Skip to content

fix: checkpoint saving with distributed optimizer + overlap param gather#949

Merged
terrykong merged 1 commit into
NVIDIA-NeMo:mainfrom
ananthsub:ananthsub/fix-ckpt-save-dist-opt-overlap-param-gather
Aug 21, 2025
Merged

fix: checkpoint saving with distributed optimizer + overlap param gather#949
terrykong merged 1 commit into
NVIDIA-NeMo:mainfrom
ananthsub:ananthsub/fix-ckpt-save-dist-opt-overlap-param-gather

handle forward pre hooks if dist opt + param gather are used together…

4bb99f1
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 20, 2025 in 1s

DCO

All commits are signed off!

View more details on DCO