Skip to content

Overlap FSDP communication with compute - #5719

Merged
wujingyue merged 8 commits into
NVIDIA:mainfrom
wujingyue:mfsdp-prefetch-on-5513
Jul 16, 2026
Merged

Overlap FSDP communication with compute#5719
wujingyue merged 8 commits into
NVIDIA:mainfrom
wujingyue:mfsdp-prefetch-on-5513

Assert Megatron-FSDP overlap happens instead of requiring the maximum

8dd7c46
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 16, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO