Skip to content

Overlap experimental Megatron-FSDP communication with two process groups - #5772

Draft
wujingyue wants to merge 1 commit into
NVIDIA:mainfrom
wujingyue:mfsdp-overlap-two-process-groups
Draft

Overlap experimental Megatron-FSDP communication with two process groups#5772
wujingyue wants to merge 1 commit into
NVIDIA:mainfrom
wujingyue:mfsdp-overlap-two-process-groups

Commits

Commits on Jul 13, 2026