Skip to content

fix(megatron-fsdp): compute SWiGLU/GDN split in item coordinates for non-DTensor optimizer states - #4423

Open
xuwchen wants to merge 2 commits into
NVIDIA:mainfrom
xuwchen:fix_mfsdp_ckpt_save
Open

fix(megatron-fsdp): compute SWiGLU/GDN split in item coordinates for non-DTensor optimizer states#4423
xuwchen wants to merge 2 commits into
NVIDIA:mainfrom
xuwchen:fix_mfsdp_ckpt_save

Commits

Commits on Apr 22, 2026

Commits on May 15, 2026