fix(megatron-fsdp): reduce padding for grouped expert weights - #4979

fix(megatron-fsdp): reduce padding for grouped expert weights#4979

xuwchen wants to merge 3 commits into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

xuwchen:mfsdp_grouped_expert_paddingxuwchen/Megatron-LM:mfsdp_grouped_expert_paddingCopy head branch name to clipboard