[Dev] Add separate toggle for varlen input padding for HybridEP in THD training - #5048

[Dev] Add separate toggle for varlen input padding for HybridEP in THD training #5048

yaox12 merged 3 commits into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

zhongbozhu:add_moe_hybridep_pad_variable_tokenszhongbozhu/Megatron-LM:add_moe_hybridep_pad_variable_tokensCopy head branch name to clipboard