[dev] Replace DP balance all-to-all rerouting with all-gather - #6378

[dev] Replace DP balance all-to-all rerouting with all-gather#6378

xiaoyao0115 merged 1 commit into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

xiaoyao0115:fix/dp-balance-allgatherxiaoyao0115/Megatron-LM:fix/dp-balance-allgatherCopy head branch name to clipboard