[fix] Training wire-up for hybrid EP-overlap (4/4 of #4798) - #4944

[fix] Training wire-up for hybrid EP-overlap (4/4 of #4798)#4944

Connor-XY wants to merge 12 commits into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

Connor-XY:pr4798-4-training-wireupConnor-XY/Megatron-LM:pr4798-4-training-wireupCopy head branch name to clipboard