Skip to content
Back to pull request #11880

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

Sign in to view logs

[MoE] add expert tensor parallelism support for NeMo2.0 MoE

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

L2_Megatron_Core_T5_Pretraining_and_Resume_Training_TP2  /  main

L2_Megatron_Core_T5_Pretraining_and_Resume_Training_TP2 / main
succeeded Jan 27, 2025 in 3m 33s