Skip to content

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

[MoE] add expert tensor parallelism support for NeMo2.0 MoE

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

L2_Megatron_GPT_Finetuning_StarCoder_PP1  /  main

succeeded Jan 27, 2025 in 1m 25s