Skip to content
Back to pull request #11880

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

Sign in to view logs

[MoE] add expert tensor parallelism support for NeMo2.0 MoE

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

L2_Megatron_GPT_Auto_Configurator_TP1_PP1_MBS124  /  main

L2_Megatron_GPT_Auto_Configurator_TP1_PP1_MBS124 / main
succeeded Jan 27, 2025 in 2m 38s