Skip to content
Back to pull request #11880

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

Sign in to view logs

[MoE] add expert tensor parallelism support for NeMo2.0 MoE

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

OPTIONAL_L2_NeMo_2_Mixtral_LoRA_TP2PP1_MBS1  /  main

OPTIONAL_L2_NeMo_2_Mixtral_LoRA_TP2PP1_MBS1 / main
succeeded Jan 27, 2025 in 2m 34s