Skip to content

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

[MoE] add expert tensor parallelism support for NeMo2.0 MoE

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

L2_NeMo_2_MLLAMA_MOCK_TRAINING  /  main

succeeded Jan 27, 2025 in 7m 23s