Skip to content
Back to pull request #11880

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

Sign in to view logs

[MoE] add expert tensor parallelism support for NeMo2.0 MoE

[MoE] add expert tensor parallelism support for NeMo2.0 MoE #7704

L2_Megatron_GPT_PEFT_Lora_TP2SP1  /  main

L2_Megatron_GPT_PEFT_Lora_TP2SP1 / main
succeeded Jan 27, 2025 in 1m 12s