Skip to content

Explicitly pass expert_tensor_parallel_size to initialize_model_parallel#537

Merged
ananthsub merged 2 commits intoNVIDIA-NeMo:mainfrom
nathan-az:pass-expert-tp-to-init
Sep 4, 2025
Merged

Explicitly pass expert_tensor_parallel_size to initialize_model_parallel#537
ananthsub merged 2 commits intoNVIDIA-NeMo:mainfrom
nathan-az:pass-expert-tp-to-init

Commits

Commits on Sep 3, 2025