[Model] Add MoE support for NemotronH#25863

Merged

tlrmchlsmth merged 16 commits intovllm-project:mainfrom

tomeras91:add-nemotronH-moe

Oct 23, 2025

Commits on Sep 18, 2025

Add option for MoE layers in NemotronH, with non-gated MoE with squaredReLu activation - adapt the FusedMoE object to support is_act_and_mul=False
tomeras91
committed
Add support for non-gated moe in triton path for ModelOptFp8MoEMethod
tomeras91
committed

Commits on Sep 28, 2025

Merge branch 'main' into add-nemotronH-moe
tomeras91
committed
(1) fix weight_scale shape (2) avoid circular import
tomeras91
committed
Add is_act_and_mul to FusedMoEConfig instead of keeping it directly as an attribute in FusedMoE
tomeras91
committed

Commits on Oct 15, 2025

Commits on Oct 19, 2025

Commits on Oct 21, 2025

Merge branch 'main' into add-nemotronH-moe
tomeras91
committed

Commits on Oct 23, 2025

Merge branch 'main' into add-nemotronH-moe
tomeras91
authored