Add MoE + expert-parallel (MoeEp) Python API with MegaMoE CuTe DSL backend - #448

Draft

mhoqueanik wants to merge 10 commits into

NVIDIA:developfrom

mhoqueanik:moe_ep_megamoe_backend

Commits on Jul 14, 2026

Add MoE + expert-parallel Python API surface, PyTorch reference, and tests

Anerudhan
and
claude
committed
c159fb6
Update moe_ep design doc for the backward reference

Anerudhan
and
claude
committed
b713803
Document and stub the MoeEp.backward call contract

Anerudhan
and
claude
committed
50df079

Commits on Jul 20, 2026

Wire the MegaMoE (CuTe DSL) device backend into cudnn.MoeEp

mhoqueanik
and
claude
committed
1f9db74

Commits on Jul 29, 2026

Apply black formatting to moe_ep Python files

mhoqueanik
and
claude
committed
d5cb1d4

Commits on Aug 5, 2026

Vendor the MegaMoE CuTe DSL backend so the PR is self-sufficient

mhoqueanik
and
claude
committed
cb00e4d
Drop the external-checkout override; kernels always load from the bundle

mhoqueanik
and
claude
committed
17c0529
Add a standalone runbook for running and testing the MoeEp PR

mhoqueanik
and
claude
committed
279def9
Runbook: add an environment-creation section; vendor the kernel pip pins

mhoqueanik
and
claude
committed
798571b
Runbook: replace environment-specific example commands with generic ones

mhoqueanik
and
claude
committed
2dfd8e0