MoE-EP: wire unified MoE compute into NCCL-EP / NIXL-EP expert parallel (LL + HT) - #3686

Merged

Anerudhan merged 12 commits into

flashinfer-ai:mainfrom

Anerudhan:feat/moe_ep/enable_compute

Jun 30, 2026

Commits on Jun 30, 2026

feat(moe_ep): wire unified MoE compute API into NCCL-EP expert parallel

Anerudhan
and
claude
committed
5d4eac9
feat(moe_ep): LL algorithm/layout support (HT, RANK_MAJOR) + multi-rank correctness fixes + perf

Anerudhan
and
claude
committed
d9b6d9a
fix(moe_ep): correct HT FLAT compute (token-major received routing, unweighted combine)

Anerudhan
and
claude
committed
e92456a
bench(moe_ep): HT ep_test geometry + dispatch/combine bandwidth (GB/s)

Anerudhan
and
claude
committed
ef52c6a
docs(moe_ep): add HT FLAT section — 8-GPU results + cross-node library limitation

Anerudhan
and
claude
committed
56242d3
moe_ep: cross-node NCCL-EP HT enablement + host-call burn-down & Python fast path

Anerudhan
and
claude
committed
d289919
docs(moe_ep): consolidate EP docs to 2, prune helper scripts, rename fast-path flag

Anerudhan
and
claude
committed
f20b915
test(moe): fix two tests broken by the MoE-EP behavior changes (CI H100)

Anerudhan
and
claude
committed
63164ae
moe_ep: remove unused DispatchOutput.num_tokens + its recv-count readback

Anerudhan
and
claude
committed
200dacc
moe_ep: address PR review comments (correctness, lint, fail-fast)

Anerudhan
and
claude
committed
3d6a459
build_backend: rename `on` loop var to `is_enabled` for readability

Anerudhan
and
claude
committed
f275e4b
address PR review: stale combine params, nvcc fail-fast, recv-count device

Anerudhan
and
claude
committed
8cde1f6