Skip to content

[MRV2] Add routed-expert capture support on top of #44214 - #3

Closed
aoshen02 wants to merge 5 commits into
xuanyu-mistral:xuanyu/enable-fi-monolithic-moe-rrfrom
aoshen02:agent/mrv2-monolithic-r3-on-44214
Closed

aoshen02 wants to merge 5 commits into
xuanyu-mistral:xuanyu/enable-fi-monolithic-moe-rrfrom
aoshen02:agent/mrv2-monolithic-r3-on-44214

Conversation

@aoshen02

Copy link
Copy Markdown

Summary

This stacked follow-up adds Model Runner V2 routed-expert capture support on top of xuanyu/enable-fi-monolithic-moe-rr from vllm-project#44214.

Before this change, Model Runner V2 only bound BaseRouter capture callbacks. Monolithic MoE kernels perform routing inside the fused expert kernel, so supported monolithic kernels from vllm-project#44214 never received the routed-expert capture callback and R3 results could be missing or all zero.

This change:

  • keeps the existing modular BaseRouter capture path;
  • discovers the monolithic fused_experts implementation through the V2 MoE quantization path;
  • binds the replay callback only when supports_routing_replay_capture() is true;
  • adds V2 binding coverage and keeps unsupported monolithic kernels unbound.

This PR is intentionally stacked on both vllm-project#38163 (Model Runner V2 expert-index capture) and vllm-project#44214 (FlashInfer monolithic replay support). The requested base branch is xuanyu/enable-fi-monolithic-moe-rr in xuanyu-mistral/vllm.

Validation

AI assistance was used. A human submitter should review every changed line and verify the stacked dependencies before merging.

WoosukKwon and others added 5 commits March 25, 2026 23:48
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants