Skip to content

feat(minimaxm3): refresh B200 AgentX Pareto points with EAGLE3-GQA / 使用 EAGLE3-GQA 刷新 MiniMax-M3 B200 AgentX 帕累托点 #2611

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Oseltamivir merged 7 commits into from
Aug 16, 2026
Merged

feat(minimaxm3): refresh B200 AgentX Pareto points with EAGLE3-GQA / 使用 EAGLE3-GQA 刷新 MiniMax-M3 B200 AgentX 帕累托点 #2611

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
37f4331
feat(minimaxm3): refresh B200 AgentX Pareto points with EAGLE3-GQA
xinli-sw Aug 14, 2026
b934549
revert: drop benchmark script byte-unit change from B200 PR
xinli-sw Aug 14, 2026
ef93aae
chore: add PR link to perf-changelog for minimaxm3 B200 refresh
xinli-sw Aug 14, 2026
c3a012d
fix(minimaxm3-b200): drop TP2 offload point, B200 HBM too small
xinli-sw Aug 14, 2026
502ee97
chore: remove comment from B200 minimaxm3 agentic config
xinli-sw Aug 14, 2026
5c3e65c
feat(minimaxm3-b200): restructure offload sweep to full-capacity TP4
xinli-sw Aug 14, 2026
5a6b317
chore: merge main into MiniMax-M3 B200 refresh
Oseltamivir Aug 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions configs/nvidia-master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7234,7 +7234,7 @@ minimaxm3-fp4-b300-vllm-agentic-mtp:
# the same 3 TB AgentX ceiling before the proportional-GPU rule is applied.
# GPU-resident points receive a zero budget.
minimaxm3-fp4-b200-vllm-agentic-mtp:
image: vllm/vllm-openai:nightly-5e35a6f4f9bbc217c599692157ca985c894373f7
image: vllm/vllm-openai:nightly-ac7509e2b1db40fec2f03dde1ed4e9dfdc2338c9
model: nvidia/MiniMax-M3-NVFP4
model-prefix: minimaxm3
runner: cluster:b200-dgxc
Expand All @@ -7245,8 +7245,11 @@ minimaxm3-fp4-b200-vllm-agentic-mtp:
agentic-coding:
- dram-utilization: 0.683
search-space:
- { tp: 4, spec-decoding: mtp, kv-offloading: none, conc-list: [1, 2, 5, 8, 10, 12, 15, 20] }
- { tp: 4, spec-decoding: mtp, kv-offloading: dram, kv-offload-backend: { name: vllm-simple }, conc-list: [20, 30, 40] }
- { tp: 8, spec-decoding: mtp, kv-offloading: none, conc-list: [1] }
- { tp: 4, spec-decoding: mtp, kv-offloading: none, conc-list: [1, 5, 10, 15, 20] }
- dram-utilization: 1.0
search-space:
- { tp: 4, spec-decoding: mtp, kv-offloading: dram, kv-offload-backend: { name: vllm-simple }, conc-list: [15, 20, 25, 30, 32, 34, 36, 38, 40] }
# Preserve the B200 TP4 search space and add the GB200 Pareto candidates found
# by direct DEP and P/D tuning.
minimaxm3-fp4-gb200-dynamo-vllm-agentic-agg-mtp:
Expand Down
8 changes: 8 additions & 0 deletions perf-changelog.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5999,3 +5999,11 @@
- "Add the tuned GB200 MiniMax-M3 FP4 AgentX frontier with EAGLE3, the B200 TP4 baseline, DEP4/DEP8, SimpleCPU offload, and KV-routed P/D."
- "Use full-decode-only CUDA graphs for TP4 stability."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2609

- config-keys:
- minimaxm3-fp4-b200-vllm-agentic-mtp
scenario-type:
- agentic-coding
description:
- "Refresh the MiniMax-M3 B200 AgentX submission: no-offload TP8 C1 and TP4 C1/C5/C10/C15/C20, plus a TP4 SimpleCPU KV-offload sweep at C15–C40 using the full-capacity DRAM budget."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2611