Skip to content

[AMD][AgentX] Add Kimi-K3 MXFP4 MI355X vLLM agentic MTP recipe #2508

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
cquil11 merged 59 commits into from
Aug 12, 2026
Merged

[AMD][AgentX] Add Kimi-K3 MXFP4 MI355X vLLM agentic MTP recipe #2508

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
14b8df0
[AMD][AgentX] kimik3 vllm-agentic MTP: add DSpark recipe + container …
seungrokj Aug 4, 2026
f92380e
[AMD][AgentX] kimik3 vllm-agentic MTP: moe-backend auto, load-format …
seungrokj Aug 4, 2026
60da246
[AMD][AgentX] kimik3 vllm-agentic MTP: drop --max-num-batched-tokens
seungrokj Aug 4, 2026
da59f22
[AMD][AgentX] kimik3 vllm-agentic MTP: bf16 KV A/B + FULL_DECODE_ONLY…
seungrokj Aug 4, 2026
2e4bdb6
[AMD][AgentX] kimik3 vllm-agentic MTP: bump gpu-memory-utilization to…
seungrokj Aug 4, 2026
4aaa36c
[AMD][AgentX] kimik3 vllm-agentic MTP: gluondspark bf16-KV patch stac…
seungrokj Aug 5, 2026
28939b8
[AMD][AgentX] kimik3 vllm-agentic MTP: piecewise cudagraph capture + …
seungrokj Aug 6, 2026
0b0a596
[AMD][AgentX] kimik3 vllm-agentic MTP: add perf-changelog entry for M…
seungrokj Aug 6, 2026
9c3e5e5
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
seungrokj Aug 6, 2026
7154c2e
[AMD][AgentX] kimik3 vllm-agentic MTP: FULL_AND_PIECEWISE cudagraph, …
seungrokj Aug 7, 2026
95d6788
[AMD][AgentX] kimik3 vllm-agentic MTP: trim MI355X sweep to conc 8 fo…
seungrokj Aug 7, 2026
f27d5a3
[AMD][AgentX] kimik3 vllm-agentic MTP: fp8 KV + GMU 0.9 to fix KDA pr…
seungrokj Aug 7, 2026
86b5d7d
[AMD][AgentX] kimik3 vllm-agentic MTP: bf16 KV at GMU 0.85 A/B
seungrokj Aug 7, 2026
31e7ccd
[AMD][AgentX] kimik3 vllm-agentic MTP: switch KV back to fp8 at GMU 0.85
seungrokj Aug 7, 2026
2df49f0
[AMD][AgentX] kimik3 vllm-agentic MTP: fix warmup illegal-address by …
seungrokj Aug 7, 2026
0652bf2
[AMD][AgentX] kimik3 vllm-agentic MTP: lower GMU to 0.8
seungrokj Aug 7, 2026
6f901f3
[AMD][AgentX] kimik3 vllm-agentic MTP: add aiter #4494 split-K graph-…
seungrokj Aug 8, 2026
6aed0a4
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
seungrokj Aug 8, 2026
a2e800a
[AMD][AgentX] remove kimik2.5-fp4-mi355x-vllm-disagg config
seungrokj Aug 8, 2026
2ff0d9d
[AMD][AgentX] kimik3 vllm-agentic MTP: raise GMU to 0.9, narrow sweep…
seungrokj Aug 8, 2026
16ee774
[AMD][AgentX] kimik3 vllm-agentic MTP: hybrid asm-decode + gluon-veri…
seungrokj Aug 8, 2026
4d7a132
Modify search-space configurations in amd-master.yaml
seungrokj Aug 8, 2026
453b02e
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
seungrokj Aug 8, 2026
96119d7
[AMD][AgentX] kimik3 vllm-agentic MTP: explicit cudagraph_capture_siz…
seungrokj Aug 9, 2026
b572edf
[AMD][AgentX] kimik3 vllm-agentic MTP: narrow sweep to conc=8
seungrokj Aug 9, 2026
7346abb
[AMD][AgentX] kimik3 vllm-agentic MTP: switch DSpark draft model to R…
seungrokj Aug 9, 2026
644631c
[AMD][AgentX] kimik3 vllm-agentic MTP: stage DSpark draft locally, pa…
seungrokj Aug 9, 2026
a1321e7
[AMD][AgentX] kimik3 vllm-agentic MTP: dense cudagraph_capture_sizes …
seungrokj Aug 9, 2026
ad99c16
[AMD][AgentX] kimik3 vllm-agentic MTP: cap max-num-batched-tokens at …
seungrokj Aug 9, 2026
33e1976
[AMD][AgentX] kimik3 vllm-agentic MTP: handle asm-term-absent hybrid …
seungrokj Aug 9, 2026
0e57d34
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
seungrokj Aug 9, 2026
818b5b8
[AMD][AgentX] kimik3 vllm-agentic MTP: restore full conc sweep [4,8,1…
seungrokj Aug 9, 2026
1f5fa3a
[AMD][AgentX] kimik3 vllm-agentic MTP: narrow conc sweep to [8, 14]
seungrokj Aug 9, 2026
aa043c6
[AMD][AgentX] kimik3 vllm-agentic MTP: widen conc sweep [1,4,8,10,14,…
seungrokj Aug 9, 2026
3098a6f
[AMD][AgentX] kimik3 vllm-agentic MTP: fix cudagraph capture size mis…
seungrokj Aug 9, 2026
f0c5fae
[AMD][AgentX] kimik3 vllm-agentic MTP: pin fixed cudagraph capture sizes
seungrokj Aug 9, 2026
9ee8c0e
[AMD][AgentX] kimik3 vllm-agentic MTP: load Inferact DSpark draft, na…
seungrokj Aug 10, 2026
4ced5b9
[AMD][AgentX] kimik3 vllm-agentic MTP: shrink cudagraph capture list …
seungrokj Aug 10, 2026
7b10e76
[AMD][AgentX] kimik3 vllm-agentic MTP: use TRITON_MLA for DSpark draf…
seungrokj Aug 10, 2026
a834685
[AMD][AgentX] kimik3 vllm-agentic MTP: embed offline container patche…
seungrokj Aug 10, 2026
7a16386
[AMD][AgentX] kimik3 vllm-agentic MTP: contiguous cudagraph capture 1…
seungrokj Aug 10, 2026
9766780
[AMD][AgentX] kimik3 vllm-agentic MTP: switch conc sweep to [8]
seungrokj Aug 10, 2026
b5024e0
[AMD][AgentX] kimik3 vllm-agentic MTP: cudagraph_mode FULL_DECODE_ONL…
seungrokj Aug 10, 2026
3caf461
[AMD][AgentX] kimik3 vllm-agentic MTP: HYBRID verify fix for DSpark H…
seungrokj Aug 10, 2026
36e932b
[AMD][AgentX] kimik3 vllm-agentic MTP: KDA state-index stride (vllm #…
seungrokj Aug 10, 2026
8330f10
[AMD][AgentX] kimik3 vllm-agentic MTP: aiter #4521 fp8 cprr asm MLA v…
seungrokj Aug 11, 2026
986ae4c
[AMD][AgentX] kimik3 vllm-agentic MTP: MAX_NUM_SEQS=20, cudagraph cap…
seungrokj Aug 11, 2026
7dee539
[AMD][AgentX] kimik3 vllm-agentic MTP: narrow search-space to conc [8]
seungrokj Aug 11, 2026
6b0f0e0
[AMD][AgentX] kimik3 vllm-agentic MTP: cudagraph capture 60, simplify…
seungrokj Aug 11, 2026
9febb71
[AMD][AgentX] kimik3 vllm-agentic MTP: add spec-decoding mtp to vllm-…
seungrokj Aug 11, 2026
950732f
[AMD][AgentX] kimik3 vllm-agentic MTP: fix vllm-simple SIMPLE_RANKS u…
seungrokj Aug 11, 2026
e5559e4
[AMD][AgentX] kimik3 vllm-agentic MTP: drop LMCache/native/mooncake o…
seungrokj Aug 11, 2026
e8f6106
[AMD][AgentX] kimik3 vllm-agentic MTP: b300 vllm-simple lazy_offload=…
seungrokj Aug 11, 2026
c93b729
[AMD][AgentX] kimik3 vllm-agentic MTP: vllm-simple dram conc sweep [1…
seungrokj Aug 11, 2026
abd65bc
[AMD][AgentX] kimik3 vllm-agentic MTP: b300 lazy_offload=false; mi355…
seungrokj Aug 12, 2026
0baf642
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
seungrokj Aug 12, 2026
4d2d5a2
[AMD][AgentX] kimik3 vllm-agentic MTP: add mi355x container-patch wai…
seungrokj Aug 12, 2026
2a3ffd1
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
seungrokj Aug 12, 2026
27f35f6
Merge branch 'main' into amd/agentx_k3_vllm_dev_0804
cquil11 Aug 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading