[ROCm][DI][CI] Enable WideEP EP16/DP16 tests by lcskrishna · Pull Request #59266 · vllm-project/vllm

lcskrishna · 2026-09-29T18:27:06Z

Purpose

This PR enables ROCm DI WideEP EP16 tests.
Currently the following models are added :

DeepSeek-V3
DeepSeek-R1-Fp4
Kimi K2.6 & 2.5
GLM5.2
MiniMax M3

Test Plan

Run all these models on AMD DI CI.

Test Result

https://buildkite.com/vllm/amd-distributed-inference-ci/builds/118/list

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.

claude

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

mergify · 2026-10-13T06:17:15Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @lcskrishna.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

mergify · 2026-10-16T14:34:47Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @lcskrishna.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

lcskrishna · 2026-10-16T16:29:21Z

Dependent PRs are merged; Reopening it and is ready for review.

#59596 (FP4 MoE MoRI)
#58585 (GLM HMA changes)
#58989 (Skip all reduce changes)

claude

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

Folds b90eee6, 190c7ac, 74a998d, 9327e85, d1e2300 and 57f33bb. Their conflicts with upstream were resolved in merge 212dddc; this is that merge's diff against df4dbe4. Signed-off-by: lcskrishna <lollachaitanya@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com>

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

Verified on Spur MI350X cluster (4 nodes, nightly + MORI 5c88676c): - GSM8K flexible: 93.25% - GSM8K strict: 93.25% Signed-off-by: Tej Kiran <kiran.tej@amd.com> Co-authored-by: Tej Kiran <kiran.tej@amd.com> Signed-off-by: lcskrishna <lollachaitanya@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com>

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

…sts (#27) * Add MiniMax-M3-MXFP8 and GLM-5.2-FP8 2P2D EP16 WideEP MoRIIO vllm-router CI Mirror Kimi-K2.5 2P2D EP16 entry (#24). Verified on Spur MI350X this week: both models PASS on toy proxy and vllm-router (2P2D EP16/DP16). Co-authored-by: Cursor <cursoragent@cursor.com> * Add proxy companions for MiniMax and GLM 2P2D EP16 CI steps Match the proxy + vllm-router pairing used for lower topologies (e.g. GLM catalog PR pattern). Co-authored-by: Cursor <cursoragent@cursor.com> --------- Co-authored-by: avininjamay8 <avpaul@amd.com> Co-authored-by: Cursor <cursoragent@cursor.com> Signed-off-by: lcskrishna <lollachaitanya@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Avinash Paul <Avinash.Paul@amd.com>

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

…M3 EP16 Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

shen-shanshan · 2026-10-21T08:18:55Z

/ci run

github-actions · 2026-10-21T08:19:15Z

✅ Triggered Buildkite CI #96360 for commit 01d98cac543a.

Signed-off-by: lcskrishna <lollachaitanya@gmail.com> Signed-off-by: Tej Kiran <kiran.tej@amd.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Tej Kiran <kiran.tej@amd.com> Co-authored-by: avininjamay8 <avpaul@amd.com> Co-authored-by: Avinash Paul <Avinash.Paul@amd.com> Co-authored-by: Shanshan Shen <467638484@qq.com>

lcskrishna requested review from Harry-Chen, khluu, mgoin, pavanimajety and zyongye as code owners September 29, 2026 18:27

claude Bot reviewed Sep 29, 2026

View reviewed changes

mergify Bot added ci/build rocm Related to AMD ROCm labels Sep 29, 2026

github-project-automation Bot added this to AMD Sep 29, 2026

lcskrishna marked this pull request as draft September 29, 2026 18:28

mergify Bot added deepseek Related to DeepSeek models kv-connector labels Oct 13, 2026

mergify Bot added the needs-rebase label Oct 13, 2026

lcskrishna force-pushed the csrikris-internode-di-ci branch from 4d6e2e5 to 3077af5 Compare October 15, 2026 11:58

mergify Bot removed the needs-rebase label Oct 15, 2026

mergify Bot added the needs-rebase label Oct 16, 2026

lcskrishna force-pushed the csrikris-internode-di-ci branch from 4890ed0 to 5d30756 Compare October 16, 2026 16:29

lcskrishna marked this pull request as ready for review October 16, 2026 16:43

claude Bot reviewed Oct 16, 2026

View reviewed changes

mergify Bot removed the needs-rebase label Oct 16, 2026

lcskrishna and others added 3 commits October 21, 2026 05:04

remove explicit mori installation as nightly has it now

c09df7e

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

enable kimi k2.6mxfp4 ep16

d0591f9

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

lcskrishna force-pushed the csrikris-internode-di-ci branch from 85c953c to 1504e42 Compare October 21, 2026 05:11

lcskrishna and others added 3 commits October 21, 2026 05:36

add kimi k2.6 mxfp4 2p2d ep16 test

6cb9371

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

upgrade automation with spur 0.14 compatibility

1c4e02c

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

lcskrishna and others added 12 commits October 21, 2026 05:36

glm5.2 fp8 changes added

ffb0715

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

update concurrency and hf cache

dcfeb0d

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

update execute model timeout settings

e360cef

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

drop overlays now in nightly vllm-project#58585,vllm-project#59596

f70a9af

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

update vllm-project#58589 overlay: reduce MoE output once for TP and EP

9a405da

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

run CI inside the vllm-ci reservation while it is active

af3a2fa

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

skip overlays the image already ships

62493ba

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

raise P/D startup budget to 5400s and fit step timeouts

6165f51

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

drop the deepseek_v32 overlay now in nightly (vllm-project#58589)

e7e4466

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

keep the HF cache in container /tmp

dc9325f

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

remove the unused vLLM overlay plumbing

4550e5b

Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

lcskrishna force-pushed the csrikris-internode-di-ci branch from 19bdd54 to 4550e5b Compare October 21, 2026 05:37

lcskrishna and others added 2 commits October 21, 2026 06:29

run the disagg CI blocks in sequence; 3h workload budget for MiniMax-…

e194007

…M3 EP16 Signed-off-by: lcskrishna <lollachaitanya@gmail.com>

Merge branch 'main' into csrikris-internode-di-ci

01d98ca

shen-shanshan approved these changes Oct 21, 2026

View reviewed changes

shen-shanshan merged commit 64c5f14 into vllm-project:main Oct 21, 2026
20 checks passed

github-project-automation Bot moved this from Todo to Done in AMD Oct 21, 2026

lcskrishna mentioned this pull request Oct 30, 2026

[RFC]: [ROCm][DistInf]: Distributed Inference (Disaggregated P/D + Wide-EP) CI Enablement on ROCm #48117

Open

1 task done

Navigation Menu

Repository navigation

[ROCm][DI][CI] Enable WideEP EP16/DP16 tests - #59266

[ROCm][DI][CI] Enable WideEP EP16/DP16 tests #59266
shen-shanshan merged 20 commits into
vllm-project:mainfrom
lcskrishna:csrikris-internode-di-ci

lcskrishna commented Sep 29, 2026 •

edited

Loading

Uh oh!

claude Bot left a comment

Uh oh!

mergify Bot commented Oct 13, 2026

Uh oh!

mergify Bot commented Oct 16, 2026

Uh oh!

lcskrishna commented Oct 16, 2026

Uh oh!

claude Bot left a comment

Uh oh!

shen-shanshan commented Oct 21, 2026

Uh oh!

github-actions Bot commented Oct 21, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

lcskrishna commented Sep 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

claude Bot left a comment

Choose a reason for hiding this comment

Claude Code Review

Uh oh!

mergify Bot commented Oct 13, 2026

Uh oh!

mergify Bot commented Oct 16, 2026

Uh oh!

lcskrishna commented Oct 16, 2026

Uh oh!

claude Bot left a comment

Choose a reason for hiding this comment

Claude Code Review

Uh oh!

shen-shanshan commented Oct 21, 2026

Uh oh!

github-actions Bot commented Oct 21, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

lcskrishna commented Sep 29, 2026 •

edited

Loading