Skip to content

[AMD][ROCM] dsv4-fp4-mi355x-vllm, Bump vLLM ROCm image to (nightly-4f940896) #1546

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
seungrokj merged 11 commits into from
May 21, 2026
Merged

[AMD][ROCM] dsv4-fp4-mi355x-vllm, Bump vLLM ROCm image to (nightly-4f940896) #1546

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
a1f861a
Bump vLLM ROCm image for dsv4-fp4-mi355x-vllm (nightly-4f940896)
seungrokj May 21, 2026
3bf0dec
Update perf-changelog with PR #1546
seungrokj May 21, 2026
fb54c92
Update server args for dsv4-fp4-mi355x-vllm: add compilation-config, …
seungrokj May 21, 2026
fd1afed
Update dsv4_fp4_mi355x_vllm.sh
seungrokj May 21, 2026
bdbc449
Merge branch 'main' into dsv4-fp4-mi355x-vllm-20260521
seungrokj May 21, 2026
5883e5a
Update dsv4_fp4_mi355x_vllm.sh
seungrokj May 21, 2026
e52f5a5
Update amd-master.yaml
seungrokj May 21, 2026
436a199
Update dsv4_fp4_mi355x_vllm.sh
seungrokj May 21, 2026
c2e0775
Apply HF_HUB_CACHE_MOUNT override for vllm framework on DeepSeek-V4-Pro
seungrokj May 21, 2026
f067820
Remove VLLM_CACHE_ROOT workaround for dsv4 fp4 vllm
seungrokj May 21, 2026
8763922
Add --async-scheduling and --no-enable-prefix-caching to dsv4 fp4 vllm
seungrokj May 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/configs/amd-master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1795,7 +1795,7 @@ dsv4-fp4-mi355x-sglang:
# gpu-mem-util=0.6. TP8 sweeps conc 4-64; DEP8 has a single conc=64
# probe to validate the ROCm DP+EP path.
dsv4-fp4-mi355x-vllm:
image: vllm/vllm-openai-rocm:nightly-b50646e5effd7cb5884cd96fdff4c53c18521198
image: vllm/vllm-openai-rocm:nightly-4f940896a32c9e2a0eba7f50d521bf5f6b4de458
model: deepseek-ai/DeepSeek-V4-Pro
model-prefix: dsv4
runner: mi355x
Expand Down
6 changes: 6 additions & 0 deletions perf-changelog.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3050,3 +3050,9 @@
description:
- "Update SGLang image from v0.5.11-cu130 (5d old) to v0.5.12-cu130"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1475

- config-keys:
- dsv4-fp4-mi355x-vllm
description:
- "Bump vLLM ROCm image from nightly-b50646e5effd7cb5884cd96fdff4c53c18521198 to nightly-4f940896a32c9e2a0eba7f50d521bf5f6b4de458"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/PLACEHOLDER

Check failure on line 3058 in perf-changelog.yaml

View check run for this annotation

Claude / Claude Code Review

perf-changelog pr-link contains literal PLACEHOLDER 

The new perf-changelog entry's `pr-link` field at line 3058 still contains the literal string `PLACEHOLDER` instead of this PR's number (1546). The resulting URL `https://github.com/SemiAnalysisAI/InferenceX/pull/PLACEHOLDER` will 404 once merged — please replace `PLACEHOLDER` with `1546` before merge.
Comment thread
seungrokj marked this conversation as resolved.
Resolved