Skip to content

[ROCm][CI] Bump ROCk base to ROCm 10.0 - #55246

Merged
dllehr-amd merged 4 commits into
vllm-project:mainfrom
Rohan138:rock10-bump
Sep 4, 2026
Merged

dllehr-amd merged 4 commits into
vllm-project:mainfrom
Rohan138:rock10-bump

Conversation

@Rohan138

@Rohan138 Rohan138 commented Sep 3, 2026

Copy link
Copy Markdown
Collaborator

Purpose

Bump the TheRock base (docker/Dockerfile.rock_base) from ROCm 7.14.0 to 10.0.0 and switch the ROCk nightly tags rocm714rocm100. Based on @rasmith's ROCm:vllm:rock10 dockerfile; follows #55014.

Scoped for a first landing:

  • Triton: prebuilt 3.8.0+git4cff872c.rocm10.0.0 wheel (exactly torch's Requires-Dist). Source rebuild from release/internal/3.8.x dropped for now — follow-up.
  • AOTriton: version/kernel-image guard dropped; ROCm 10 ships stock AOTriton.
  • AITER v0.1.19v0.1.21.post1, mirroring merged [ROCm] Bump AITER to 0.1.21.post1 #52826 (its runtime changes are already on main).
  • ENV ROCPROFILER_QUEUE_INTERPOSITION=0 — torch 2.12 rocprofiler hangs at HSA teardown; mirrors [ROCm][Perf][Bugfix] Multi-stream perf improvements; rocprofiler fixes #55099. The ROCr/CLR + rocprofiler-sdk source rebuilds from rocm_base are not ported (7.2.x-targeted; 10.0 carries the fixes; /opt/rocm vs TheRock layout).
  • docker/Dockerfile.rock unchanged.

Not a duplicate: no open PR bumps Dockerfile.rock_base to ROCm 10. AI assistance (Claude Code) was used; reviewed and owned by me.

Test Plan

python3 -c "import yaml; yaml.safe_load(open('.buildkite/release-pipeline.yaml'))"
DOCKER_BUILDKIT=1 docker build --check -f docker/Dockerfile.rock_base --target final .

Test Result

YAML parses; docker build --check clean apart from two pre-existing SCCACHE_S3_NO_CREDENTIALS lints in unmodified lines. Full image build validated by the release pipeline.

@coderabbitai

coderabbitai Bot commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Team

Run ID: 25d851b9-ddfc-4518-925e-efcbcd749da1

📥 Commits

Reviewing files that changed from the base of the PR and between 7dc30f5 and 8928918.

📒 Files selected for processing (2)
  • .buildkite/release-pipeline.yaml
  • docker/Dockerfile.rock_base

Included review availability: Your plan provides up to 10 included reviews per hour; 8 remain after this review.


📝 Summary

Summary by CodeRabbit

  • Updates
    • Upgraded ROCm support to version 10.0.0 in the ROCK Docker image.
    • Updated PyTorch, TorchVision, and TorchAudio packages to ROCm 10-compatible builds.
    • Updated AITER to version 0.1.21.post1 and Triton to a pinned prebuilt version.
    • Nightly Docker image publishing and cleanup now use ROCm 10 image tags.
    • Updated stable and nightly package sources for ROCm 10 builds.

Walkthrough

The ROCk Docker image now uses ROCm 10.0.0 packages, a pinned Triton wheel, and updated final-image settings. The nightly release pipeline passes rocm100 and cleans up matching DockerHub tags.

Changes

ROCm 10 ROCk image

Layer / File(s) Summary
ROCm 10 toolchain and Triton inputs
docker/Dockerfile.rock_base
The Dockerfile updates ROCm, PyTorch, AITER, and wheel repository versions. It replaces source-built Triton with a pinned Triton wheel.
Triton packaging and final image setup
docker/Dockerfile.rock_base
Intermediate stages stop copying Triton wheels. The final stage installs and verifies the pinned Triton version and disables rocprofiler queue interposition.
Nightly publishing tags
.buildkite/release-pipeline.yaml
The nightly publish step uses rocm100 and targets the corresponding cleanup tags.

Estimated code review effort: 2 (Simple) | ~10 minutes

Merge Risk: ⚪ Minimal · up to 89289

The ROCk image now targets ROCm 10.0.0 with pinned Triton packaging and ROCm 10 nightly tags. The configured package validation and publishing-tag contract are aligned, with no concrete merge-blocking risk identified.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description check ✅ Passed The description clearly explains the ROCm 10.0 migration, tag updates, Triton changes, environment setting, and test results described in the changeset.
Title check ✅ Passed The title clearly and concisely identifies the CI change: updating the ROCk base image to ROCm 10.0.

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@mergify mergify Bot added ci/build rocm Related to AMD ROCm labels Sep 3, 2026
@github-project-automation github-project-automation Bot moved this to Todo in AMD Sep 3, 2026
@Rohan138 Rohan138 changed the title [ROCm][CI] Bump Dockerfile.rock_base to ROCm 10.0 (prebuilt triton 3.8.x) [ROCm][CI] Bump Dockerfile.rock_base to ROCm 10.0 + AITER 0.1.21.post1 Sep 3, 2026
Comment thread docker/Dockerfile.rock_base Outdated
Comment thread docker/Dockerfile.rock_base Outdated
Comment thread docker/Dockerfile.rock_base Outdated
Comment thread docker/Dockerfile.rock_base Outdated
Comment thread docker/Dockerfile.rock_base Outdated
Comment thread docker/Dockerfile.rock_base Outdated
Rohan138 and others added 4 commits September 3, 2026 21:35
…8.x)

Bump the TheRock base image from ROCm 7.14.0 to 10.0.0, based on Randy
Smith's rock10 dockerfile: torch/vision/audio 2.12.0/0.27.0/2.11.0+rocm10.0.0
from the whl-next channels, ROCM_SDK_VERSION=10.0.0, and triton pinned to the
prebuilt 3.8.0+git4cff872c.rocm10.0.0 wheel (exactly torch's Requires-Dist).
Switch the pipeline publish/cleanup tags from rocm714 to rocm100.

Scoped down from Randy's commit for a first landing:
- Drop the triton source-rebuild stage (release/internal/3.8.x @ 0d631838);
  the prebuilt 4cff wheel is used for now. A follow-up will add the rebuild
  back to pull in the newer 3.8.x commits.
- Drop the AOTriton version/kernel-image guard; ROCm 10 ships stock AOTriton,
  and the accuracy guard is a later CI concern.
- Keep the existing docker/Dockerfile.rock (Randy's triton_kernels PR-965
  patch + commit bump land via a separate fix).

Co-authored-by: Randall Smith <Randall.Smith@amd.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Mirror vllm-project#52826 (which bumped Dockerfile.rocm_base) for the TheRock base image.
The vLLM-side runtime adaptations from vllm-project#52826 (fused_flydsl_moe, mxfp4 test)
are already on main and ride along when this merges.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Drop the explanatory comments called out in review (TRITON_VERSION, whl-next
URLs, final-stage triton, "displace our pins"), remove the redundant base-stage
torch/triton verification RUN, and drop `RUN ldconfig` (only needed when
rebuilding AOTriton).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
torch 2.12 attaches rocprofiler-sdk implicitly and its queue interposition
hangs at HSA teardown. Set ROCPROFILER_QUEUE_INTERPOSITION=0 in the final
image, matching the mitigation in vllm-project#55099 for Dockerfile.rocm_base. The ROCr/CLR
and rocprofiler-sdk source rebuilds from rocm_base are not ported: they target
ROCm 7.2.x and ROCm 10.0 already carries those fixes.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
@Rohan138
Rohan138 marked this pull request as ready for review September 4, 2026 02:36

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@dllehr-amd dllehr-amd left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's make the bump

@Rohan138 Rohan138 changed the title [ROCm][CI] Bump Dockerfile.rock_base to ROCm 10.0 + AITER 0.1.21.post1 [ROCm][CI] Bump ROCk base to ROCm 10.0 Sep 4, 2026
@dllehr-amd dllehr-amd added the ready ONLY add when PR is ready to merge/full CI is needed label Sep 4, 2026
@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown

@Rohan138, CI is now available for this PR.

  • /ci run starts upstream CI; /amd-ci run starts AMD CI only.
  • /ci retry retries failed jobs in the CI build for the current PR head. If the current head has no CI build, it starts a new CI build for the current head containing only jobs that failed in the latest earlier CI build for this PR.
  • /amd-ci retry retries failed jobs in AMD CI for the current PR head. Use /amd-ci run when the current head has no AMD CI build.
  • /ci cancel cancels scheduled or running CI builds for this PR branch; /amd-ci cancel does the same for AMD CI only.

@Rohan138

Rohan138 commented Sep 4, 2026

Copy link
Copy Markdown
Collaborator Author

/ci run

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #87183 for commit 892891826ac4.

@dllehr-amd
dllehr-amd enabled auto-merge (squash) September 4, 2026 03:23
@dllehr-amd
dllehr-amd merged commit 1560505 into vllm-project:main Sep 4, 2026
33 checks passed
@github-project-automation github-project-automation Bot moved this from Todo to Done in AMD Sep 4, 2026
@Rohan138
Rohan138 deleted the rock10-bump branch September 4, 2026 03:43
ItsRoy69 pushed a commit to ItsRoy69/vllm that referenced this pull request Sep 10, 2026
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Jyotirmoy Roy <jyotirmoyroy649@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/build ready ONLY add when PR is ready to merge/full CI is needed rocm Related to AMD ROCm

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants