Skip to content

[ROCm][CI] Add ROCm Docker Hub registry cache and weekly cleanup pipeline#307

Open
AndreasKaratzas wants to merge 9 commits intomainfrom
akaratza_optimize_docker_build
Open

[ROCm][CI] Add ROCm Docker Hub registry cache and weekly cleanup pipeline#307
AndreasKaratzas wants to merge 9 commits intomainfrom
akaratza_optimize_docker_build

Conversation

@AndreasKaratzas
Copy link
Collaborator

@AndreasKaratzas AndreasKaratzas commented Mar 13, 2026

  • ci-rocm.hcl: New overlay file for ROCm CI builds. Implements registry cache (Docker Hub rocm/vllm-ci-cache) with 4-layer fallback: exact commit -> parent commit -> merge-base with main -> rocm-latest baseline.
  • test-template-amd.j2: Refactored from inline | shell block to commands: + env: block. Switches to pinned bash .buildkite/scripts/ci-bake.sh (in vllm repo) instead of curl-at-runtime. Main-branch builds now write rocm-latest via DOCKERHUB_CACHE_TO.
  • bootstrap-amd.sh: Deepen shallow clone so git merge-base resolves correctly for cache key computation.
  • cleanup-dockerhub-rocm-cache.sh + pipelines/cleanup-dockerhub-rocm-cache.yaml: Weekly scheduled pipeline that prunes commit-specific rocm-<sha> tags older than 30 days from Docker Hub, keeping rocm-latest permanently.

Requires DOCKERHUB_USERNAME + DOCKERHUB_TOKEN secrets on the cleanup pipeline.

This PR is connected to: vllm-project/vllm#36949
These two PRs should likely be merged simultaneously.

cc @kenroche @okakarpa @tjtanaa @khluu

…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
@AndreasKaratzas AndreasKaratzas marked this pull request as draft March 13, 2026 18:27
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
…line

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant