Skip to content

[CI] Disable jobs with unlocked transitive dependencies - #63608

Merged
khluu merged 1 commit into
vllm-project:mainfrom
khluu:codex/disable-unlocked-dependency-ci
Oct 25, 2026
Merged

khluu merged 1 commit into
vllm-project:mainfrom
khluu:codex/disable-unlocked-dependency-ci

Conversation

@khluu

@khluu khluu commented Oct 25, 2026 •

Copy link
Copy Markdown
Member

Overview

Temporarily disable the CI jobs listed below until their transitive dependencies are locked. Keep the job definitions commented out so they can be restored without reconstructing their configuration.

Claims

Package installed by job Disabled jobs
evalscope==1.10.0 B200/H200 nightly Qwen3.8 accuracy evaluation and MI355 evaluation
helion==1.4.0 H100 and MI250 Helion kernel tests
b12x==1.5.1 DGX Spark nightly b12x linear kernels
torchao==0.18.0 / 0.17.0 H200 MIG, MI300 and MI355 DPX quantization
torch-abi-audit==0.0.1 MI300 Torch Stable ABI Audit
tblib==3.1.0 BMG Example Test that invokes run-intel-ci-test.sh example
  • Disable both shared definitions/AMD mirrors and the standalone AMD definitions: 15 job declarations, counting mirrors.
  • Keep the NVIDIA Torch Stable ABI Audit and other Intel jobs enabled. The separate Intel pipeline's Example Test does not invoke the script that installs tblib, so it remains enabled.
  • Record the 42 test files that lose their last CI job in the test-tethering allowlist, each with the dependency-locking reason.

Validation

Passed:

.venv/bin/python -m pre_commit run --files \
  .buildkite/hardware_tests/intel_xpu_ci/test-intel.yaml \
  .buildkite/test-amd.yaml \
  .buildkite/test_areas/kernels.yaml \
  .buildkite/test_areas/lm_eval.yaml \
  .buildkite/test_areas/quantization.yaml \
  .buildkite/test_areas/torch_abi.yaml \
  tools/pre_commit/test_tethering_allowlist.txt
.venv/bin/python tools/pre_commit/check_buildkite_step_keys.py
git diff --check

Additional local validation parsed every Buildkite YAML file and compared the six changed YAML documents against the base commit: the only semantic changes are removal of the listed job declarations and the AMD-only ABI mirror. The locally available ci-infra read_steps_from_job_dir loader successfully loaded 389 steps across all ci_config*.yaml configurations. No active targeted package-install command remains in the affected definitions.

GPU tests/model evaluations were not run: this changes CI scheduling only, with no model, serving, or test implementation changes. Live Buildkite execution was not tested.

Details

A top-level version pin does not freeze the transitive dependency graph. This is the requested temporary scheduling mitigation, not a dependency-locking fix or a claim that every listed package has a demonstrated vulnerable dependency.

The pipeline generator's Step model does not support a skip field, so this uses the existing commented-out-job convention. Restore the blocks and remove the corresponding temporary allowlist entries once the dependency environments are locked. Coverage is intentionally reduced while these jobs are disabled.

Duplicate-work checks searched open PRs for evalscope, Helion, dependency changes, and CI disablement. No existing PR implementing this disablement was found. #63574 updates dependency floors and lockfiles rather than disabling these jobs; #62077 changes sharding and is also distinct. No issue number was supplied.

AI assistance was used to prepare and validate this change.


Pull Request Checklist
  • I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

  • AI assistance was used during the creation of this PR.

  • Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

  • Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

  • Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

  • Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need.

Temporarily disable the evalscope, Helion, b12x, torchao, AMD ABI audit, and tblib-installing Intel example jobs. Preserve their definitions and document the resulting test coverage gaps.

Co-authored-by: Codex <noreply@openai.com>

Signed-off-by: khluu <khluu000@gmail.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mergify mergify Bot added the ci/build label Oct 25, 2026
@khluu
khluu merged commit 9d48c8a into vllm-project:main Oct 25, 2026
14 checks passed
Micador pushed a commit to Micador/vllm that referenced this pull request Oct 27, 2026
…#63608)

Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Christopher Mackenzie <christopher.mackenzie.software@gmail.com>
Micador pushed a commit to Micador/vllm that referenced this pull request Oct 27, 2026
…#63608)

Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Christopher Mackenzie <christopher.mackenzie.software@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant