Skip to content

[CI] Enroll the remaining Distributed, EP and fault-tolerance jobs in automatic sharding (25 jobs) - #64593

Merged
khluu merged 1 commit into
vllm-project:mainfrom
Thangnguyenvn98:agent/automatic-shard-distributed
Oct 30, 2026
Merged

khluu merged 1 commit into
vllm-project:mainfrom
Thangnguyenvn98:agent/automatic-shard-distributed

Conversation

@Thangnguyenvn98

@Thangnguyenvn98 Thangnguyenvn98 commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Overview

Enrolls the remaining Distributed, EP and fault-tolerance jobs in automatic_shard: 25 jobs (13 steps and 12 AMD mirrors). Part of a series that enrolls every remaining test step, split by test area for review. No commands change.

Claims

Step Plan AMD mirror
distributed-compile-comm-4-gpus 1 shard 1 shard
distributed-torchrun-shutdown-tests-2-gpus 1 job (not plain pytest) 1 job (not plain pytest)
distributed-comm-ops 1 shard 1 shard
sharded-rdt-weight-transfer 1 shard 1 shard
distributed-tests-8xh100 1 job (not plain pytest) 1 job (not plain pytest)
preload-2-gpus 1 shard 1 shard
distributed-compile-rpc-tests-2-gpus 1 shard 1 shard
gemm-rs-ar-2xb200 1 shard 1 shard
distributed-tests-2xb200 1 shard 1 shard
qwen4-exp-sp-tests-4-gpus 1 shard 1 shard
eplb-execution 1 shard 1 shard
eplb-algorithm 1 shard 1 shard
amd-fault-tolerance-e2e-2xh100 1 shard none
  • One-shard and one-job plans run the same tests as on main, as one job, and split by themselves once their tests grow.

Validation

  • Planned each step and mirror with ci-infra main's planner against main's timings; every plan is within 10% of the same plan run as one job.
  • The sharding harness (each shard's commands run against a mock test tree, as a PR build and as main with the OTel wrapper) shows every test runs exactly once wherever a plan has 2 or more shards.
  • Every step and mirror passes on recent main runs, nightly included.
  • /ci run (98458) plus a scoped build (98469) for the optional steps and AMD mirrors on this head: every enrolled job passed, and every shard finished under 22 minutes.

Details

  • Not plain pytest steps (shell scripts, torchrun, examples) are enrolled too; the generator keeps them as one job. Standalone AMD steps plan like any other since Fix automatic sharding for standalone AMD jobs and selected tests ci-infra#871.
  • caplog. Files that assert on logs sit in one-shard plans here, so their order in the process doesn't change.
  • Timeouts unchanged. timeout_in_minutes stays per job. Fallback-aware timeouts belong in a central timeout setting.

🤖 Generated with Claude Code


Pull Request Checklist
  • I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

  • AI assistance was used during the creation of this PR.

  • Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

  • Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

  • Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

  • Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.

BEFORE SUBMITTING, PLEASE READ https://docs.vllm.ai/en/latest/contributing (anything written below this line will be removed by GitHub Actions)

… automatic sharding

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
@mergify mergify Bot added the ci/build label Oct 29, 2026
@Thangnguyenvn98

Copy link
Copy Markdown
Contributor Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #98458 for commit 2f6d2960cdf1.

@Thangnguyenvn98
Thangnguyenvn98 marked this pull request as ready for review October 30, 2026 01:01
@Thangnguyenvn98
Thangnguyenvn98 requested a review from a team October 30, 2026 01:01

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@khluu
khluu merged commit c5e37f1 into vllm-project:main Oct 30, 2026
94 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants