Skip to content

[CI] Shard entrypoints API-server tests - #52344

Merged
vllm-bot merged 1 commit into
vllm-project:mainfrom
khluu:ci-shard-entrypoints-api-server
Sep 2, 2026
Merged

vllm-bot merged 1 commit into
vllm-project:mainfrom
khluu:ci-shard-entrypoints-api-server

Conversation

@khluu

@khluu khluu commented Aug 14, 2026

Copy link
Copy Markdown
Member

Why

In the 24-hour dashboard window ending 2026-09-01 10:31 UTC:

  • NVIDIA Entrypoints API Server: 2,735s P90 (42 runs)
  • AMD Entrypoints API Server: 2,733s P90 (41 runs)

What changed

Partition the main serve and scale-out collections across four pytest shards, run the RPC singleton once, and apply the identical partition to the AMD mirror.

No merged or active non-draft PR covers this job.

Validation

  • YAML parse
  • current ci-infra Buildkite step schema
  • all YAML command entries pass bash -n
  • git diff --check

Targeted CI

Build #86570 passed. API Server shards 1–4: 18:54, 25:59, 21:43, 23:20. The three changed sibling keys also passed: Generate 26:37, OpenAI Part 1 17:48, and OpenAI Part 2 32:16.

This is a draft pending human review. AI assistance was used.

@mergify mergify Bot added the ci/build label Aug 14, 2026
@mergify

mergify Bot commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @khluu.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added the needs-rebase label Aug 19, 2026
Assisted-by: AI
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
@khluu khluu changed the title [CI] Shard entrypoints API server [CI] Shard entrypoints API-server tests Sep 1, 2026
@khluu
khluu force-pushed the ci-shard-entrypoints-api-server branch from 06119b0 to be8acdb Compare September 1, 2026 10:57
@mergify mergify Bot removed the needs-rebase label Sep 1, 2026
@khluu
khluu marked this pull request as ready for review September 1, 2026 22:26
@khluu
khluu requested a review from Harry-Chen as a code owner September 1, 2026 22:26

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@vllm-bot
vllm-bot merged commit 878ec4b into vllm-project:main Sep 2, 2026
13 checks passed
mylibrar pushed a commit to tanyuqian/vllm that referenced this pull request Sep 3, 2026
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
sheralskumar pushed a commit to sheralskumar/vllm that referenced this pull request Sep 8, 2026
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants