Skip to content

[CI] Consolidate per-version model labels into vendor/family labels - #65753

Merged
WoosukKwon merged 2 commits into
vllm-project:mainfrom
jcotant-inferact:ci/vendor-model-labels
Nov 5, 2026
Merged

WoosukKwon merged 2 commits into
vllm-project:mainfrom
jcotant-inferact:ci/vendor-model-labels

Conversation

@jcotant-inferact

Copy link
Copy Markdown
Collaborator

Purpose

The repo currently tracks a mix of vendor/family labels (deepseek, qwen, minimax, kimi, …) and per-model-version labels (DSv4, DSv4.1, k3, Qwen3.5+). Every new model iteration requires new label automation, which has become diminishing returns. This consolidates labeling onto vendor/family labels (matching what SGLang does for new-model tracking):

  • Drop the DSv4 / DSv4.1 rules — DSv4 mentions in titles now fold into the deepseek vendor label. The existing deepseek file rules already cover the vllm/models/deepseek_v4*/ trees, so no coverage is lost.
  • Drop the k3 launch-triage rule — K3 mentions now fold into the kimi family label (the rule was already marked "retire after ramp-down").
  • Same consolidation in the issue_autolabel workflow for issues.

mrv1-only / mrv2 are Model Runner V1/V2 (engine internals), not model versions — left untouched. Qwen3.5+ has no automation; it is a manual label only.

Post-merge action for a maintainer

Delete the now-unused labels from repo settings: DSv4, DSv4.1, k3, Qwen3.5+.

Test Plan

  • Both YAML files parse; the workflow's embedded JS passes node --check.
  • Simulated the matcher logic against sample titles: DSv4 serving crash → deepseek, Deepseek V4.1 MTP regression → deepseek, K3 MTP acceptance rate low → kimi, Kimi K3 reasoning parser bug → kimi.

Track models under their vendor (or family, for Kimi) instead of
maintaining a label per model version:

- Drop the DSv4 / DSv4.1 rules; DSv4 mentions now fold into the
  existing deepseek vendor label (file rules already covered the
  deepseek_v4 / deepseek_v41 trees).
- Drop the k3 launch-triage rule; K3 mentions now fold into the kimi
  family label.
- Apply the same changes to the issue_autolabel workflow.

The DSv4, DSv4.1, k3 and Qwen3.5+ labels themselves (unused by
automation after this change) can be deleted from the repo settings.
@jcotant-inferact
jcotant-inferact requested a review from a team November 4, 2026 22:35

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mergify mergify Bot added the ci/build label Nov 4, 2026
@WoosukKwon
WoosukKwon merged commit f962123 into vllm-project:main Nov 5, 2026
8 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants