Skip to content

Revert "[CI/Build] Enable Qwen3.5 tests on CI" (#35763)#35818

Closed
zhewenl wants to merge 1 commit intovllm-project:mainfrom
zhewenl:auto-revert/pr-35763
Closed

Revert "[CI/Build] Enable Qwen3.5 tests on CI" (#35763)#35818
zhewenl wants to merge 1 commit intovllm-project:mainfrom
zhewenl:auto-revert/pr-35763

Conversation

@zhewenl
Copy link
Collaborator

@zhewenl zhewenl commented Mar 3, 2026

Revert of #35763

This reverts commit cc0d565 (merge commit of PR #35763).

Original PR: #35763
Failure count: 2 new CI failures linked to this PR
Build: https://buildkite.com/vllm/ci/builds/54051

Failing tests

  • Multi-Modal Processor — Qwen3.5 models fail with ValueError: Video metadata is required but not found in mm input
  • Multi-Modal Processor Test (CPU) — Same Qwen3.5 video metadata error

Root cause

PR #35763 enabled Qwen3.5 model tests in tests/models/registry.py. The Qwen3.5 models inherit from Qwen2-VL video parsing which requires video metadata, but the test harness does not provide it for these models, causing all Qwen3.5-related multimodal processor test cases to fail.


Auto-generated by CI failure analyzer

@mergify mergify bot added the qwen Related to Qwen models label Mar 3, 2026
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to fix CI failures related to Qwen3.5 model tests by updating the test models in tests/models/registry.py to their -Instruct versions. This change is intended to resolve a ValueError caused by missing video metadata in the test environment. While the code change appears to be a valid fix, the pull request is titled and described as a 'Revert' of PR #35763. This is misleading because the changes are an update, not a reversion. For better clarity and maintainability of the project's history, I recommend updating the pull request title and description to accurately reflect that this is a fix. For example, a title like 'Fix: Update Qwen3.5 test models to resolve CI failures' would be more appropriate.

@Isotr0py
Copy link
Member

Isotr0py commented Mar 3, 2026

I think #35797 has fixed it with correct patching

@DarkLight1337
Copy link
Member

Closing as superseded by #35797

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

qwen Related to Qwen models

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants