Skip to content

[Models] Allow converting Qwen3-VL into Reranker model#31890

Merged
Isotr0py merged 13 commits intovllm-project:mainfrom
Isotr0py:qwen3-vl-rerank
Jan 8, 2026
Merged

[Models] Allow converting Qwen3-VL into Reranker model#31890
Isotr0py merged 13 commits intovllm-project:mainfrom
Isotr0py:qwen3-vl-rerank

Conversation

@Isotr0py
Copy link
Copy Markdown
Member

@Isotr0py Isotr0py commented Jan 7, 2026

Purpose

  • Enable reranker support for Qwen3-VL

Test Plan

python examples/pooling/score/vision_language_reranker.py -m qwen3_vl_reranker

Test Result

Query: A woman playing with her dog on a beach at sunset.
Relevance scores: [0.8426481485366821, 0.6725457310676575]
# HF reference: [0.8430634140968323, 0.6631059646606445]

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Isotr0py and others added 5 commits January 7, 2026 16:45
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Jan 7, 2026

Documentation preview: https://vllm--31890.org.readthedocs.build/en/31890/

@mergify mergify bot added documentation Improvements or additions to documentation qwen Related to Qwen models labels Jan 7, 2026
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds support for converting Qwen3-VL models into reranker models. The changes are well-implemented and consistent across the codebase. The core logic correctly generalizes configuration handling to allow hf_overrides to adapt the model for sequence classification tasks. This is achieved by prioritizing the top-level Hugging Face config for parameters like classifier_from_token and method. The logic for accessing the text backbone in multimodal models is also made more robust. The addition of documentation and an example file is a great touch and makes the new feature easy to use. Overall, this is a solid contribution.

Comment thread docs/models/supported_models.md Outdated
Comment thread examples/pooling/pooling/vision_language_pooling.py Outdated
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
@mergify mergify bot added the frontend label Jan 7, 2026
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
@Isotr0py Isotr0py marked this pull request as ready for review January 7, 2026 16:22
@Isotr0py Isotr0py added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 8, 2026
@Isotr0py Isotr0py enabled auto-merge (squash) January 8, 2026 05:40
@Isotr0py Isotr0py merged commit eac3b96 into vllm-project:main Jan 8, 2026
56 checks passed
@Isotr0py Isotr0py deleted the qwen3-vl-rerank branch January 8, 2026 09:31
yugong333 pushed a commit to yugong333/vllm that referenced this pull request Jan 9, 2026
akh64bit pushed a commit to akh64bit/vllm that referenced this pull request Jan 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation frontend qwen Related to Qwen models ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants