[Models] Allow converting Qwen3-VL into Reranker model#31890
[Models] Allow converting Qwen3-VL into Reranker model#31890Isotr0py merged 13 commits intovllm-project:mainfrom
Conversation
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
Documentation preview: https://vllm--31890.org.readthedocs.build/en/31890/ |
There was a problem hiding this comment.
Code Review
This pull request adds support for converting Qwen3-VL models into reranker models. The changes are well-implemented and consistent across the codebase. The core logic correctly generalizes configuration handling to allow hf_overrides to adapt the model for sequence classification tasks. This is achieved by prioritizing the top-level Hugging Face config for parameters like classifier_from_token and method. The logic for accessing the text backbone in multimodal models is also made more robust. The addition of documentation and an example file is a great touch and makes the new feature easy to use. Overall, this is a solid contribution.
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
…31890) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
…31890) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Purpose
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.