Skip to content

[LoRA] Make LoRA respect language_model_only #37375

Merged
jeejeelee merged 4 commits intovllm-project:mainfrom
jeejeelee:mm-lora-opt
Mar 18, 2026
Merged

[LoRA] Make LoRA respect language_model_only #37375
jeejeelee merged 4 commits intovllm-project:mainfrom
jeejeelee:mm-lora-opt

Conversation

@jeejeelee
Copy link
Copy Markdown
Collaborator

@jeejeelee jeejeelee commented Mar 18, 2026

Purpose

Test Plan

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to make LoRA respect the language_model_only setting in multimodal models. The change in vllm/lora/model_manager.py correctly identifies when only the language model is used, but it has a small bug where it doesn't update a crucial flag, which could lead to a runtime error. I've provided a critical comment with a suggested fix to ensure the state remains consistent. The other change is a minor import refactoring which looks good.

@jeejeelee jeejeelee requested a review from Isotr0py March 18, 2026 03:47
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
@jeejeelee jeejeelee added the ready ONLY add when PR is ready to merge/full CI is needed label Mar 18, 2026
@jeejeelee jeejeelee enabled auto-merge (squash) March 18, 2026 06:11
@jeejeelee jeejeelee merged commit 8c31f47 into vllm-project:main Mar 18, 2026
49 checks passed
@jeejeelee jeejeelee deleted the mm-lora-opt branch March 18, 2026 07:57
wendyliu235 pushed a commit to wendyliu235/vllm-public that referenced this pull request Mar 18, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
fxdawnn pushed a commit to fxdawnn/vllm that referenced this pull request Mar 19, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
SouthWest7 pushed a commit to SouthWest7/vllm that referenced this pull request Mar 27, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
khairulkabir1661 pushed a commit to khairulkabir1661/vllm that referenced this pull request Mar 27, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Monishver11 pushed a commit to Monishver11/vllm that referenced this pull request Mar 27, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
JiantaoXu pushed a commit to JiantaoXu/vllm that referenced this pull request Mar 28, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
vrdn-23 pushed a commit to vrdn-23/vllm that referenced this pull request Mar 30, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
EricccYang pushed a commit to EricccYang/vllm that referenced this pull request Apr 1, 2026
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: EricccYang <yangyang4991@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants