Skip to content

[BAGEL] [Feature]: Add thinking mode in Bagel multi-stage serving#2447

Merged
princepride merged 5 commits into
vllm-project:mainfrom
princepride:add-think-model-in-bagel-2
Apr 3, 2026
Merged

[BAGEL] [Feature]: Add thinking mode in Bagel multi-stage serving#2447
princepride merged 5 commits into
vllm-project:mainfrom
princepride:add-think-model-in-bagel-2

Conversation

@princepride
Copy link
Copy Markdown
Collaborator

@princepride princepride commented Apr 2, 2026

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Add thinking mode in Bagel multi-stage serving

Test Plan

python3 ./examples/offline_inference/bagel/end2end.py   --stage-configs-path vllm_omni/model_executor/stage_configs/bagel_think.yaml   --modality img2img   --image-path women.jpg   --prompts "Let the woman wear a blue dress"   --think

Test Result

** Without thinking mode: **

image

** With thinking mode: **

<think>\nThe user requests to change the red jacket into a blue dress while maintaining the overall structure and layout of the image. The background, pose, and accessories like the white poodle pin remain unchanged.\n</think>
image
Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan. Please provide the test scripts & test commands. Please state the reasons if your codes don't require additional test scripts. For test file guidelines, please check the test style doc
  • The test results. Please paste the results comparison before and after, or the e2e results.
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model. Please run mkdocs serve to sync the documentation editions to ./docs.
  • (Optional) Release notes update. If your change is user-facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

Signed-off-by: princepride <wangzhipeng628@gmail.com>
@princepride princepride changed the title [BAGEL] [Feature]: Add think model in Bagel online serving [BAGEL] [Feature]: Add thinking mode in Bagel online serving Apr 2, 2026
@princepride princepride changed the title [BAGEL] [Feature]: Add thinking mode in Bagel online serving [BAGEL] [Feature]: Add thinking mode in Bagel multi-stage serving Apr 2, 2026
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
@princepride
Copy link
Copy Markdown
Collaborator Author

@natureofnature PTAL

@princepride princepride marked this pull request as ready for review April 2, 2026 10:42
Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 59b9c22451

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread vllm_omni/model_executor/models/bagel/bagel.py Outdated
Comment thread vllm_omni/model_executor/models/bagel/bagel.py
Copy link
Copy Markdown
Collaborator

@lishunyang12 lishunyang12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

left a few comments — one looks like a real bug with cfg_img missing multimodal data.

Comment thread vllm_omni/model_executor/stage_input_processors/bagel.py
Comment thread vllm_omni/model_executor/models/bagel/bagel.py
Comment thread examples/offline_inference/bagel/end2end.py Outdated
Comment thread vllm_omni/model_executor/models/bagel/bagel.py Outdated
Signed-off-by: princepride <wangzhipeng628@gmail.com>
@princepride
Copy link
Copy Markdown
Collaborator Author

@lishunyang12 PTAL

@princepride princepride requested a review from lishunyang12 April 2, 2026 16:37
@princepride princepride added the ready label to trigger buildkite CI label Apr 3, 2026
Copy link
Copy Markdown
Collaborator

@lishunyang12 lishunyang12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@princepride princepride merged commit fa275fd into vllm-project:main Apr 3, 2026
7 of 8 checks passed
linyueqian pushed a commit to JuanPZuluaga/vllm-omni that referenced this pull request Apr 3, 2026
vraiti pushed a commit to vraiti/vllm-omni that referenced this pull request Apr 9, 2026
lengrongfu pushed a commit to lengrongfu/vllm-omni that referenced this pull request May 1, 2026
clodaghwalsh17 pushed a commit to clodaghwalsh17/nm-vllm-omni-ent that referenced this pull request May 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready label to trigger buildkite CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants