Skip to content

add MiniCPM-o 4.5 recipe under recipes/OpenBMB#4067

Merged
hsliuustc0106 merged 1 commit into
vllm-project:mainfrom
tc-mb:recipe/minicpmo-4-5
Jun 2, 2026
Merged

add MiniCPM-o 4.5 recipe under recipes/OpenBMB#4067
hsliuustc0106 merged 1 commit into
vllm-project:mainfrom
tc-mb:recipe/minicpmo-4-5

Conversation

@tc-mb

@tc-mb tc-mb commented Jun 2, 2026

Copy link
Copy Markdown
Contributor

Purpose

Add a community recipe documenting how to serve openbmb/MiniCPM-o-4_5
on vLLM-Omni, following the structure of the existing
recipes/Qwen/Qwen3-Omni.md and recipes/OpenBMB/VoxCPM2.md.

The MiniCPM-o 4.5 integration itself already landed in
#3642 (model code + 3 default deploy configs + Gradio demo); this PR
only adds the recipe file + a row in the central recipes/README.md
table. No source code is touched.

What's added

  • recipes/OpenBMB/MiniCPM-o-4_5.md — covers the three shipped GPU
    layouts:
    • 2-GPU default (minicpmo_4_5.yaml)
    • 3-GPU thinker TP=2 (minicpmo_4_5_3gpu.yaml)
    • 8x RTX 4090 (minicpmo_4_5_8x4090.yaml)
  • Recipe also documents:
    • The stepaudio2-minicpmo talker dependency and the
      pip install 'vllm-omni[minicpmo]' install path
    • The chat_template_kwargs.use_tts_template=true gate that
      triggers speech output
    • The hf_config.version == "4.5" routing predicate that prevents
      misrouting MiniCPM-o 2.6 checkpoints into the 4.5 pipeline
  • recipes/README.md — added one row to the Available Recipes table,
    inserted in alphabetical order before OpenBMB/VoxCPM2.md.

Test Plan

Documentation-only change. All relative links in the recipe resolve to
files that exist in this PR's base (verified locally against
origin/main post-rebase).

Signed-off-by: tc-mb <tianchi_cai@icloud.com>
@chatgpt-codex-connector

Copy link
Copy Markdown

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

@hsliuustc0106 hsliuustc0106 merged commit da9c45e into vllm-project:main Jun 2, 2026
3 checks passed
86MaxCao pushed a commit to 86MaxCao/vllm-omni that referenced this pull request Jun 4, 2026
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
@tc-mb tc-mb deleted the recipe/minicpmo-4-5 branch June 8, 2026 08:57
akshatvishu pushed a commit to akshatvishu/vllm-omni that referenced this pull request Jun 13, 2026
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants