Skip to content

[sync] Upstream sync to v0.25.0 (2026-07-20) - #29

Merged
oglok merged 285 commits into
mainfrom
sync-upstream-2026-07-20
Jul 23, 2026
Merged

oglok merged 285 commits into
mainfrom
sync-upstream-2026-07-20

Conversation

@oglok

@oglok oglok commented Jul 22, 2026

Copy link
Copy Markdown

Summary

Syncs nm-vllm-omni-ent with upstream/main (e24bddfb, 283 commits since fork point b1a4b08a).

Uses the same merge-based workflow as nm-vllm-ent: git merge -X theirs upstream/main followed by re-applying downstream carries.

vLLM version

Bumped from v0.23.0 → v0.25.1 — upstream now requires vLLM v0.25.0+ (PR vllm-project#5043). Uses nm-cicd wheel build 29766140891 from sync-v0.25.1 branch.

Carries dropped (merged upstream)

Carry Upstream PR Merged
endpoint rejection (vllm-project#4762) PR vllm-project#4762 Jul 8
hack for single stage q3omni (PR vllm-project#3760) PR vllm-project#3760 Jun 24
fix HTTP status codes for audio voice (vllm-project#3969) PR vllm-project#3969 Jun 22
Centralize audio format constants PR vllm-project#4718 Jul 16
Switch endpoint restrict fail to warn Upstream refactored to handle gracefully N/A
Remove unregister_vllm_metrics warning Upstream removed entire monkey-patch (PR vllm-project#4396) N/A

Carries preserved

All build/infra, smoke tests, bugfix validators, and audio/text merge carries are preserved.

Carries re-applied after merge

7 files were overwritten by -X theirs and re-applied from the validated rebased branch:

Open upstream PRs still carried

Carry Upstream PR
Merge text+audio into single choice PR vllm-project#4450 closed, needs new PR
Validate TTS speech, batch, voice upload PR vllm-project#4749
Add modalities and logprobs validation PR vllm-project#4743
Add audio/generate validators PR vllm-project#4741
Add omni/sleep+wakeup validators PR vllm-project#4740
Reject empty/whitespace image prompts PR vllm-project#4723
Fix unsupported modality empty choices PR vllm-project#4720

Deferred

3 carries from v0.21.0 (lost during v0.23.0 sync): fa3-fwd, av dependency, exclude list — follow-up PR.

Test plan

  • Verify midstream build with vLLM v0.25.1 wheel
  • Run smoke tests (Qwen3-Omni, FLUX, Voxtral TTS)
  • Verify python -c "import vllm_omni" works
  • Run unit tests: pytest tests/entrypoints/openai_api/test_audio_format.py tests/entrypoints/openai_api/test_modality_validation.py tests/entrypoints/test_stream_finish_reason.py

Wallbreazzz and others added 30 commits June 18, 2026 16:58
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com>
vllm-project#4434)

Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <[Your Email]>
…tion[1/N] (vllm-project#4225)

Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
…roject#4026)

Signed-off-by: Zening Chen <59945561+zeningc@users.noreply.github.com>
Signed-off-by: zeningc <zening.chen@yahoo.com>
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
…llm-project#4415)

Signed-off-by: leo.yang <leo.yang.engineer@gmail.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
…-TTS talker (vllm-project#4230)

Signed-off-by: leo.yang <leo.yang.engineer@gmail.com>
…T Caching. (vllm-project#4213)

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
… fix stale references (vllm-project#4567)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
…ct#4494)

Signed-off-by: Kwokho Tsui <kh_tsui@163.com>
Co-authored-by: Kwokho Tsui <kh_tsui@163.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
…#3798)

Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
…llm-project#4466) (vllm-project#4525)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Sy03 <1370724210@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
…llm-project#4575)

Signed-off-by: lishunyang12 <125541396+lishunyang12@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
…M 0.23.0 (vllm-project#4428)

Signed-off-by: nagelanping <xiao.yi.ming@foxmail.com>
…ference) (vllm-project#4467)

Signed-off-by: david6666666 <530634352@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
…/skills to better match the current vllm-omni codebase and repo conventions (vllm-project#4110)

Signed-off-by: Lancer <maruixiang6688@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
FayeSpica and others added 25 commits July 17, 2026 17:32
…lm-project#5158)

Signed-off-by: Weiming Liao <liaowm5@gmail.com>
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com>
…th correct RNG handling for upcoming Cosmos3 distilled models (vllm-project#5176)

Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
…oject#4643 OOM) (vllm-project#4761)

Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
Signed-off-by: Inesh Reddy Chappidi <ineshreddy249@gmail.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
)

Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
…m-project#5031)

Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Liangyx2 <yuxiang.liang@intel.com>
Signed-off-by: Yuxiang Liang <yuxiang.liang@intel.com>
Signed-off-by: Yuxiang <yuxiang.liang@intel.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Signed-off-by: Lancer <maruixiang6688@gmail.com>
Signed-off-by: David Chen <530634352@qq.com>
…eech.py (vllm-project#4833)

Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
…ject#5136)

Signed-off-by: diyapeng <50388704+diyapeng@users.noreply.github.com>
Co-authored-by: diyapeng <50388704+diyapeng@users.noreply.github.com>
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
Signed-off-by: leo <yaoliu548926@gmail.com>
Carries wiped by `git merge -X theirs upstream/main`:
- vLLM version bump to v0.25.1 (midstream/vllm-version, vllm-wheels.yml)
- Modality validation in serving_chat.py (PR vllm-project#4720, open upstream)
- Modalities/logprobs validation string fix in api_server.py (PR vllm-project#4743)
- _SKIP_ISSUE_3649 marker in test_invalid_audio_speech.py
- test_stream_finish_reason.py helper extraction (tests/helpers/serving_chat.py)
- Formatting fix in test_invalid_omni_chat.py

Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com>
@oglok
oglok force-pushed the sync-upstream-2026-07-20 branch from ce8e744 to 5b482be Compare July 22, 2026 15:17

@dougbtv dougbtv left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same content as PR #28, verified all key midstream files are identical (Dockerfile.ubi, midstream-build.yml, docker-bake.hcl, version files, ROCm/CPU Dockerfiles — all SHA-match).

Merge-based approach (-X theirs + re-apply carries) is the right pattern for protected main — matches how nm-vllm-ent does it. The explicit list of 7 re-applied files in the PR description is a nice touch for auditability.

Previous review findings still apply (tracked in INFERENG-9317): CUDA path clean, ROCm/CPU Dockerfiles have pre-existing issues for follow-up.

LGTM for merge (use "Create a merge commit" to preserve upstream history).

@oglok
oglok merged commit 87004a3 into main Jul 23, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.