Skip to content

[cherry-pick][release/v0.32.0] Backport 14 milestone fixes and regressions (batch 4) - #9334

Merged
tzhouam merged 17 commits into
vllm-project:release/v0.32.0from
tzhouam:cherry-pick/release-v0.32.0-batch4
Oct 24, 2026
Merged

tzhouam merged 17 commits into
vllm-project:release/v0.32.0from
tzhouam:cherry-pick/release-v0.32.0-batch4

Conversation

@tzhouam

@tzhouam tzhouam commented Oct 24, 2026 •

Copy link
Copy Markdown
Collaborator

Purpose

Fourth backport batch for release/v0.32.0, following #9295. Includes the 14 selected upstream PRs tied to v0.32.0 issues or required regression coverage. Base: bb3c0521628cfa13cdb2ace76c525c811c313b33.

Source PR Release issue / purpose
#8801 #8796: preserve native MiniMax-H3 local snapshot layout
#9289 #9287: register native KV specs in fast-allocation tests
#9244 #6882: repair the NPU full_attn_spans sub-path; does not establish full issue resolution
#9171 #9166: align 1x1 Wan VAE attention queries
#9107 #9072: allow a cold-start timeout budget for the first duplex open
#7880 #7729: re-aim a dropped silence continuation at the opened answer
#9302 Repair the spans-precedence regression from #9248, already included in #9295
#9303 ROCm math-kernel test coverage accompanying #9171
#9041 #6843: place stage-CLI test replicas on separate GPUs
#5784 #5659: resolve missing OmniVoice reference text and align audio preprocessing
#9249 #6179: reject recompute preemption for AR stages that cannot replay safely
#9276 Strengthen the existing #6223 GroupNorm workaround regression; no underlying kernel fix claimed
#8874 #8817: keep diffusion LoRA buffers on the compute device
#8868 #8850: correct trailing VAE tile placement and blending

#9270 and #9273 remain separate release backports (#9274 and #9275); they are not duplicated here.

Backport adaptations

No new models or performance optimizations from the intervening main commits are included.

Contributor intent

Outcome: bring the selected v0.32.0 issue fixes and their necessary regressions to the release line. The controlling variable is whether the existing affected release paths contain these fixes. This batch backports the established upstream implementations and tests for users encountering those release failures; it does not broaden the release feature set.

Validation

Head: bbf9bde14189e83469853f396f03e8c060f5e55b.
Local CPU environment: Python 3.12.13, vLLM 0.32.0, PyTorch 2.13.0+cu130, Diffusers 0.40.0, pytest 9.1.1.

Final integrated command (from the backport checkout):

PYTHONPATH=. python -m pytest -o addopts='' -m cpu -q --tb=short \
  tests/core/sched/test_omni_recompute_preemption.py \
  tests/model_executor/models/test_recompute_preemption_declarations.py \
  tests/model_executor/models/fish_omni/test_fish_omni_model_state.py \
  tests/model_executor/models/qwen3_omni/test_qwen3_omni_preempt_replay.py \
  tests/config/test_omni_config.py \
  tests/diffusion/models/minimax_h3/test_fasth3_checkpoint.py \
  tests/diffusion/attention/test_flash_attn.py \
  tests/entrypoints/openai_api/test_tts_adapter.py

Ruff, formatting, documentation lint, SPDX, forbidden imports, test marks, and applicable remaining pre-commit hooks pass. Mypy retains six pre-existing errors, reproduced on the release-base tree: four in attention/layer.py, one in duplex_omni_engine.py, and one in the pre-existing LoRA test. The new NPU helper's typing error was fixed.

Not run locally: CUDA/NPU/XPU/ROCm model E2E or hardware kernels. This environment lacks the native vllm._C extension and has stale installed Omni version metadata; passing CPU tests are not hardware evidence. Current-head project CI is requested with ready.

AI assistance: Codex prepared the backports, resolved release-context conflicts, reviewed patch scope, ran local checks, and drafted this description.

Release CI follow-ups

The original head passed CUDA 18001, AMD 14561, NPU 9742, GitHub Actions, and docs. Intel 10742 hit Level Zero OUT_OF_RESOURCES during unchanged Z-Image text-encoder warmup, before LoRA adapters were loaded. The same test passed on release backports 10739/10740 and main 10736 (already containing #8874). Concurrent builds shared physical devices without an affinity mask; resource interference is a supported hypothesis.

The updated head also includes two minimal CI stabilizations:

All applicable checks passed on the changed files. The approved 14 source backports are unchanged. On current head 7ad5f31e3750bbeaf7b0767c9e60d0b31245c6a5, Intel 10749 passed the full four-round suite with the runner's supported ZE_AFFINITY_MASK=4,5,6,7. This retained all selected tests, including the Z-Image LoRA switching test and both three-card Qwen2.5-Omni tests; the original resource error did not recur. All 11/11 current-head checks passed: CUDA 18007, AMD 14567, Intel 10749, NPU 9748, both wheel builds, CodeQL, pre-commit, DCO, and docs. The final NPU MiniCPM-o test reported 5 passed, 12 deselected.

iboiko-habana and others added 14 commits October 24, 2026 23:40
…ct#9248 (vllm-project#9302)

Signed-off-by: Iryna Boiko <iboiko@habana.ai>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
(cherry picked from commit 8e2a7c1)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…ect#9289)

Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: wangyu <410167048@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
(cherry picked from commit bd73c65)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…spans (vllm-project#9244)

Signed-off-by: YawningPants <54137998+YawningPants@users.noreply.github.com>
Co-authored-by: changetheway <guotaoyuan1@h-partners.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: dengyunyang <584797741@qq.com>
(cherry picked from commit 0be1493)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…9171)

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: amy-why-3459 <amy-why-3459@users.noreply.github.com>
(cherry picked from commit 3ce3f97)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…get (vllm-project#9107)

Signed-off-by: kunkunblueberry <1833921874@qq.com>
(cherry picked from commit e1b99a8)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…ned (vllm-project#7880)

Signed-off-by: Armaan Amatya <armaanamatya2014@gmail.com>
(cherry picked from commit 859103e)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…m-project#9303)

Signed-off-by: haic0 <149741444+haic0@users.noreply.github.com>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: andyluo7 <andy.luo@amd.com>
(cherry picked from commit 7861026)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…lm-project#9041)

Signed-off-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
(cherry picked from commit c704a28)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…o preprocessing (vllm-project#5784)

Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
(cherry picked from commit c464923)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…ing guard (vllm-project#9276)

Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: akshatvishu <akshatnayak197@gmail.com>
(cherry picked from commit 1edbb9e)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…llm-project#8874)

Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
(cherry picked from commit e900011)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…eaves no seam (vllm-project#8868)

Signed-off-by: ZhIMQ <15000371166@163.com>
(cherry picked from commit 0f79bd8)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…lar_model_index.json (vllm-project#8801)

Signed-off-by: Sylvan Liu <Sylvan.Liu@amd.com>
(cherry picked from commit a147aaf)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
…r decode state (vllm-project#9249)

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
(cherry picked from commit c42398c)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-24T16:08:46.821386Z
We couldn’t complete this review. Comment @codex review to try again.
a4b807d Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
@tzhouam tzhouam changed the title [cherry-pick][release/v0.32.0] cherry-pick #9302 (batch 4) [cherry-pick][release/v0.32.0] Backport 14 milestone fixes and regressions (batch 4) Oct 24, 2026
@tzhouam tzhouam added the ready label to trigger buildkite CI label Oct 24, 2026 — with ChatGPT Codex Connector
@vllm-omni-review-bot

vllm-omni-review-bot commented Oct 24, 2026 •

Copy link
Copy Markdown

Omni ReviewBot triage note

Automated triage of commit 7ad5f31e3750 produced:

  • Priority: high. Prompt maintainer attention is suggested.

These are automated triage suggestions only — the final decision belongs to the maintainers.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
(cherry picked from commit 472cbeb)
Use the existing block initialization helper before the fused and native QK norm/RoPE checks. The vLLM-backed projections otherwise read uninitialized checkpoint weight allocations. Drop the redundant bare CUDA mark already supplied by hardware_marks, preserving platform and resource selection.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
(cherry picked from commit a81d739)
@tzhouam tzhouam removed the ready label to trigger buildkite CI label Oct 24, 2026
@tzhouam tzhouam added the ready label to trigger buildkite CI label Oct 24, 2026 — with ChatGPT Codex Connector
@tzhouam
tzhouam merged commit c16f4ae into vllm-project:release/v0.32.0 Oct 24, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready label to trigger buildkite CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.