Skip to content

[BugFix] Restore vllm_c IR op priority and torch.nn.RMSNorm for Qwen-Image (Same As #5009) - #5016

Closed
NumberWan wants to merge 26 commits into
vllm-project:release/v0.24.1from
NumberWan:fix/4964-restore-vllm-c-ir-priority
Closed

NumberWan wants to merge 26 commits into
vllm-project:release/v0.24.1from
NumberWan:fix/4964-restore-vllm-c-ir-priority

Conversation

@NumberWan

Copy link
Copy Markdown
Contributor

Details Please See #5009

yuanheng-zhao and others added 26 commits July 7, 2026 08:09
…extras (vllm-project#4835)

Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
…llm-project#4936)

Signed-off-by: SamitHuang <285365963@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
…llm-project#4647)

Signed-off-by: Advik <scince5678@gmail.com>
Signed-off-by: Nightwing-77 <scince5678@gmail.com>
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: Advik <scince5678@gmail.com>
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
…t#3573)

Signed-off-by: loveysuby <loveysuby@users.noreply.github.com>
Signed-off-by: Hyoseop Song <crad_on25@naver.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: loveysuby <loveysuby@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
… vendored tokenizers (vllm-project#4760)

Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
…ckends (vllm-project#4926)

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
…plate_kwargs usage (vllm-project#4950)

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: leo <yaoliu548926@gmail.com>
…n3-tts min_tokens engine crash) (vllm-project#4971)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
…yload opt-out (vllm-project#4879)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
…tched MTP sampling (vllm-project#4970)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com>
… & Adapt to async output (vllm-project#4923)

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: leo <yaoliu548926@gmail.com>
…project#4261)

Signed-off-by: 林鑫 <77673148+l-wave@users.noreply.github.com>
Co-authored-by: yurain <yurain26@users.noreply.github.com>
…roject#4964)

The v0.24 rebase adopted upstream inductor-aware CUDA defaults that select
native-only RMSNorm when compilation is active. For Qwen-Image diffusion this
forces the denoise loop onto a slower native decomposition path instead of
vLLM CUDA kernels, causing large nightly perf regressions.

Restore Omni's default IR op priority to prefer vllm_c kernels while
keeping the existing VLLM_USE_OINK_OPS behavior.

Fixes vllm-project#4964

Signed-off-by: NumberWan <wantszkin2003@gmail.com>
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
Revert to the vllm-project#4074 RMSNorm backend for Qwen-Image diffusion layers.
Avoids vLLM IR dispatch overhead on the denoise hot path.

Signed-off-by: NumberWan <wantszkin2003@gmail.com>
…#4964)

Assert inductor-active configs still prefer vllm_c over native for
rms_norm and fused_add_rms_norm, including VLLM_USE_OINK_OPS ordering.

Signed-off-by: NumberWan <wantszkin2003@gmail.com>
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
@chatgpt-codex-connector

Copy link
Copy Markdown

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

@mergify

mergify Bot commented Jul 10, 2026

Copy link
Copy Markdown

⚠️ The sha of the head commit of this PR conflicts with #5009. Mergify cannot evaluate rules on this PR. Once #5009 is merged or closed, Mergify will resume processing this PR. ⚠️

@NumberWan NumberWan closed this Jul 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.