Skip to content

[Bugfix] Avoid global config lookup in sparse indexer forward - #54400

Merged
khluu merged 1 commit into
vllm-project:mainfrom
ZJY0516:fix/sparse-indexer-config-context
Aug 30, 2026
Merged

khluu merged 1 commit into
vllm-project:mainfrom
ZJY0516:fix/sparse-indexer-config-context

Conversation

@ZJY0516

@ZJY0516 ZJY0516 commented Aug 30, 2026

Copy link
Copy Markdown
Member

Purpose

Fix the DeepSeek-V4-Flash startup regression seen in Buildkite CI #86195. During memory profiling, SparseAttnIndexer reads the current vLLM config from a global context after the model-construction context has exited, causing EngineCore initialization to fail.

Fix

Keep a reference to the ParallelConfig captured during model construction and read the late-adjusted cp_kv_cache_interleave_size from that object during forward.

This preserves the post-construction PD+DCP interleave adjustment introduced by #50611 while avoiding a forward-time get_current_vllm_config() call.

AI assistance

AI assistance was used to diagnose the CI failure, prepare the code change, run validation, and draft this PR. The PR remains a draft so the human submitter can review every changed line and validate the change end-to-end before marking it ready.

Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@mergify mergify Bot added the bug Something isn't working label Aug 30, 2026
@ZJY0516
ZJY0516 marked this pull request as ready for review August 30, 2026 07:36
@ZJY0516
ZJY0516 requested a review from zyongye as a code owner August 30, 2026 07:36

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Aug 30, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-08-30T08:24:13.457389Z 25dfb9a Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@ZJY0516

ZJY0516 commented Aug 30, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #86202 for commit 25dfb9aa02e2.

@ZJY0516
ZJY0516 marked this pull request as draft August 30, 2026 08:20
@ZJY0516
ZJY0516 marked this pull request as ready for review August 30, 2026 08:22
@khluu
khluu merged commit 8c51b92 into vllm-project:main Aug 30, 2026
111 checks passed
@ZJY0516
ZJY0516 deleted the fix/sparse-indexer-config-context branch August 30, 2026 14:37
am-cohere pushed a commit to am-cohere/vllm that referenced this pull request Sep 1, 2026
…roject#54400)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Leoyzen pushed a commit to Leoyzen/vllm that referenced this pull request Sep 1, 2026
…roject#54400)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Leoyzen added a commit to Leoyzen/vllm that referenced this pull request Sep 1, 2026
mylibrar pushed a commit to tanyuqian/vllm that referenced this pull request Sep 3, 2026
…roject#54400)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
D-G-Dimitrov pushed a commit to D-G-Dimitrov/vllm that referenced this pull request Sep 5, 2026
…roject#54400)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
(cherry picked from commit 8c51b92)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants