[Bugfix] Prevent out-of-bounds access in FlashInfer SM90 sparse MLA mixed batches - #56969
Merged
Merged
Conversation
…ixed batches Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
ZJY0516
approved these changes
Sep 15, 2026
Member
|
/ci run |
ZJY0516
enabled auto-merge (squash)
September 15, 2026 10:14
|
❌ This PR is 10 commits behind upstream |
JaredforReal
approved these changes
Sep 15, 2026
JaredforReal
left a comment
Contributor
There was a problem hiding this comment.
reproduced the bug and verified the fix works
thanks~ @chaunceyjiang
Collaborator
Author
|
/ci run |
|
✅ Triggered Buildkite CI #89082 for commit |
drakosha
added a commit
to drakosha/vllm
that referenced
this pull request
Sep 16, 2026
…and-workspace The Indexer moved from vllm/models/glm5next/nvidia/attention.py to vllm/models/glm5next/common/attention.py (vllm-project#55358); the prefill workspace division by index_kpool follows it. vllm-project#56969 changed the same SM90 builder and test file; both changes are kept. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
keneoneth
pushed a commit
to keneoneth/vllm
that referenced
this pull request
Sep 16, 2026
…ixed batches (vllm-project#56969) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.
Purpose
Prevent out-of-bounds access in FlashInfer SM90 sparse MLA mixed batches
Test Plan
On 4 * H20-3e
Test Result
before
this pr
AI assistance: Codex. Draft: human review/validation.
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.BEFORE SUBMITTING, PLEASE READ https://docs.vllm.ai/en/latest/contributing (anything written below this line will be removed by GitHub Actions)