[9/N][Attention] Support adaptive verification in FlashMLA Sparse - #56474
Draft
MatthewBonanni wants to merge 1 commit into
Draft
MatthewBonanni wants to merge 1 commit into
MatthewBonanni wants to merge 1 commit into
Conversation
MatthewBonanni
added this pull request to stack #55964
September 11, 2026 14:14
MatthewBonanni
force-pushed
the
feat/flashmla-sparse-adaptive-verification
branch
from
September 11, 2026 15:12
4d1f72f to
765556b
Compare
MatthewBonanni
removed this pull request from stack #55964
September 11, 2026 15:13
MatthewBonanni
added this pull request to stack #56481
September 11, 2026 15:13
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
LucasWilkinson
force-pushed
the
feat/flashmla-sparse-adaptive-verification
branch
from
September 12, 2026 04:36
765556b to
218a55e
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This is split from the core HiSparse PR because FlashMLA Sparse does not support adaptive verification on main; HiSparse can otherwise use the existing FlashInfer Sparse MLA support.
Duplicate work
I searched open PRs for FlashMLA Sparse adaptive-verification support and found no duplicate. #52988 concerns Kimi-K3 rather than FlashMLA Sparse or HiSparse.
Validation
pre-commit run --files tests/v1/attention/test_sparse_mla_backends.py vllm/model_executor/layers/attention/sparse_mla_attention.py vllm/v1/attention/backends/mla/flashmla_sparse.pypython -m pytest -q tests/v1/attention/test_sparse_mla_backends.py::test_hisparse_fp8_decode_preserves_packed_varlen_rows tests/v1/attention/test_sparse_mla_backends.py::test_flashmla_hisparse_reports_varlen_cudagraph_support tests/v1/attention/test_sparse_mla_backends.py::test_hisparse_flashmla_reorders_full_speculative_window_as_decodeFULL_AND_PIECEWISEand forced adaptive rejection:AI assistance was used. Every changed line and the validation results were reviewed by the human submitter.