[Attention] Skip sparse indexer scoring for dense short prefills - #48407

[Attention] Skip sparse indexer scoring for dense short prefills#48407

MatthewBonanni merged 9 commits into

vllm-project:mainvllm-project/vllm:mainfrom

qianlihuang:feature/mla-mha-threshold-for-short-sequencesqianlihuang/vllm:feature/mla-mha-threshold-for-short-sequencesCopy head branch name to clipboard