[Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking - #36178

[Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking#36178

LucasWilkinson merged 8 commits into

mainvllm-project/vllm:mainfrom

lucas/sparse-indexer-logits-budgetvllm-project/vllm:lucas/sparse-indexer-logits-budgetCopy head branch name to clipboard