Skip to content

[Bugfix][Attention] Zero reused FlashInfer MLA KV blocks - #58716

Draft
andylolu2 wants to merge 2 commits into
vllm-project:mainfrom
andylolu2:andylolu2/zero-flashinfer-mla-kv-blocks
Draft

andylolu2 wants to merge 2 commits into
vllm-project:mainfrom
andylolu2:andylolu2/zero-flashinfer-mla-kv-blocks

[Refactor][Attention] Generalize KV cache zeroing capability

85262f0
Select commit
Loading
Failed to load commit list.