Skip to content

[Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs#24964

Merged
njhill merged 12 commits intovllm-project:mainfrom
Jialin:gc_none_block
Oct 14, 2025
Merged

[Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs#24964
njhill merged 12 commits intovllm-project:mainfrom
Jialin:gc_none_block

Commits

Commits on Oct 13, 2025

Commits on Oct 14, 2025