Skip to content

[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCacheManager#17479

Merged
WoosukKwon merged 6 commits intovllm-project:mainfrom
heheda12345:kv_cache_blocks
May 6, 2025
Merged

[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCacheManager#17479
WoosukKwon merged 6 commits intovllm-project:mainfrom
heheda12345:kv_cache_blocks

Commits

Commits on Apr 30, 2025

Commits on May 1, 2025

Commits on May 6, 2025