Skip to content

[v1][KVCacheManager] Change prefix caching metric from counting blocks to counting tokens#18003

Merged
WoosukKwon merged 1 commit intovllm-project:mainfrom
heheda12345:prefix_cache_metric
May 12, 2025
Merged

[v1][KVCacheManager] Change prefix caching metric from counting blocks to counting tokens#18003
WoosukKwon merged 1 commit intovllm-project:mainfrom
heheda12345:prefix_cache_metric

Commits

Commits on May 12, 2025