Skip to content

fix(vllm): use engine-reported logical KV block sizes - #14590

Closed
JulienDarve wants to merge 4 commits into
mainfrom
jdarve/vllm-legacy-logical-kv-block-size
Closed

fix(vllm): use engine-reported logical KV block sizes#14590
JulienDarve wants to merge 4 commits into
mainfrom
jdarve/vllm-legacy-logical-kv-block-size

fix(vllm): read effective block size from cache config

cd223b1
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar