Skip to content

[KV offload] Scale uniform-type attention groups by DCP in build_offloading_config - #53889

Open
LucasWilkinson wants to merge 1 commit into
vllm-project:mainfrom
LucasWilkinson:fix/offload-dcp-uniform-group
Open

LucasWilkinson wants to merge 1 commit into
vllm-project:mainfrom
LucasWilkinson:fix/offload-dcp-uniform-group