Remove KV cache scale boilerplate from model weight loading methods - #43167

Merged

vllm-bot merged 18 commits into

vllm-project:mainfrom

hmellor:generalise-kv-cache-scaling

Jun 5, 2026

Commits on May 19, 2026

Replace `get_cache_scale` -> `get_cache_scale_mapper`
hmellor
committed
04a7e46
Do shape normalisation automatically for scalar scales
hmellor
committed
f4023eb
Make `maybe_remap_kv_scale_name` idempotent
hmellor
committed
a17d7e5
Only accept single values in KVCacheScaleParameter
hmellor
committed
f37a964
Delete some boilerplate
hmellor
committed
35210cc
Remote more boilerplate
hmellor
committed
bc7a84a
Do quant config mapping
hmellor
committed
581f662
Llama 4 special case
hmellor
committed
5b7ec34

Commits on May 20, 2026

revert modelopt change as it's likely not correct
hmellor
committed
1246e75
fix regex combining
hmellor
committed
93beb34

Commits on May 27, 2026

Commits on Jun 3, 2026

Commits on Jun 4, 2026

Merge branch 'main' into generalise-kv-cache-scaling
hmellor
authored
7ea179d