Skip to content

[Feature] Enable uniform KV cache allocation for multi-group HMA models - #34373

Closed
Etelis wants to merge 33 commits into
vllm-project:mainfrom
Etelis:itay/hma-uniform-kv-cache
Closed

[Feature] Enable uniform KV cache allocation for multi-group HMA models#34373
Etelis wants to merge 33 commits into
vllm-project:mainfrom
Etelis:itay/hma-uniform-kv-cache

[Feature] Add KVCacheTensorReference/KVCacheDataReference API for con…

e0e33bf
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Mar 15, 2026 in 0s

There is no internal Diff connected, this can be merged now