Skip to content

Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention - #2214

Merged
kunal-vaishnavi merged 2 commits into
microsoft:mainfrom
shreyshah-microsoft:fix/kv-cache-per-layer-num-kv-heads
Jun 18, 2026
Merged

Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention#2214
kunal-vaishnavi merged 2 commits into
microsoft:mainfrom
shreyshah-microsoft:fix/kv-cache-per-layer-num-kv-heads

Address review: collapse per-layer KV detection to a single flag

ecc3e5f
Select commit
Loading
Failed to load commit list.
Sign in for the full log view