Skip to content

Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention - #2214

Merged
kunal-vaishnavi merged 2 commits into
microsoft:mainfrom
shreyshah-microsoft:fix/kv-cache-per-layer-num-kv-heads
Jun 18, 2026
Merged

Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention#2214
kunal-vaishnavi merged 2 commits into
microsoft:mainfrom
shreyshah-microsoft:fix/kv-cache-per-layer-num-kv-heads

Address review: collapse per-layer KV detection to a single flag

ecc3e5f
Select commit
Loading
Failed to load commit list.
Microsoft GitHub Policy Service / license/cla succeeded Jun 18, 2026 in 0s

All CLA requirements met.

This check verifies that the author has agreed to a CLA with Microsoft.

View more details on Microsoft GitHub Policy Service