Skip to content

Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention - #2214

Merged
kunal-vaishnavi merged 2 commits into
microsoft:mainfrom
shreyshah-microsoft:fix/kv-cache-per-layer-num-kv-heads
Jun 18, 2026
Merged

Fix DefaultKeyValueCache: per-layer num_kv_heads for Gemma 4 dual/MQA attention#2214
kunal-vaishnavi merged 2 commits into
microsoft:mainfrom
shreyshah-microsoft:fix/kv-cache-per-layer-num-kv-heads

Address review: collapse per-layer KV detection to a single flag

ecc3e5f
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / CodeQL completed Jun 16, 2026 in 3s

1 configuration not found

Warning: Code scanning cannot determine the alerts introduced by this pull request, because 1 configuration present on refs/heads/main was not found:

API upload

  • ❓  <default>

View all branch alerts.