[GQA] Make present_key/present_value outputs optional and add Gemma4 support - #28242

Merged

Akshay Sonawane (apsonawane) merged 36 commits into

mainfrom

asonawane/gemma4

May 12, 2026

Commits on Apr 25, 2026

Update GQA to support Gemma4
Akshay Sonawane (apsonawane)
committed
0db9578

Commits on Apr 27, 2026

Commits on Apr 28, 2026

Make GQA present_key/present_value outputs optional for KV-shared layers
Akshay Sonawane (apsonawane)
committed
d2ead38
Fix tests
Akshay Sonawane (apsonawane)
committed
aad74ef

Commits on Apr 29, 2026

Update the docs
Akshay Sonawane (apsonawane)
committed
64005dd

Commits on May 1, 2026

Commits on May 4, 2026

Address comments
Akshay Sonawane (apsonawane)
committed
bd023f1
Fix unit tests
Akshay Sonawane (apsonawane)
committed
f0035aa
fix cuda tests
Akshay Sonawane (apsonawane)
committed
0afa1c9
address comments
Akshay Sonawane (apsonawane)
committed
ab0ddfb

Commits on May 5, 2026

Support KV-shared decode with separate Q/KV sequence lengths
Akshay Sonawane (apsonawane)
committed
ec50731
Address copilot comment:
Akshay Sonawane (apsonawane)
committed
1069d55
fix cuda pipeline
Akshay Sonawane (apsonawane)
committed
b1c6271

Commits on May 6, 2026

Commits on May 7, 2026

Merge branch 'main' into asonawane/gemma4
Akshay Sonawane (apsonawane)
committed
17ec243

Commits on May 8, 2026

Commits on May 11, 2026