[WebGPU] Fuse Q/K RMSNorm into GroupQueryAttention for Qwen3-style models - #28484

Merged

hariharans29 merged 26 commits into

mainfrom

hari/webgpu_perf_2

Jun 9, 2026

Commits on May 12, 2026

[WebGPU] Fuse Q/K RMSNorm into GroupQueryAttention decode
hariharans29
committed
[WebGPU] Extract RunLayerNormProgram helper
hariharans29
committed
[WebGPU] Tighten GroupQueryAttentionPreNormFusion preconditions
hariharans29
committed
[GQA] Reject q_norm_weight / k_norm_weight inputs on CPU/CUDA/JSEP
hariharans29
committed
Merge remote-tracking branch 'origin' into hari/webgpu_perf_2
hariharans29
committed
[Test] Use custom checker for SkipsAlreadyFusedNode
hariharans29
committed
[Test] Add <cmath> include for std::abs
hariharans29
committed
[Test] Fix stale comment on BuildQwenQkPostNormPattern
hariharans29
committed
[Optimizer] Update GroupQueryAttentionPreNormFusion class doc to reflect WebGPU-only scope
hariharans29
committed
[Optimizer] Drop unused k{Q,K}NormWeightInputName constants
hariharans29
committed
[WebGPU] Refresh stale q/k_norm_weight comment in GQA
hariharans29
committed
[WebGPU] Clarify qk_norm_epsilon_ comment covers prefill fallback too
hariharans29
committed
[Schema] Clarify q_norm_weight is honored by native WebGPU only
hariharans29
committed
[Optimizer] Fix MatchPreNormReshapeChain doc comment (reshape order)
hariharans29
committed

Commits on May 13, 2026

[Test] Fix uniform_int_distribution assertion in GQA pre-norm fusion test
hariharans29
committed

Commits on May 15, 2026

Commits on May 20, 2026

Merge branch 'main' into hari/webgpu_perf_2
hariharans29
authored

Commits on May 21, 2026

Merge remote-tracking branch 'origin/main' into hari/webgpu_perf_2
hariharans29
committed

Commits on May 26, 2026

Merge remote-tracking branch 'origin/main' into HEAD
hariharans29
committed

Commits on May 28, 2026

Commits on Jun 7, 2026

Add more tests
hariharans29
committed

Commits on Jun 8, 2026

Fix
hariharans29
committed