Skip to content

[Kernel] Gemma4 MoE decode GEMV optimization — up to 46% TPOT improvement at BS=1-8#41379

Closed
kailashbuki wants to merge 1 commit into
vllm-project:mainfrom
kailashbuki:gemma4-moe-decode-gemv
Closed

[Kernel] Gemma4 MoE decode GEMV optimization — up to 46% TPOT improvement at BS=1-8#41379
kailashbuki wants to merge 1 commit into
vllm-project:mainfrom
kailashbuki:gemma4-moe-decode-gemv

Commits

Commits on Apr 30, 2026