Repository navigation

[ROCm][Perf] Tiny-dot kernel for the Qwen MoE shared-expert gate - #56789

Closed

roberteg16 wants to merge 3 commits into

vllm-project:mainfrom

ROCm:rogarcia.tiny-dot-upstream

Closed

[ROCm][Perf] Tiny-dot kernel for the Qwen MoE shared-expert gate#56789
roberteg16 wants to merge 3 commits into
vllm-project:mainfrom
ROCm:rogarcia.tiny-dot-upstream

Commits on Sep 14, 2026
- [ROCm] Replace the 1x1xK BLAS call with a fused dot on gfx1151
  
  committed
  fbd7246
- [ROCm] Serve the tiny scalar projection from a Triton kernel
  
  roberteg16
  and
  claude
  committed
  79115d2
- [ROCm] Fold the shared_expert_gate sigmoid into the tiny-dot kernel
  
  committed
  e323989