Repository navigation

[Perf] [NVIDIA] qwen3: Fuse prefill QK norm and RoPE with contiguous Q - #47785

Merged

BBuf merged 12 commits into

sgl-project:mainfrom

mani1106:mani1106/fuse-qwen3-prefill

Nov 5, 2026

Merged

[Perf] [NVIDIA] qwen3: Fuse prefill QK norm and RoPE with contiguous Q#47785
BBuf merged 12 commits into
sgl-project:mainfrom
mani1106:mani1106/fuse-qwen3-prefill

Commits on Nov 1, 2026
- Fuse opt-in dense Qwen3 prefill QK norm and cached RoPE
  
  mani1106
  and
  Copilot
  committed
  01b927b
Commits on Nov 2, 2026
- Assert dense Qwen3 prefill fusion dispatch
  
  mani1106
  and
  Copilot
  committed
  c39ee4c
- Merge branch 'main' into mani1106/fuse-qwen3-prefill
  mani1106
  committed
  cc39bef
- Merge branch 'main' into mani1106/fuse-qwen3-prefill
  mani1106
  authored
  071d60e
- Fix Inkling replay fixture backend cache dtype
  
  mani1106
  and
  Copilot
  committed
  d6f3d18
- Merge branch 'main' into mani1106/fuse-qwen3-prefill
  mani1106
  authored
  4e8d987
Commits on Nov 3, 2026
- Merge upstream main into mani1106/fuse-qwen3-prefill
  
  mani1106
  and
  Copilot
  committed
  f0cc5cc
- Import Qwen3 ForwardMode from its defining module
  
  mani1106
  and
  Copilot
  committed
  bbb0153
- Merge branch 'main' into mani1106/fuse-qwen3-prefill
  mani1106
  authored
  be8e97d
Commits on Nov 4, 2026
- Merge branch 'main' into mani1106/fuse-qwen3-prefill
  mani1106
  authored
  ec1c294
- Load sgl_kernel explicitly in Arm64 MoE test
  
  mani1106
  and
  Copilot
  committed
  093cf61
- Merge branch 'main' into mani1106/fuse-qwen3-prefill
  mani1106
  authored
  b1a2b65