Repository navigation

[Perf][DSv4.1] Fuse small-batch WO-A with inverse RoPE and MXFP8 quant on SM100/SM103 - #58634

Merged

zyongye merged 12 commits into

vllm-project:mainfrom

Juntian777:dsv41-fused-wo-a

Sep 27, 2026

Merged

[Perf][DSv4.1] Fuse small-batch WO-A with inverse RoPE and MXFP8 quant on SM100/SM103#58634
zyongye merged 12 commits into
vllm-project:mainfrom
Juntian777:dsv41-fused-wo-a

Commits on Sep 24, 2026
- [Perf][DSv4.1] Fuse small-batch WO-A with inverse RoPE and MXFP8 quant on SM100
  
  Juntian777
  and
  claude
  committed
  6659ac2
- [Perf][DSv4.1] Take the attention layer in dsv41_o_proj; fuse up to 32 tokens
  
  Juntian777
  and
  claude
  committed
  fdf2b4f
Commits on Sep 25, 2026
- [Bugfix][DSv4.1] Keep fused WO-A compiling under quack's const_expr-if rewrite
  
  Juntian777
  and
  claude
  committed
  f6f4b68
- [Perf][DSv4.1] Mention SM103 in the fused WO-A docstrings
  
  Juntian777
  and
  claude
  committed
  4473534
- [Perf][DSv4.1] Generalize fused WO-A layouts and pipeline its stages
  
  Juntian777
  and
  claude
  committed
  2ea0e22
- clean code and use TMA
  Juntian777
  committed
  be7dacb
- clean code
  Juntian777
  committed
  e63dfae
Commits on Sep 26, 2026
- further improve perf without numeric diff
  Juntian777
  committed
  4f59bdd
- support larger batch size and clean code
  Juntian777
  committed
  3995dbc
- reduce compile key combs
  Juntian777
  committed
  813bcd4
- Merge branch 'main' into dsv41-fused-wo-a
  Juntian777
  authored
  b50bbea
- Merge branch 'main' into dsv41-fused-wo-a
  Juntian777
  authored
  37e1e94