Repository navigation

[Perf] [AMD] DSV4.1: Fuse wo_b's GEMM with its all-reduce via mori cco on gfx950 - #43480

Open

yangyuhuiling wants to merge 24 commits into

sgl-project:mainfrom

yangyuhuiling:xiangch/fused-wo-b-gemm-ar-main

Open

[Perf] [AMD] DSV4.1: Fuse wo_b's GEMM with its all-reduce via mori cco on gfx950#43480
yangyuhuiling wants to merge 24 commits into
sgl-project:mainfrom
yangyuhuiling:xiangch/fused-wo-b-gemm-ar-main

Commits on Oct 8, 2026
- [AMD][gfx950] DSV4: fuse wo_b's GEMM with its all-reduce via mori cco
  
  authored and
  xiangch
  committed
  bd6555d
Commits on Oct 10, 2026
- [AMD][gfx950] DSV4.1: take the fused wo_b to V4.1-Flash's mxfp8 quantisation
  
  xiangch
  and
  claude
  committed
  b250059
- [AMD][gfx950] Address review on the fused wo_b
  
  xiangch
  and
  claude
  committed
  3dd6ca3
- [AMD][gfx950] Prepare the fused wo_b weight where the mxfp8 layout exists
  
  xiangch
  and
  claude
  committed
  18dd7fd
Commits on Oct 12, 2026
- [AMD][gfx950] Address the second review round on the fused wo_b
  
  xiangch
  and
  claude
  committed
  bde0b40
- [AMD][gfx950] Refuse weight updates the fused copy cannot survive
  
  Xiang.Chen
  and
  claude
  committed
  8925b98
Commits on Oct 13, 2026
- Merge origin/main into the fused wo_b branch
  Xiang.Chen
  committed
  2cd48ef
- Apply pre-commit formatting
  Xiang.Chen
  committed
  745a8ba
- Merge branch 'main' into xiangch/fused-wo-b-gemm-ar-main
  HaiShaw
  authored
  180462d
Commits on Oct 14, 2026
- Add gemm_ar unit tests and register them on gfx950 CI
  
  xiangch
  and
  claude
  committed
  abfb652
- Merge origin/main into xiangch/fused-wo-b-gemm-ar-main
  xiangch
  committed
  ec04a59
- Read the TP group through the runtime context
  
  xiangch
  and
  claude
  committed
  3d21358
- Merge origin/main into xiangch/fused-wo-b-gemm-ar-main
  xiangch
  committed
  a8b0165
Commits on Oct 16, 2026
- Bound the fused wo_b self-test so a stalled SDMA queue reports
  
  xiangch
  and
  claude
  committed
  c7b0d88
- Gate mori-gemm-ar CI on mori's own SDMA put test
  
  xiangch
  and
  claude
  committed
  26209c1
- Cover the fp8 all-gather wire in the collective test
  
  xiangch
  and
  claude
  committed
  aa08fc0
- Say what the fused wo_b does to numerics, per route
  
  xiangch
  and
  claude
  committed
  ea7d1c1
- Merge origin/main into xiangch/fused-wo-b-gemm-ar-main
  xiangch
  committed
  19a53ef
Commits on Oct 26, 2026
- Guard fused wo_b against host-backed VMM windows
  xiangch
  committed
  bfc9acf
- Merge origin/main into xiangch/fused-wo-b-gemm-ar-main
  xiangch
  committed
  7262660
- Handle preshuffled AITER weights in fused wo_b
  xiangch
  committed
  8c88d3b
Commits on Nov 5, 2026
- Address review of the fused wo_b all-reduce
  
  xiangch
  and
  claude
  committed
  ba5efe3
- Merge origin/main into xiangch/fused-wo-b-gemm-ar-main
  xiangch
  committed
  8f81ad5
- Import ForwardMode from the module that defines it
  
  xiangch
  and
  claude
  committed
  f02b7e6

Commits

Commits on Oct 8, 2026

Commits on Oct 10, 2026

Commits on Oct 12, 2026

Commits on Oct 13, 2026

Commits on Oct 14, 2026

Commits on Oct 16, 2026

Commits on Oct 26, 2026

Commits on Nov 5, 2026