Repository navigation

poc(cco): Mega-MoE GEMM2 fused with an SDMA combine (gfx950) - #859

Merged

kawhil-amd merged 9 commits into

kawhil-amd:feat/cco-flydsl-mega-moe-sdma

Oct 30, 2026

Merged

poc(cco): Mega-MoE GEMM2 fused with an SDMA combine (gfx950)#859
kawhil-amd merged 9 commits into
ROCm:mainfrom
kawhil-amd:feat/cco-flydsl-mega-moe-sdma

Commits on Oct 27, 2026
- example(cco): MoE GEMM2 fused with an SDMA combine (gfx950)
  
  kawhil-amd
  and
  claude
  committed
  58c18e0
- example(cco): run the SDMA MoE combine on GPUs, and make it win above 4k tokens
  
  kawhil-amd
  and
  claude
  committed
  c7a8acf
Commits on Oct 28, 2026
- perf(cco/example): cut the SDMA MoE plan kernel from 43 to 21 us at 8192 tokens/rank
  
  kawhil-amd
  and
  claude
  committed
  ac0a306
- fix(cco/example): plan kernel correctness under skewed routing and overflow
  
  kawhil-amd
  and
  claude
  committed
  bea7f03
- style(cco/example): make the PR pass pre-commit
  
  kawhil-amd
  and
  claude
  committed
  186b003
- perf(cco/example): sender-side inv, tree barrier and 2x combine blocks (+1-3% stage2+combine)
  
  kawhil-amd
  and
  claude
  committed
  919fba7
- refactor(cco/example): one file for the SDMA mega-moe GEMM2, one for its test and benchmark
  
  kawhil-amd
  and
  claude
  committed
  0ad1c7b
Commits on Oct 29, 2026
- perf(cco/example): drop the unused local signal, and signal on the last put
  
  Xiang.Chen
  and
  claude
  committed
  b6e4404
- perf(cco/example): unbreak the GEMM2 main loop schedule and give the fused path every CU
  
  kaiclian
  and
  claude
  committed
  f5771d1