Repository navigation

[Cake 10/13] moe_grouped_gemm: ragged BF16 MoE grouped GEMM, det and fast - #10

Merged

Zhichenzzz merged 114 commits into

radixark:mainfrom

yyihuang:cake-stack/10-moe-grouped-gemm

Nov 5, 2026

Merged

[Cake 10/13] moe_grouped_gemm: ragged BF16 MoE grouped GEMM, det and fast#10
Zhichenzzz merged 114 commits into
radixark:mainfrom
yyihuang:cake-stack/10-moe-grouped-gemm

Commits on Nov 5, 2026
- vendor: conv1d packages
  
  averyhNV
  and
  claude
  committed
  a29119e
- vendor: moe_grouped_gemm packages
  
  averyhNV
  and
  claude
  committed
  220e42b
- vendor: gqa packages
  
  averyhNV
  and
  claude
  committed
  06bcb00
- moe_grouped_gemm: the ragged BF16 MoE grouped GEMM on the cake runtime
  
  averyhNV
  and
  claude
  committed
  2edabb2
- vendor: mhc packages
  
  averyhNV
  and
  claude
  committed
  7a62dde
- mhc: the four-stream hyper-connection kernels as a cake op
  
  averyhNV
  and
  claude
  committed
  03e59f5
- gqa: packed causal GQA attention, head dim 256, on the cake runtime
  
  averyhNV
  and
  claude
  committed
  438cc96
- tests: gqa
  
  averyhNV
  and
  claude
  committed
  188f379
- tests: mhc
  
  averyhNV
  and
  claude
  committed
  94a7989
- conv1d: the short-conv op on the cake runtime
  
  averyhNV
  and
  claude
  committed
  9b9bb4f
- tests: conv1d
  
  averyhNV
  and
  claude
  committed
  1ecdec7
- tests: moe_grouped_gemm
  
  averyhNV
  and
  claude
  committed
  701c627
- vendor: kda packages
  
  averyhNV
  and
  claude
  committed
  67577b5
- vendor: gated_rmsnorm packages
  
  averyhNV
  and
  claude
  committed
  5628db4
- vendor: rmsnorm packages
  
  averyhNV
  and
  claude
  committed
  e22f32d
- vendor: dsa packages
  
  averyhNV
  and
  claude
  committed
  ad8df6a
- kda: packed KDA chunked training, single rank and context parallel
  
  averyhNV
  and
  claude
  committed
  1faa47a
- gated_rmsnorm: the SiLU-gated RMSNorm op on the cake runtime
  
  averyhNV
  and
  claude
  committed
  bc12602
- rmsnorm: the zero-centred input RMSNorm on the cake runtime
  
  averyhNV
  and
  claude
  committed
  4210da3
- dsa: sparse attention and lightning indexer on the cake runtime
  
  averyhNV
  and
  claude
  committed
  8eff403
- tests: kda
  
  averyhNV
  and
  claude
  committed
  03b86da
- tests: gated_rmsnorm
  
  averyhNV
  and
  claude
  committed
  f746c65
- tests: rmsnorm
  
  averyhNV
  and
  claude
  committed
  0177e7b
- tests: dsa
  
  averyhNV
  and
  claude
  committed
  eefde4b
- vendor: dense_gemm packages
  
  averyhNV
  and
  claude
  committed
  ef381a0
- vendor: gdn packages
  
  averyhNV
  and
  claude
  committed
  e9dd400
- cake: one runtime for every op: variants, arguments, loader, prebuild
  
  averyhNV
  and
  claude
  committed
  2fda20d
- tools/vendor_cake.py: one manifest for FlashInfer and miles PR sources
  
  averyhNV
  and
  claude
  committed
  621f82b
- Packaging, CI and README for the cake layout
  
  averyhNV
  and
  claude
  committed
  e048232
- gdn: chunked gated delta rule on the cake runtime
  
  averyhNV
  and
  claude
  committed
  631ab4b
- tests: gdn
  
  averyhNV
  and
  claude
  committed
  ad8eeef
- dense_gemm: batched projection and FP32 router GEMMs on the cake runtime
  
  averyhNV
  and
  claude
  committed
  20ccf43
- tests: dense_gemm
  
  averyhNV
  and
  claude
  committed
  9eead0b
- Tighten the README and keep version 0.0.1
  Zhichenzzz
  committed
  eaaeaf0
- README: keep only what a user needs
  Zhichenzzz
  committed
  1ebe1d5
- Simplify the cake runtime: public CUDA APIs, no lookup memos
  Zhichenzzz
  committed
  d67ad25
- Merge cake-stack/00-layout into cake-stack/01-gdn
  Zhichenzzz
  committed
  47e436c
- Merge main (squash of #12) into cake-stack/01-gdn
  Zhichenzzz
  committed
  af06868
- Merge cake-stack/01-gdn into cake-stack/02-kda
  Zhichenzzz
  committed
  ce45d9b
- Merge cake-stack/02-kda into cake-stack/03-conv1d
  Zhichenzzz
  committed
  a7b6a79
- Merge cake-stack/03-conv1d into cake-stack/04-gated-rmsnorm
  Zhichenzzz
  committed
  d67a161
- Merge cake-stack/04-gated-rmsnorm into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  6fe0cf5
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  f1e97a1
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  704dffb
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  3ca55be
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  1e23377
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  46cc60f
- Merge the README tidy (ops described in their modules) into cake-stack/01-gdn
  Zhichenzzz
  committed
  67466e4
- Merge cake-stack/01-gdn into cake-stack/02-kda
  Zhichenzzz
  committed
  7e26304
- Merge cake-stack/02-kda into cake-stack/03-conv1d
  Zhichenzzz
  committed
  a6353e3
- Merge cake-stack/03-conv1d into cake-stack/04-gated-rmsnorm
  Zhichenzzz
  committed
  1ae0bfc
- Merge cake-stack/04-gated-rmsnorm into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  2625a05
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  3e3bf8b
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  326c651
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  1ab49fe
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  34306b3
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  a8db080
- Merge main into cake-stack/01-gdn
  Zhichenzzz
  committed
  c974662
- Merge cake-stack/01-gdn into cake-stack/02-kda
  Zhichenzzz
  committed
  d9e40a2
- Merge cake-stack/02-kda into cake-stack/03-conv1d
  Zhichenzzz
  committed
  235259c
- Merge cake-stack/03-conv1d into cake-stack/04-gated-rmsnorm
  Zhichenzzz
  committed
  f2b01d9
- Merge cake-stack/04-gated-rmsnorm into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  b8eb4a3
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  388f92f
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  555e6a2
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  9e2dea2
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  0319a7a
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  fecc0fb
- Merge main (squash of cake-stack/01-gdn) into cake-stack/02-kda
  Zhichenzzz
  committed
  4fc5125
- Merge cake-stack/02-kda into cake-stack/03-conv1d
  Zhichenzzz
  committed
  bba5b43
- Merge cake-stack/03-conv1d into cake-stack/04-gated-rmsnorm
  Zhichenzzz
  committed
  ef2c15d
- Merge cake-stack/04-gated-rmsnorm into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  df6a61d
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  1d54f65
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  0962ff7
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  765de7e
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  f377f1b
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  3517116
- Merge main (squash of cake-stack/02-kda) into cake-stack/03-conv1d
  Zhichenzzz
  committed
  da3d325
- Merge cake-stack/03-conv1d into cake-stack/04-gated-rmsnorm
  Zhichenzzz
  committed
  55d3c37
- Merge cake-stack/04-gated-rmsnorm into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  0a76c88
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  01cc138
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  2e3e6ed
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  a9d4fd0
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  c587c75
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  202bb3c
- Merge main (squash of cake-stack/03-conv1d) into cake-stack/04-gated-rmsnorm
  Zhichenzzz
  committed
  865e16a
- Merge cake-stack/04-gated-rmsnorm into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  5a6c3f9
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  5a0073c
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  ac91a51
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  cc4489b
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  ad1fd6a
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  0ece6d0
- Merge main (squash of cake-stack/04-gated-rmsnorm) into cake-stack/05-rmsnorm
  Zhichenzzz
  committed
  23f835d
- Merge cake-stack/05-rmsnorm into cake-stack/06-dsa
  Zhichenzzz
  committed
  32700ee
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  2d22240
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  a400322
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  fc30ec8
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  05c0fb7
- Merge main (squash of cake-stack/05-rmsnorm) into cake-stack/06-dsa
  Zhichenzzz
  committed
  7297d6a
- Merge cake-stack/06-dsa into cake-stack/07-mhc
  Zhichenzzz
  committed
  c019f95
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  83901b0
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  81fa670
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  ecb3216
- Merge main (squash of cake-stack/06-dsa) into cake-stack/07-mhc
  Zhichenzzz
  committed
  7107f60
- Merge cake-stack/07-mhc into cake-stack/08-gqa
  Zhichenzzz
  committed
  c153391
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  603e9d8
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  45bc5ff
- Merge main (squash of cake-stack/07-mhc) into cake-stack/08-gqa
  Zhichenzzz
  committed
  a0c20dc
- Merge cake-stack/08-gqa into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  de8bca3
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  d47c425
- Merge main (squash of cake-stack/08-gqa) into cake-stack/09-dense-gemm
  Zhichenzzz
  committed
  601078c
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  a05f2c5
- tests: dense_gemm checks the batch-invariance note in its docstrings, not the README
  Zhichenzzz
  committed
  79f55da
- Merge cake-stack/09-dense-gemm into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  974ab92
- Merge main (squash of cake-stack/09-dense-gemm) into cake-stack/10-moe-grouped-gemm
  Zhichenzzz
  committed
  b2c247f

Commits

Commits on Nov 5, 2026