Repository navigation

feat(cake_comm): support SM100 and SM103 TP8 packed-QKV all-gather matmul - #5116

Merged

yyihuang merged 7 commits into

flashinfer-ai:mainfrom

yyihuang:codex/agmm-tp8-qkv-peer-grid4-v32

Sep 14, 2026

Merged

feat(cake_comm): support SM100 and SM103 TP8 packed-QKV all-gather matmul#5116
yyihuang merged 7 commits into
flashinfer-ai:mainfrom
yyihuang:codex/agmm-tp8-qkv-peer-grid4-v32

Commits on Sep 11, 2026
- Parallelize SM103 TP8 packed QKV peer traversal
  averyhNV
  committed
  436c1ac
- perf(comm): bind prepared TP8 launch arguments
  averyhNV
  committed
  4fc1859
- perf(comm): copy prepared descriptors on current stream
  averyhNV
  committed
  f65607a
- Refresh Blackwell AGMM device exports from current generator
  averyhNV
  committed
  807516f
- Add serialized peer-copy transport for TP8 QKV
  averyhNV
  committed
  a059801
Commits on Sep 13, 2026
- Enable packed QKV TP8 on SM100 and update peer barrier storage
  averyhNV
  committed
  f037814
- Format packed-QKV dispatch and tests
  averyhNV
  committed
  92b9e39