Repository navigation

feat(tp): run one tensor-parallel group across nodes - #2647

Open

gbyu-amd wants to merge 7 commits into

mainfrom

gyu/tp-across-nodes

Open

feat(tp): run one tensor-parallel group across nodes#2647
gbyu-amd wants to merge 7 commits into
mainfrom
gyu/tp-across-nodes

Commits on Oct 20, 2026
- [TP] Run one tensor-parallel group across nodes
  gbyu-amd
  committed
  ce21227
- [MLA][DCP] Run DCP decode persistent on gfx1250 with the PS1 kernel
  gbyu-amd
  committed
  c59ffd5
Commits on Oct 22, 2026
- fix(tp): wait for a lazily created NCCL id as long as the cross-node TP setup
  
  zejunchen-zejun
  and
  claude
  committed
  c3cc236
- fix(mono): refuse mono decode when the TP group spans nodes
  
  zejunchen-zejun
  and
  claude
  committed
  24049fe
Commits on Nov 3, 2026
- Merge branch 'main' into gyu/tp-across-nodes
  gbyu-amd
  committed
  7742448
- fix(dsv4): refuse Mono decode when the TP group spans nodes
  gbyu-amd
  committed
  2b10dd6
- fix(tp): address review of the cross-node TP group
  gbyu-amd
  committed
  3095411