ep: graph-safe worst-token HT dispatch+combine (internode + intranode) - #18

Open

fergusfinn wants to merge 11 commits into

upstream-basefrom

feat/ht-cudagraph-worst-tokens

Commits on Jun 26, 2026

[bugfix]: keep sync barrier single-queued
PanJason
committed
7d3766c
[bugfix]: preserve fifo control wr ids
PanJason
committed
b20d747
[bugfix]: quiet all CXI proxy queues
PanJason
committed
9c470bf

Commits on Jul 3, 2026

Merge upstream PR #998 head (swiss-ai control_fix): CXI proxy-queue fixes
fergusfinn
committed
429ba28
ep: make HT internode dispatch+combine CUDA-graph replay-safe
fergusfinn
committed
bca15a5
ep: expose per-expert recv counts as a device tensor in worst-tokens mode
fergusfinn
committed
669c61b
ep: add CUDA-graph capture/replay correctness test for HT internode
fergusfinn
committed
0bcc0cd
ep: graph-mode notify must not write the host-mapped counters
fergusfinn
committed
a3e67c2
ep: fix bench test teardown ordering (cudaErrorContextIsDestroyed abort)
fergusfinn
committed
b355aca
ep/bench: accept+validate device recv-counts tensor in worst-tokens dispatch test

fergus barratt
authored and
fergusfinn
committed
d9ba3ff
ep: gate intranode worst-token notify host-counter writes for CUDA-graph replay safety

fergus barratt
authored and
fergusfinn
committed
97ebe5e