[TRTLLM-15344][feat] cache transceiver nixl bounce buffer - #15780

Open

chuangz0 wants to merge 45 commits into

NVIDIA:mainfrom

chuangz0:worktree-bounce-v2

Commits on Aug 21, 2026

[None][feat] bounce v2: core data structures, scheduler, codec, kernel
chuangz0
committed
7e7e5a9
[None][feat] bounce v2: transport reactor + control channel + NIXL engine + agent integration
chuangz0
committed
b4583e8
[None][doc] bounce v2: DESIGN.md (as-built spec)
chuangz0
committed
c874ccb
[None][fix] bounce v2: stop silently swallowing cleanup failures
chuangz0
committed
8e600a3
[None][build] bounce v2: decouple from ENABLE_UCX (gate on NIXL + zmq)
chuangz0
committed
5e920e6
[None][doc] bounce v2: explain CreditScheduler::schedule() for newcomers
chuangz0
committed
7e0cac9
[None][refactor] bounce v2: name the cancel codec (encodeCancel / isCancelWant)
chuangz0
committed
4ca42d5
[None][feat] bounce v2: opt-in cub + zero-copy gather/scatter copy backends
chuangz0
committed
9e082b8
[None][test] bounce v2: real-RDMA failure-path e2e (no-grant timeout, forgetPeer)
chuangz0
committed
16d50d7
[None][fix] bounce v2: reclaim control-channel DEALER on forgetPeer
chuangz0
committed
4d4f0bb
[None][chore] bounce v2: group unit tests under executor/bounce/
chuangz0
committed
9f9d5fd
[None][fix] bounce v2: make forgetPeer's peer-reconnect deterministic
chuangz0
committed
f61cfd9
[None][chore] bounce v2: stop tracking local DESIGN.md
chuangz0
committed
a0f3126
[None][test] bounce v2: drive transport tests over real NIXL, drop LocalCopy fake
chuangz0
committed
becdc61
[None][test] bounce v2: drive happy-path e2e through the production API
chuangz0
committed
6861afd
[None][fix] bounce v2: clamp maxChunkBytes and guard region bounds
chuangz0
committed
83ce36d
[None][chore] bounce v2: drop dangling DESIGN.md references from comments
chuangz0
committed
b4c1ce2
[None][feat] bounce v2: accept KB/MB/GB suffixes in byte-valued env vars
chuangz0
committed
fc3d229
[None][feat] bounce v2: NVTX instrumentation for the transfer pipeline
chuangz0
committed
f537fcb
[None][perf] bounce v2: cut per-chunk KV transfer latency ~49% (1.68ms -> 0.85ms)
chuangz0
committed
de6915a
[None][chore] bounce v2: satisfy clang-format and codespell hooks
chuangz0
committed
f8e7f0d
[None][fix] bounce v2: don't modulo an empty ring in dropFromRing
chuangz0
committed
396c8ff
fix: align bounce v2 configuration and peer handshake
chuangz0
committed
2dad352
test: cover NIXL bounce through Python transceiver
chuangz0
committed
6793ff3
fix: validate bounce control endpoints
chuangz0
committed
44e2dbf
fix: prevent starvation of large bounce chunks
chuangz0
committed
3b42727
[None][fix] bounce v2: address code review findings
chuangz0
committed
12db298
[None][test] bounce v2: verify engagement programmatically, not via logs
chuangz0
committed
8d2c611
[None][test] reject skipped bounce subprocess
chuangz0
committed
5d243a7
fix: harden bounce transport protocol handling
chuangz0
committed
1d2b1c8
[None][feat] bounce v2: enable via CacheTransceiverConfig.agent_buffer_enable
chuangz0
committed
2bb8cc2
[None][chore] drop per-field capture test for agent_buffer_enable
chuangz0
committed
1b0591c
[None][chore] raise KV transfer defaults: 4 sender workers, 512MiB bounce arena
chuangz0
committed
3889424
[None][chore] bounce v2: drop the NIXL-notifications control channel
chuangz0
committed
6fa2d31
[None][fix] bounce v2: lease + quarantine reclaim of dead senders' regions
chuangz0
committed
b82e25c
[None][test] bounce v2: deduplicate and consolidate the test suite
chuangz0
committed
48e0945
[None][feat] bounce v2: surface the failure reason to the upper layer
chuangz0
committed
14e0f6b
[None][chore] bounce v2: drop the cub-copy backend and the run-merging debug knob
chuangz0
committed
b3046e4
[None][refactor] bounce v2: post writes through NixlTransferAgent, drop NixlTransferEngine
chuangz0
committed
9fac944
[None][chore] bounce v2: derive the lease/quarantine timeouts from the request timeout
chuangz0
committed
88492b1
[None][fix] bounce v2: fix shutdown lost-wakeup, harden peer-input and startup paths
chuangz0
committed
4235486
[TRTLLM-15344][feat] configure bounce v2 via CacheTransceiverConfig instead of env vars
chuangz0
committed
8ddae67
[None][fix] bounce v2: reject WANT chunk sizes outside the handshake contract
chuangz0
committed
c4e01b7
[None][chore] bounce v2: fix stale comments, drop dead code, dedup logic and tests
chuangz0
committed
5c94adc
[TRTLLM-15344][refactor] select the bounce implementation with a bool over a shared capacity
chuangz0
committed
373e2ab