[https://nvbugspro.nvidia.com/bug/6104831][fix] Disagg transceiver: shared_ptr<LlmRequest>, RAII buffer holders, kv_transfer_timeout_ms enforcement - #13056

Closed

yifjiang wants to merge 16 commits into

NVIDIA:mainfrom

yifjiang:fix/prefill-sender-total-timeout

Commits on Apr 21, 2026

[NVBug 5969206][fix] Enforce kv_transfer_timeout_ms on prefill sender + guard against dangling pointers

yifjiang
and
claude
committed
a319775
[NVBug 5969206][fix] Report timed-out transfers to Python for full cleanup

yifjiang
and
claude
committed
a3bce0c
[NVBug 5969206][fix] Apply kv_transfer_timeout_ms in blockAll mode
yifjiang
committed
a8c27a4
[NVBug 5969206][fix] Close remaining UAF paths and enforce gen-side deadline
yifjiang
committed
43b5180
[NVBug 5969206][fix] Hoist kv_transfer_timeout_ms check above readiness gate
yifjiang
committed
3d0a6d1
[NVBug 5969206][fix] Release receiver resources when gen-side deadline evicts
yifjiang
committed
6bb116d
[NVBug 5969206][fix] sendRequestInfo / receiveReadySignal / data-phase send honor perRequestCancel
yifjiang
committed
62c5d24
[NVBug 5969206][fix] Sender-side in-flight cancel parity + notifySyncMessage pre-notify check
yifjiang
committed
7e8016a
[NVBug 5969206][fix] Tie sender cancel-flag lifetime to session + port catch(...) to sender worker
yifjiang
committed
e7fcbab
[NVBug 5969206][fix] Bound assignBufferIndex CV wait + plumb cancel + diagnostic [buf] logs
yifjiang
committed
2860ac5
[NVBug 5969206][fix] RAII BufferIndexHolder for requestSync — stop leaking pool slots on non-happy exits
yifjiang
committed
39f5452
[NVBug 5969206][fix] RAII BufferIndexHolder on sender formatters + reqId-tagged [buf] logs
yifjiang
committed
28f836e
[NVBug 5969206][fix] Send-side RAII: atomic release(), cancel parity, FUTURE_WAIT/JOIN diagnostics
yifjiang
committed
6f85ce8
[NVBug 5969206][fix] Carry std::shared_ptr<LlmRequest> through transceiver — close UAF, remove Path A/B guards, unwedge KV block leak
yifjiang
committed
649d146
[NVBug 5969206][fix] Harden drain worker loop against non-std::exception escapes
yifjiang
committed
abfcb6d

Commits on Apr 22, 2026

[NVBug 5969206][fix] Re-add is_disagg_context_complete_state guard dropped during d7844fc6f8 cherry-pick conflict resolution on the 4e69c14 base
yifjiang
committed
c9777c4

Navigation Menu

Uh oh!

[https://nvbugspro.nvidia.com/bug/6104831][fix] Disagg transceiver: shared_ptr<LlmRequest>, RAII buffer holders, kv_transfer_timeout_ms enforcement - #13056

[https://nvbugspro.nvidia.com/bug/6104831][fix] Disagg transceiver: shared_ptr<LlmRequest>, RAII buffer holders, kv_transfer_timeout_ms enforcement#13056
yifjiang wants to merge 16 commits into
NVIDIA:mainfrom
yifjiang:fix/prefill-sender-total-timeout

Commits on Apr 21, 2026

[NVBug 5969206][fix] Enforce kv_transfer_timeout_ms on prefill sender + guard against dangling pointers

[NVBug 5969206][fix] Report timed-out transfers to Python for full cleanup

[NVBug 5969206][fix] Apply kv_transfer_timeout_ms in blockAll mode

[NVBug 5969206][fix] Close remaining UAF paths and enforce gen-side deadline

[NVBug 5969206][fix] Hoist kv_transfer_timeout_ms check above readiness gate

[NVBug 5969206][fix] Release receiver resources when gen-side deadline evicts

[NVBug 5969206][fix] sendRequestInfo / receiveReadySignal / data-phase send honor perRequestCancel

[NVBug 5969206][fix] Sender-side in-flight cancel parity + notifySyncMessage pre-notify check

[NVBug 5969206][fix] Tie sender cancel-flag lifetime to session + port catch(...) to sender worker

[NVBug 5969206][fix] Bound assignBufferIndex CV wait + plumb cancel + diagnostic [buf] logs

[NVBug 5969206][fix] RAII BufferIndexHolder for requestSync — stop leaking pool slots on non-happy exits

[NVBug 5969206][fix] RAII BufferIndexHolder on sender formatters + reqId-tagged [buf] logs

[NVBug 5969206][fix] Send-side RAII: atomic release(), cancel parity, FUTURE_WAIT/JOIN diagnostics

[NVBug 5969206][fix] Carry std::shared_ptr<LlmRequest> through transceiver — close UAF, remove Path A/B guards, unwedge KV block leak

[NVBug 5969206][fix] Harden drain worker loop against non-std::exception escapes

Commits on Apr 22, 2026

[NVBug 5969206][fix] Re-add is_disagg_context_complete_state guard dropped during d7844fc6f8 cherry-pick conflict resolution on the 4e69c14 base