Skip to content

Draft: [None][fix] Use KV cache transfer future timeout on generation worker - #13083

Closed
pcastonguay wants to merge 10 commits into
NVIDIA:mainfrom
pcastonguay:fix/cpp-gen-transfer-timeout
Closed

Draft: [None][fix] Use KV cache transfer future timeout on generation worker#13083
pcastonguay wants to merge 10 commits into
NVIDIA:mainfrom
pcastonguay:fix/cpp-gen-transfer-timeout

Adding unit test to verify gen timeout. Currently failing.

f0cb58a
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Apr 20, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO