nixl_ep: Optimize low-latency NVLink path - #1751

Merged

itayalroy merged 6 commits into

ai-dynamo:mainfrom

itayalroy:nvlink_opt_ups

Jun 18, 2026

Commits on Jun 11, 2026

Cache low-latency P2P pointers
itayalroy
committed
6efdd0a
Use conservative PTX load/store mode by default
itayalroy
committed
f3434a5
Match DeepEP TMA store wait
itayalroy
committed
5c42b5a
Use 32-bit top-k indices by default
itayalroy
committed
cbc66f7
Use plain combine rank-mask loads after sync
itayalroy
committed
a7a3bf3
Cache P2P pointers only for newly connected ranks
itayalroy
committed
2678857