Skip to content

[Core] Replace routing replay with device cache and async D2H pipeline#39917

Open
TomerBN-Nvidia wants to merge 9 commits intovllm-project:mainfrom
TomerBN-Nvidia:upstream-routing-replay
Open

[Core] Replace routing replay with device cache and async D2H pipeline#39917
TomerBN-Nvidia wants to merge 9 commits intovllm-project:mainfrom
TomerBN-Nvidia:upstream-routing-replay

Commits

Commits on Apr 16, 2026