Skip to content

[Core][KV Offload] Service the P2P control plane while the engine waits on the model - #57165

Closed
nilig wants to merge 2 commits into
vllm-project:mainfrom
nilig:p2p/control-plane-off-step
Closed

nilig wants to merge 2 commits into
vllm-project:mainfrom
nilig:p2p/control-plane-off-step

[Core][KV Connector] Service connector work while waiting on the model

94ac8f3
Select commit
Loading
Failed to load commit list.