Skip to content

[Bugfix] Register KV caches with the connector outside the runtime pool - #59847

Draft
aoshen02 wants to merge 2 commits into
vllm-project:mainfrom
aoshen02:fix/kv-connector-register-outside-runtime-pool
Draft

aoshen02 wants to merge 2 commits into
vllm-project:mainfrom
aoshen02:fix/kv-connector-register-outside-runtime-pool