[KV Connector][Mooncake] Start async lookup when a request arrives via on_new_request - #61292

[KV Connector][Mooncake] Start async lookup when a request arrives via on_new_request#61292

njhill merged 8 commits into

vllm-project:mainvllm-project/vllm:mainfrom

Dao007forever:dao/preschedule-lookupDao007forever/vllm:dao/preschedule-lookupCopy head branch name to clipboard