[V1][Core] Add a cache hit threshold for requests - #24520

[V1][Core] Add a cache hit threshold for requests#24520

kfirwolfson wants to merge 2 commits into

vllm-project:mainvllm-project/vllm:mainfrom

kfirwolfson:feature/kv-cache-hit-thresholdkfirwolfson/vllm:feature/kv-cache-hit-thresholdCopy head branch name to clipboard