Add cache watermark to avoid frequent cache eviction#11

WoosukKwon merged 5 commits intomainvllm-project/vllm:mainfrom

watermarkvllm-project/vllm:watermarkCopy head branch name to clipboard