[KV offload][1/N] Introduce an offloading component#19848

njhill merged 1 commit intovllm-project:mainvllm-project/vllm:mainfrom

orozery:offloadingorozery/vllm:offloadingCopy head branch name to clipboard