feat: KV offloading for the Metal backend (pageable host pool, disk tier, cross-restart reuse) - #530

feat: KV offloading for the Metal backend (pageable host pool, disk tier, cross-restart reuse)#530

RobbieJ wants to merge 8 commits into

vllm-project:mainvllm-project/vllm-metal:mainfrom

RobbieJ:kv-offload-metal-prRobbieJ/vllm-metal:kv-offload-metal-prCopy head branch name to clipboard