Skip to content

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into cpu/ package#37874

Merged
orozery merged 7 commits into
vllm-project:mainfrom
ronensc:cpu-manager
Mar 24, 2026
Merged

[KV Offload] Refactor CPU offloading: pluggable CachePolicy, remove Backend abstraction, restructure into cpu/ package#37874
orozery merged 7 commits into
vllm-project:mainfrom
ronensc:cpu-manager

Address review: reorganize file tree structure

4fa01c2
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Mar 23, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO