Skip to content

[kv_offload]: Add request_finished method to OffloadingManager and decouple store policy - #42050

Draft
hickeyma wants to merge 6 commits into
vllm-project:mainfrom
hickeyma:decouple-store-policy
Draft

[kv_offload]: Add request_finished method to OffloadingManager and decouple store policy#42050
hickeyma wants to merge 6 commits into
vllm-project:mainfrom
hickeyma:decouple-store-policy

Fix mypy error in CI

66354a9
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded May 13, 2026 in 0s

There is no internal Diff connected, this can be merged now