Skip to content

CPU KV Offloading: Use more CUDA streams - #29013

Merged
njhill merged 2 commits into
vllm-project:mainfrom
orozery:cpu-kv-offloading-streams
Dec 14, 2025
Merged

CPU KV Offloading: Use more CUDA streams#29013
njhill merged 2 commits into
vllm-project:mainfrom
orozery:cpu-kv-offloading-streams

Merge branch 'main' into cpu-kv-offloading-streams

7d7b4a9
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Dec 14, 2025 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync