Skip to content

[BugFix] Wait for compute before offloading KV to CPU#31341

Merged
njhill merged 2 commits into
vllm-project:mainfrom
orozery:offloading-wait-stream
Jan 10, 2026
Merged

[BugFix] Wait for compute before offloading KV to CPU#31341
njhill merged 2 commits into
vllm-project:mainfrom
orozery:offloading-wait-stream

Merge branch 'main' into offloading-wait-stream

4f5923a
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Jan 10, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync