Skip to content

scheduler: Cache also the last block after KV recving - #32168

Closed
orozery wants to merge 1 commit into
vllm-project:mainfrom
orozery:sched-cache-last-async-loaded-block
Closed

scheduler: Cache also the last block after KV recving#32168
orozery wants to merge 1 commit into
vllm-project:mainfrom
orozery:sched-cache-last-async-loaded-block

scheduler: Cache also the last block after KV recving

0076065
Select commit
Loading
Failed to load commit list.