Skip to content

server : refactor prompt cache state ownership - #25649

Merged
ggerganov merged 3 commits into
masterfrom
gg/server-clear-checkpoints
Jul 14, 2026
Merged

server : refactor prompt cache state ownership#25649
ggerganov merged 3 commits into
masterfrom
gg/server-clear-checkpoints

server : handle batched slot being cleared

07e604b
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar