kv cache : optimize restoring non-contiguous cells - #27991

Merged

ggerganov merged 4 commits into

ggml-org:masterfrom

itsnotoger:kv-restore-run-batch

Aug 31, 2026

Commits on Aug 30, 2026

kv cache : batch state restore scatter reads per contiguous run
itsnotoger
committed
ae89c2c
context : fall back to the byte cursor when read and write chunking differ
itsnotoger
committed
a0a8aab
tests : cover state restore scatter reads on host and on-device paths
itsnotoger
committed
e1e96a8

Commits on Aug 31, 2026

Merge branch 'ggml-org:master' into kv-restore-run-batch
itsnotoger
authored
9e352f5