Skip to content

cpu: copy the KV cache by plane instead of scattering it element by element - #1756

Merged
justinchuby merged 2 commits into
mainfrom
seb/concat-cache-memcpy
Aug 22, 2026
Merged

justinchuby merged 2 commits into
mainfrom
seb/concat-cache-memcpy

Commits

  1. Commits on Aug 22, 2026