fix: Gemma 4 time-to-first-token drops from 8-12s to <1s by unblocking cache reuse - #9

fix: Gemma 4 time-to-first-token drops from 8-12s to <1s by unblocking cache reuse#9

Ooooze merged 1 commit into

AtomicBot-ai:feature/turboquant-kv-cacheAtomicBot-ai/atomic-llama-cpp-turboquant:feature/turboquant-kv-cachefrom

sujitvasanth:fix/iswa-get-can-shift-gemma4sujitvasanth/atomic-llama-cpp-turboquant:fix/iswa-get-can-shift-gemma4Copy head branch name to clipboard