feat: zero-pad non-128 heads + turbo4 CUDA port + cross-type FA (issues #13, #25)#24

TheTom merged 5 commits into

TheTom:feature/turboquant-kv-cacheTheTom/llama-cpp-turboquant:feature/turboquant-kv-cachefrom

signalnine:feature/turboquant-kv-cachesignalnine/llama-cpp-turboquant:feature/turboquant-kv-cacheCopy head branch name to clipboard