fix: turbo4 on non-128 heads + KV state serialization with padded tensors (issue #28)#30

TheTom merged 1 commit into

TheTom:feature/turboquant-kv-cacheTheTom/llama-cpp-turboquant:feature/turboquant-kv-cachefrom

signalnine:feature/turboquant-kv-cachesignalnine/llama-cpp-turboquant:feature/turboquant-kv-cacheCopy head branch name to clipboard