feat: TQ4_1S weight compression (Metal only, needs CUDA port)#45

TheTom merged 0 commit into

feature/turboquant-kv-cacheTheTom/llama-cpp-turboquant:feature/turboquant-kv-cachefrom

pr/tq4-weight-compressionTheTom/llama-cpp-turboquant:pr/tq4-weight-compressionCopy head branch name to clipboard