--split-mode=tensor KV cache quantization support#23912

gordan-bobic wants to merge 1 commit into

ggml-org:masterggml-org/llama.cpp:masterfrom

shatteredsilicon:split-mode-tensor-kv-quant-enableshatteredsilicon/llama.cpp:split-mode-tensor-kv-quant-enableCopy head branch name to clipboard