Disable KV cache shifting automatically for unsupported models#11053
Merged
ggerganov merged 2 commits intoggml-org:masterfrom Jan 3, 2025
Merged
Disable KV cache shifting automatically for unsupported models#11053ggerganov merged 2 commits intoggml-org:masterfrom
ggerganov merged 2 commits intoggml-org:masterfrom