Skip to content

fix(cuda): allow f16/bf16 + q8_0 KV without GGML_CUDA_FA_ALL_QUANTS - #82

Merged
TheTom merged 1 commit into
feature/turboquant-kv-cachefrom
fix/cuda-fa-mixed-kv-without-all-quants
Apr 17, 2026
Merged

fix(cuda): allow f16/bf16 + q8_0 KV without GGML_CUDA_FA_ALL_QUANTS#82
TheTom merged 1 commit into
feature/turboquant-kv-cachefrom
fix/cuda-fa-mixed-kv-without-all-quants

fix(cuda): allow f16/bf16 + q8_0 mixed KV without GGML_CUDA_FA_ALL_QU…

9bc88bd
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error

The logs for this run have expired and are no longer available.