Skip to content

[2/2] cuda: TQ4_1S MMQ prefill on RDNA3 and RDNA2 - #337

Merged
TheTom merged 6 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq4_1s-mmq-rdna
Sep 3, 2026
Merged

[2/2] cuda: TQ4_1S MMQ prefill on RDNA3 and RDNA2#337
TheTom merged 6 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq4_1s-mmq-rdna

cuda: read GGML_TQ_MMQ once instead of on every mul_mat

439fe67
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
labeler
succeeded Sep 3, 2026 in 12s