Skip to content

[1/2] cuda: native TQ4_1S MMQ prefill on CDNA - #336

Merged
TheTom merged 2 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq4_1s-mmq-cdna2
Sep 3, 2026
Merged

[1/2] cuda: native TQ4_1S MMQ prefill on CDNA#336
TheTom merged 2 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq4_1s-mmq-cdna2

cuda: guard __builtin_amdgcn_perm in the TQ4_1S tile loader for nvcc …

03ee3ed
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
labeler
succeeded Sep 3, 2026 in 10s