Skip to content

cuda: TurboQuant TQ4_1S decode optimisations - #338

Closed
jasstrong wants to merge 13 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq4_1s-decode
Closed

jasstrong wants to merge 13 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq4_1s-decode