Skip to content

Repository navigation

perf(cuda): prefetch-pipeline the block-32 scales-fp16 split-K int4 GEMV (+4.4% q38 decode) - #1584

Merged
justinchuby merged 3 commits into
mainfrom
squad/int4-gemv-m1
Aug 20, 2026
Merged

perf(cuda): prefetch-pipeline the block-32 scales-fp16 split-K int4 GEMV (+4.4% q38 decode)#1584
justinchuby merged 3 commits into
mainfrom
squad/int4-gemv-m1

Merge origin/main (0faa63547, #1585 deep-split GQA k/v) into squad/in…

b0c28d1
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar