perf(cpu): remove per-block bookkeeping from the int4 acc4 decode kernel (1.69x t=1, 1.38x block 64) - #1628

perf(cpu): remove per-block bookkeeping from the int4 acc4 decode kernel (1.69x t=1, 1.38x block 64)#1628

justinchuby merged 13 commits into

mainjustinchuby/onnx-genai:mainfrom

squad/sebastian-int4-acc4-block-bookkeepingjustinchuby/onnx-genai:squad/sebastian-int4-acc4-block-bookkeepingCopy head branch name to clipboard