MatMulNBits: gate accuracy-4 M=1 decode on the host actually having an int8 dot product (up to 15x) - #1028

MatMulNBits: gate accuracy-4 M=1 decode on the host actually having an int8 dot product (up to 15x)#1028

justinchuby merged 3 commits into

mainjustinchuby/onnx-genai:mainfrom

squad/roy-int4-acc4-decode-isajustinchuby/onnx-genai:squad/roy-int4-acc4-decode-isaCopy head branch name to clipboard