perf(cpu-ep): fuse the 8-bit dequant into the prefill GEMM pack step (17x kernel; every ORT prefill cell loss -> win) - #1403

perf(cpu-ep): fuse the 8-bit dequant into the prefill GEMM pack step (17x kernel; every ORT prefill cell loss -> win)#1403

justinchuby merged 90 commits into

squad/roy-int4-prefill-gebpjustinchuby/onnx-genai:squad/roy-int4-prefill-gebpfrom

squad/roy-int8-prefill-gebpjustinchuby/onnx-genai:squad/roy-int8-prefill-gebpCopy head branch name to clipboard