perf(cpu): break the serial f32 reduction chain in the int4 decode GEMV (5.75x t=1) - #1667

perf(cpu): break the serial f32 reduction chain in the int4 decode GEMV (5.75x t=1)#1667

justinchuby merged 3 commits into

mainjustinchuby/onnx-genai:mainfrom

roy/gemv-nk-chainjustinchuby/onnx-genai:roy/gemv-nk-chainCopy head branch name to clipboard