perf: reduce split W4A16 routing and output overhead - #5186

Open

zianglih wants to merge 3 commits into

flashinfer-ai:mainfrom

zianglih:perf/w4a16-split-megamoe-learnings

Commits on Sep 13, 2026

perf: specialize split W4A16 fused finalize on top-k
zianglih
committed
968380d
perf: specialize split W4A16 epilogue bounds
zianglih
committed
b90b347
perf: use complete W4A16 subtiles for scratch stores
zianglih
committed
88ff7db