feat: wire flashinfer autotuner - #820

Merged

syuoni merged 6 commits into

lightseekorg:mainfrom

syuoni:autotuner

Aug 1, 2026

Commits on Aug 1, 2026

feat(runtime): autotune kernels once at startup, before graph capture

syuoni
and
claude
committed
9874a96
feat(kernel): autotune nvfp4_gemm_swiglu_nvfp4_quant tile and cluster shape

syuoni
and
claude
committed
5e908f4
refactor(kernel): make the startup autotune window the only tuning path

syuoni
and
claude
committed
af92605
fix ut
syuoni
committed
39d322c
fix(runtime): keep startup dummy prefill requests within the model context length

syuoni
and
claude
committed
bbb6966
fix(kernel): reject cluster shapes the persistent scheduler mis-tiles in nvfp4_gemm_swiglu

syuoni
and
claude
committed
2e22df4