Skip to content

feat: add NVFP4 MoE kernels with optional 4over6 quantization - #12

Draft
S1ro1 wants to merge 6 commits into
feat/mxfp8-moe-runtimefrom
feat/nvfp4-moe
Draft

S1ro1 wants to merge 6 commits into
feat/mxfp8-moe-runtimefrom
feat/nvfp4-moe

feat: add FlashInfer-compatible 4over6 NVFP4 quantization

436719d
Select commit
Loading
Failed to load commit list.