Skip to content

Force NVFP4 W4A8 path for NVFP4_W4A16 layers on Blackwell, where NVFP4 normally uses the native W4A4 path. - #24364

Draft
ynankani wants to merge 8 commits into
ggml-org:masterfrom
ynankani:ynankani/Force_W4A16_NVFP4_to_W4A8
Draft

Force NVFP4 W4A8 path for NVFP4_W4A16 layers on Blackwell, where NVFP4 normally uses the native W4A4 path. #24364
ynankani wants to merge 8 commits into
ggml-org:masterfrom
ynankani:ynankani/Force_W4A16_NVFP4_to_W4A8