[Quant][Prototype] Hoist static FP8 input quant into model code - #42469

Draft

mgoin wants to merge 8 commits into

vllm-project:mainfrom

mgoin:nvfp4-input-quant-prototype

Commits on May 12, 2026

[Quant][Prototype] Hoist NVFP4 input quant out of Linear apply

mgoin
and
claude
committed
989c78c

Commits on May 13, 2026

[Quant][Prototype] Add static FP8 + Llama; gate manual fusion behind env var

mgoin
and
claude
committed
cc0e21c
[Quant][Prototype] Wire fused rms_norm_static_fp8_quant on hoist path

mgoin
and
claude
committed
5165a8e
[Quant][Prototype] Drop VLLM_HOIST_INPUT_QUANT gate

mgoin
and
claude
committed
5d6d041
[Quant][Prototype] Drop NVFP4 scope; let QuantizedActivation flow into kernel

mgoin
and
claude
committed
d49d677
[Quant][Prototype] Move RMSNorm+quant dispatch into quant_fusion

mgoin
and
claude
committed
4cb7ecc
[Quant][Prototype] Pass quant_key/input_scale explicitly at call site

mgoin
and
claude
committed
5c84221
Revert "[Quant][Prototype] Pass quant_key/input_scale explicitly at call site"
mgoin
committed
1c6157f