[Cherry pick to release/v0.5.15] Fix NVFP4 online quantization - #30397
Conversation
b8zhong
changed the title
|
/rerun-test test/registered/backends/test_flashinfer_trtllm_gen_moe_backend.py |
|
Results for 🚀 |
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request adds the dequant_fp4_to_fp8 attribute, initialized to False, to the quantization configuration in nvfp4_online.py. There are no review comments, and I have no feedback to provide.
Important
The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.
…roject#30397) Co-authored-by: Brayden Zhong <brayden@radixark.ai>
…roject#30397) Co-authored-by: Brayden Zhong <brayden@radixark.ai>
… NVFP4 online quantization (sgl-project#30397) (sgl-project#30424) Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca> Co-authored-by: Brayden Zhong <brayden@radixark.ai>
…roject#30397) Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2 participants
test/registered/backends/test_flashinfer_trtllm_gen_moe_backend.pyAttributeError: 'NvFp4OnlineConfig' object has no attribute 'dequant_fp4_to_fp8'It's broken by #27867
CI States
Latest PR Test (Base): ❌ Run #28869009529
Latest PR Test (Extra): 🚫 Run #28869008915