Skip to content

fix fp8 online quantization streaming with tp > 1#30900

Merged
robertgshaw2-redhat merged 1 commit intovllm-project:mainfrom
vkuzo:20251217_fp8_streaming_fix
Dec 18, 2025
Merged

fix fp8 online quantization streaming with tp > 1#30900
robertgshaw2-redhat merged 1 commit intovllm-project:mainfrom
vkuzo:20251217_fp8_streaming_fix

Commits

Commits on Dec 18, 2025