Repository navigation

feat(norm): fused Add+RMSNorm+1x128 fp8 block-quant producer - #4480

Merged

kahyunnam merged 7 commits into

flashinfer-ai:mainfrom

NVShreyas:shreyasm/fused-add-rmsnorm-fp8-block-quant

Aug 27, 2026

Merged

feat(norm): fused Add+RMSNorm+1x128 fp8 block-quant producer#4480
kahyunnam merged 7 commits into
flashinfer-ai:mainfrom
NVShreyas:shreyasm/fused-add-rmsnorm-fp8-block-quant

Commits on Aug 12, 2026
- feat(norm): fused Add+RMSNorm+1x128 fp8 block-quant producer
  
  NVShreyas
  and
  claude
  committed
  55dbfa8
- fix(bench): correct byte model — weight is H, not M×H
  
  NVShreyas
  and
  claude
  committed
  1501b44
- fix(norm): validate hidden_size + use normed_out's own row stride
  
  NVShreyas
  and
  claude
  committed
  5863564
- test(norm): unit tests for fused_add_rmsnorm_fp8_block_quant
  
  NVShreyas
  and
  claude
  committed
  f0e9fbe
- feat(norm): mark fused_add_rmsnorm_fp8_block_quant as a public flashinfer_api
  
  NVShreyas
  and
  claude
  committed
  ccc3a55
Commits on Aug 26, 2026
- fix(norm): validate out/block_scale/normed_out in fp8 block-quant binding
  
  NVShreyas
  and
  claude
  committed
  3268a08
- docs(norm): list fused_add_rmsnorm_fp8_block_quant in the API reference
  
  NVShreyas
  and
  claude
  committed
  2b2e6cb