Repository navigation

feat(trainer): add FP8 QAT with shared stochastic rounding - #4073

Open

nxphi47 wants to merge 5 commits into

feat/fp8-stochastic-roundingfrom

feat/dsv4-fp8-qat-sft

Open

feat(trainer): add FP8 QAT with shared stochastic rounding#4073
nxphi47 wants to merge 5 commits into
feat/fp8-stochastic-roundingfrom
feat/dsv4-fp8-qat-sft

Commits on Oct 13, 2026
- feat: add FP8 QAT with consistent stochastic weight rounding
  nxphi47
  committed
  3daffca
- fix: align QAT output projection with vLLM casting
  nxphi47
  committed
  9b10d47
- feat: share FP8 stochastic rounding scaffolding with QAT
  nxphi47
  committed
  f1eee78
- merge: align QAT review with shared FP8 SR parent
  nxphi47
  committed
  c40ad7a
- docs: record FP8 QAT decisions and validation results
  nxphi47
  committed
  97fac65