Skip to content

feat(inference): opt-in online FP8 ue8m0 scales and stochastic weight rounding - #4041

Closed
garrett361 wants to merge 3 commits into
mainfrom
feat/online-fp8-weight-rounding
Closed

feat(inference): opt-in online FP8 ue8m0 scales and stochastic weight rounding#4041
garrett361 wants to merge 3 commits into
mainfrom
feat/online-fp8-weight-rounding

feat(configs): reject online FP8 rounding options that cannot take ef…

64c3a04
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar