You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the source code I see that before division with the scale, SCALING is added (or subtracted) to (or from) the rational parameter value in most rounding functions. Instead the term should be (SCALING - 1). A fix would depend on the intended functionality:
either adjust the documentation
change the rounding in the source code
Can you please clarify which behaviour is intended? Then somebody could start a pull request...
Based on ETL version 20.40.0.
The text was updated successfully, but these errors were encountered:
Some of the scaled rounding functions incorrectly round scaled natural numbers. For example scaled 5.0 is rounded to 6.0 with
round_infinity_scaled()
. According to the referenced paper in the documentation for round-ceiling (toward positive infinity) this should result to 5.0:In the source code I see that before division with the scale,
SCALING
is added (or subtracted) to (or from) the rational parametervalue
in most rounding functions. Instead the term should be(SCALING - 1)
. A fix would depend on the intended functionality:Can you please clarify which behaviour is intended? Then somebody could start a pull request...
Based on ETL version 20.40.0.
The text was updated successfully, but these errors were encountered: