[release/10.0] Non-zero result of Vector3.Cross with parallel vectors #119450
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Backport of #119438 to release/10.0
/cc @tannergooding @pedrobsaila
Customer Impact
Developers using
Vector3.Cross(x, x)(that is the cross-product of parallel vectors) to be zero and would get a non-zero result.Regression
This was regressed sometime in .NET 9 and wasn't caught due to it being non-LTS. The fix was introduced as part of an optimization to use
MultiplyAddEstimatewhich allows the use ofFusedMultiplyAddon hardware that supports it, similarly to other vector math libraries (such as DirectX Math). This instruction is more accurate but can also cause a non-zero result in some edge cases due to the additional precision and inherent rounding error.Testing
An explicit regression test was added.
Risk
Low risk. This simply changes out
MultiplyAddEstimate(a, b, c)for an explicit(a * b) + cinstead so that fusing can no longer occur.