Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase critical value threshold #3004

Merged
merged 1 commit into from
Oct 26, 2023
Merged

Conversation

Alan-Jowett
Copy link
Member

@Alan-Jowett Alan-Jowett commented Oct 25, 2023

Resolves: #2986

Description

Test of randomness for causes sporadic failures by being to strict.

Testing

CI/CD

Documentation

No.

Installation

No.

@@ -1094,7 +1094,7 @@ TEST_CASE("get_authentication_id", "[platform]")

#define SEQUENCE_LENGTH 1024 * 128
#define CHI_SQUARED_STATISTIC_THRESHOLD \
3.841 // Critical value for Chi-squared test with 2 degrees of freedom with significance level of 0.05.
9.210 // Critical value for Chi-squared test with 2 degrees of freedom with significance level of 0.01.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For my understanding, how does the change in level help?
Was there a test failure/problem already encountered?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, see #2986

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The issue doesn't provide the Root Cause Analysis.

@dv-msft dv-msft added this pull request to the merge queue Oct 26, 2023
Merged via the queue into microsoft:main with commit 973cfef Oct 26, 2023
76 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Workflow failed - unit_tests
4 participants