-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add flaky shadow mode #553
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅ ✅ All tests successful. No failed tests found. @@ Coverage Diff @@
## main #553 +/- ##
=======================================
Coverage 97.52% 97.52%
=======================================
Files 425 425
Lines 35488 35497 +9
=======================================
+ Hits 34608 34617 +9
Misses 880 880
Flags with carried forward coverage won't be shown. Click here to find out more.
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
✅ All tests successful. No failed tests found. @@ Coverage Diff @@
## main #553 +/- ##
=======================================
Coverage 97.52% 97.52%
=======================================
Files 425 425
Lines 35488 35497 +9
=======================================
+ Hits 34608 34617 +9
Misses 880 880
Flags with carried forward coverage won't be shown. Click here to find out more.
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
✅ All tests successful. No failed tests found. @@ Coverage Diff @@
## main #553 +/- ##
=======================================
Coverage 97.52% 97.52%
=======================================
Files 425 425
Lines 35488 35497 +9
=======================================
+ Hits 34608 34617 +9
Misses 880 880
Flags with carried forward coverage won't be shown. Click here to find out more.
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
✅ All tests successful. No failed tests found. Additional details and impacted files@@ Coverage Diff @@
## main #553 +/- ##
=======================================
Coverage 97.55% 97.55%
=======================================
Files 458 458
Lines 36560 36569 +9
=======================================
+ Hits 35666 35675 +9
Misses 894 894
Flags with carried forward coverage won't be shown. Click here to find out more.
This change has been scanned for critical changes. Learn more |
we want to run the write part of the flake detection process without doing the read part of the flake detection process
b52eb6f
to
1e4d125
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Generally LGTM. Just a nit suggestion.
tasks/sync_pull.py
Outdated
if ( | ||
FLAKY_TEST_DETECTION.check_value(identifier=repoid, default=False) | ||
and read_yaml_field( | ||
current_yaml, ("test_analytics", "flake_detection"), False | ||
) | ||
) or (FLAKY_SHADOW_MODE.check_value(identifier=repoid, default=False)): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This if
statement is kind of hard to read. I would suggest pulling up the conditional into a variable or function. If you pull it up into a function, we can even make this reusable in test_results_finisher.py
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
addressed 👍
Signed-off-by: joseph-sentry <[email protected]>
we want to run the write part of the flake detection process without doing the read part of the flake detection process