Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

harness: improve robustness of tests #1194

Merged
merged 11 commits into from
Dec 23, 2023
Merged

harness: improve robustness of tests #1194

merged 11 commits into from
Dec 23, 2023

Conversation

dyc3
Copy link
Owner

@dyc3 dyc3 commented Dec 22, 2023

  • improve robustness of should_update_load_epoch_when_balancer_restart_2_monoliths
  • slightly improve should_prioritize_same_region_ws robustness
  • refactor harness discoverer to make it easier to debug
  • fix harness discoverer sometimes listening on a port that is already being used
  • improve some error messages
  • use ipv6 localhost to check port availability
  • minor refactor
  • automatically try to restart the balancer if starting it the first time fails
  • make route_ws_to_correct_monolith_race much less flaky
  • improve reliability of should_not_unload_rooms_when_balancer_restart

Dramatically improves the robustness of many of our tests. However, I think we might need to go back to the drawing board with how the emulated monolith works, specifically with regards to receiving messages in order to completely fix it.

@dyc3 dyc3 force-pushed the harness-test-robustness branch from 866d0e2 to a708f3c Compare December 23, 2023 13:01
Copy link

codecov bot commented Dec 23, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (6a5498d) 61.4426% compared to head (1d27786) 61.4426%.

Additional details and impacted files
@@             Coverage Diff             @@
##             master      #1194   +/-   ##
===========================================
  Coverage   61.4426%   61.4426%           
===========================================
  Files           115        115           
  Lines          9316       9316           
  Branches       1139       1139           
===========================================
  Hits           5724       5724           
  Misses         3592       3592           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

cypress bot commented Dec 23, 2023

Passing run #768 ↗︎

0 71 1 0 Flakiness 0

Details:

Merge 1d27786 into 6a5498d...
Project: OpenTogetherTube Commit: 2f8e6b1339 ℹ️
Status: Passed Duration: 03:49 💡
Started: Dec 23, 2023 1:04 PM Ended: Dec 23, 2023 1:08 PM

Review all test suite changes for PR #1194 ↗︎

@dyc3 dyc3 merged commit 3bc8b99 into master Dec 23, 2023
18 checks passed
@dyc3 dyc3 deleted the harness-test-robustness branch December 23, 2023 13:13
cjrkoa pushed a commit to cjrkoa/opentogethertube that referenced this pull request Jan 26, 2024
* improve robustness of `should_update_load_epoch_when_balancer_restart_2_monoliths`

* slightly improve `should_prioritize_same_region_ws` robustness

* refactor harness discoverer to make it easier to debug

* fix harness discoverer sometimes listening on a port that is already being used

* improve some error messages

* use ipv6 localhost to check port availability

* minor refactor

* automatically try to restart the balancer if starting it the first time fails

* make `route_ws_to_correct_monolith_race` much less flaky

* improve reliability of `should_not_unload_rooms_when_balancer_restart`

* format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant