Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#2589] Run CI tests in parallel #1282

Merged
merged 1 commit into from
Jun 26, 2024

Conversation

swrichards
Copy link
Contributor

@swrichards swrichards commented Jun 26, 2024

We have made several previous attempts at running the CI tests in
parallel, which were ultimately reverted because we ran into the
issue described at django/django#17650 and
https://code.djangoproject.com/ticket/32114 (in this repo, see PRs
#1050, #948 and #690.

The Django ticket has been fixed, but will will only be included
in 5.1 onwards, and won't be backported to 4.2.x. However, it seems
the current testsuite no longer fails with the issue reported in the
Django ticket (pickle related errors). It is possible the potentially
failing tests are flaky, but so far we've not run into it during a
handful of parallel runs. This commit will re-enable parallel tests,
and we'll have to see if we run into the same issues again.

@codecov-commenter
Copy link

codecov-commenter commented Jun 26, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 44.23%. Comparing base (4b02eb4) to head (c7f44f8).

❗ There is a different number of reports uploaded between BASE (4b02eb4) and HEAD (c7f44f8). Click for more details.

HEAD has 1 upload more than BASE | Flag | BASE (4b02eb4) | HEAD (c7f44f8) | |------|------|------| ||1|2|
Additional details and impacted files
@@             Coverage Diff              @@
##           develop    #1282       +/-   ##
============================================
- Coverage    95.17%   44.23%   -50.94%     
============================================
  Files          981      971       -10     
  Lines        35665    35453      -212     
============================================
- Hits         33945    15684    -18261     
- Misses        1720    19769    +18049     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@swrichards swrichards marked this pull request as ready for review June 26, 2024 13:27
@swrichards swrichards force-pushed the issues/2589-parallel-test-execution branch from 60a21db to c95919e Compare June 26, 2024 14:51
We have made several previous attempts at running the CI tests in
parallel, which were ultimately reverted because we ran into the
issue described at django/django#17650 and
https://code.djangoproject.com/ticket/32114 (in this repo, see PRs
1050, 948 and 690.

The Django ticket has been fixed, but will will only be included
in 5.1 onwards, and won't be backported to 4.2.x. However, it seems
the current testsuite no longer fails with the issue reported in the
Django ticket (pickle related errors). It is possible the potentially
failing tests are flaky, but so far we've not run into it during a
handful of parallel runs. This commit will re-enable parallel tests,
and we'll have to see if we run into the same issues again.
@swrichards swrichards force-pushed the issues/2589-parallel-test-execution branch from c95919e to c7f44f8 Compare June 26, 2024 14:52
@swrichards swrichards requested a review from pi-sigma June 26, 2024 14:53
@swrichards
Copy link
Contributor Author

swrichards commented Jun 26, 2024

FYI, a fair number of runs without flake: #1, #2, #3, #4, #5, #6 , #7.

@pi-sigma @alextreme let's discuss tomorrow whether we feel ok with this.

Copy link
Member

@alextreme alextreme left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm okay with trying this out again for the time being, worst case is that we run into the flakey tests issue again and have to revert this CI change

@alextreme alextreme merged commit 6546094 into develop Jun 26, 2024
17 checks passed
@alextreme alextreme deleted the issues/2589-parallel-test-execution branch June 26, 2024 18:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants