Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

parallel/test-runner-reporters is flaking #46747

Closed
joyeecheung opened this issue Feb 20, 2023 · 2 comments · Fixed by #46737
Closed

parallel/test-runner-reporters is flaking #46747

joyeecheung opened this issue Feb 20, 2023 · 2 comments · Fixed by #46737
Labels
flaky-test Issues and PRs related to the tests with unstable failures on the CI. test_runner Issues and PRs related to the test runner subsystem. test Issues and PRs related to the tests.

Comments

@joyeecheung
Copy link
Member

From nodejs/reliability#501 it's failing 15 PRs out of the last 100 CI runs.

Reason parallel/test-runner-reporters
Type JS_TEST_FAILURE
Failed PR 15 (#46600, #46547, #46725, #45841, #46721, #46735, #46509, #46387, #46723, #46616, #46737, #45258, #46577, #46736, #46738)
Appeared test-osuosl-rhel8-ppc64_le-2, test-osuosl-rhel8-ppc64_le-3, test-digitalocean-freebsd12-x64-1, test-osuosl-rhel8-ppc64_le-4, test-ibm-rhel8-s390x-4, test-rackspace-win2012r2_vs2017-x64-4, test-rackspace-win2012r2_vs2019-x64-1, test-rackspace-win2012r2_vs2015-x64-2, test-rackspace-win2012r2_vs2013-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49683/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49750/
Example
not ok 2463 parallel/test-runner-reporters
  ---
  duration_ms: 3.288
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: node:test reporters
        # Subtest: should default to outputing TAP to stdout
        ok 1 - should default to outputing TAP to stdout
          ---
          duration_ms: 2885.486488
          ...

@joyeecheung joyeecheung added test Issues and PRs related to the tests. flaky-test Issues and PRs related to the tests with unstable failures on the CI. test_runner Issues and PRs related to the test runner subsystem. labels Feb 20, 2023
@joyeecheung
Copy link
Member Author

cc @nodejs/test_runner

@MoLow
Copy link
Member

MoLow commented Feb 21, 2023

working on resolving this. see a discussion regarding this fluke: #46737 (comment)

@MoLow MoLow closed this as completed in ce49f79 Feb 21, 2023
MoLow added a commit that referenced this issue Feb 21, 2023
PR-URL: #46737
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MoLow added a commit to MoLow/node that referenced this issue Feb 25, 2023
PR-URL: nodejs#46737
Fixes: nodejs#46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MoLow added a commit to MoLow/node that referenced this issue Feb 25, 2023
PR-URL: nodejs#46737
Fixes: nodejs#46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MoLow added a commit to MoLow/node that referenced this issue Feb 25, 2023
PR-URL: nodejs#46737
Fixes: nodejs#46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
juanarbol pushed a commit that referenced this issue Mar 3, 2023
PR-URL: #46737
Backport-PR-URL: #46839
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
juanarbol pushed a commit that referenced this issue Mar 5, 2023
PR-URL: #46737
Backport-PR-URL: #46839
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
targos pushed a commit that referenced this issue Mar 13, 2023
PR-URL: #46737
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
targos pushed a commit that referenced this issue Mar 14, 2023
PR-URL: #46737
Fixes: #46747
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
flaky-test Issues and PRs related to the tests with unstable failures on the CI. test_runner Issues and PRs related to the test runner subsystem. test Issues and PRs related to the tests.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants