Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI Reliability 2022-09-26 #385

Open
18 tasks
github-actions bot opened this issue Sep 26, 2022 · 0 comments
Open
18 tasks

CI Reliability 2022-09-26 #385

github-actions bot opened this issue Sep 26, 2022 · 0 comments

Comments

@github-actions
Copy link

Failures in node-test-pull-request/46696 to node-test-pull-request/46788 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-09-26 00:18 6 9 9 4 72 10.00%

JSTest Failure

Reason sequential/test-cpu-prof-drained
Type JS_TEST_FAILURE
Failed PR 5 (nodejs/node#44774, nodejs/node#44763, nodejs/node#44675, nodejs/node#44779, nodejs/node#44778)
Appeared test-equinix-ubuntu1804_sharedlibs_container-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46752/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46757/
Example
not ok 3685 sequential/test-cpu-prof-drained
  ---
  duration_ms: 0.516
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":3,"result":{}}
    
    
    #
    # Fatal error in ../deps/v8/src/execution/frames.h, line 190
    # Debug check failed: static_cast<uintptr_t>(type) < Type::NUMBER_OF_TYPES (93825331403216 vs. 24).
    #
    #
    #
    #FailureMessage Object: 0xffffe926d968
     1: 0xaaaab28d093c node::DumpBacktrace(_IO_FILE*) [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     2: 0xaaaab2aae880  [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     3: 0xaaaab2aae8b4  [/home/iojs...

Reason parallel/test-worker-heap-snapshot
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#44675, nodejs/node#44696, nodejs/node#44778)
Appeared test-rackspace-win2012r2_vs2017-x64-3, test-rackspace-win2012r2_vs2013-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46755/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46781/
Example
not ok 806 parallel/test-worker-heap-snapshot
  ---
  duration_ms: 1.252
  severity: fail
  exitcode: 134
  stack: |-
    FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
  ...


Reason sequential/test-cpu-prof-dir-relative
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#44758, nodejs/node#44412, nodejs/node#44754)
Appeared test-equinix-ubuntu1804_sharedlibs_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46730/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46732/
Example
not ok 3683 sequential/test-cpu-prof-dir-relative
  ---
  duration_ms: 0.335
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":3,"result":{}}
    
    
    #
    # Fatal error in ../deps/v8/src/execution/frames.h, line 190
    # Debug check failed: static_cast<uintptr_t>(type) < Type::NUMBER_OF_TYPES (140737487869144 vs. 24).
    #
    #
    #
    #FailureMessage Object: 0xfffffff109d8
     1: 0xaaaac7cdc93c node::DumpBacktrace(_IO_FILE*) [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     2: 0xaaaac7eba880  [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     3: 0xaaaac7eba8b4  [/hom...

Reason sequential/test-watch-mode-inspect
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#44754, nodejs/node#44758, nodejs/node#44436)
Appeared test-nearform-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46732/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46735/
Example
not ok 3786 sequential/test-watch-mode-inspect
  ---
  duration_ms: 120.163
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    (node:41648) ExperimentalWarning: The test runner is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
  ...


Reason parallel/test-crypto-key-objects
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs-private/node-private/pull/342/, https://github.com/nodejs-private/node-private/pull/352/)
Appeared test-nearform-macos10.15-x64-1, test-joyent-smartos20-x64-3, test-joyent-smartos20-x64-4, test-orka-macos10.14-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46704/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46721/
Example
not ok 383 parallel/test-crypto-key-objects
  ---
  duration_ms: 0.402
  severity: crashed
  exitcode: -6
  stack: |-
  ...


Reason parallel/test-http2-misbehaving-multiplex
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#44741, nodejs/node#44696)
Appeared test-osuosl-rhel8-ppc64_le-4
First CI https://ci.nodejs.org/job/node-test-pull-request/46771/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46772/
Example
not ok 1662 parallel/test-http2-misbehaving-multiplex
  ---
  duration_ms: 0.214
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: 5
        at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-http2-misbehaving-multiplex.js:45:10)
        at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/common/index.js:446:15)
        at Http2Server.emit (node:events:513:28)
        at ServerHttp2Session.sessionOnStream (node:internal/http2/core:2999:19)
        at ServerHttp2Session.emit (node:events:513:28)
        at emit (node:internal/http2/core:329:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:85:22) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 5,
      expected: 5,
      operator: 'notStrictEq...

Reason sequential/test-perf-hooks
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#44779, nodejs/node#44782)
Appeared test-digitalocean-fedora32-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7
First CI https://ci.nodejs.org/job/node-test-pull-request/46756/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46766/
Example
not ok 3779 sequential/test-perf-hooks
  ---
  duration_ms: 1.613
  severity: fail
  exitcode: 1
  stack: |-
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 37.9613037109375 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 37.921607971191406, delay: 2500 },
      environment: { around: 0 },
      loopStart: -1,
      loopExit: -1
    }
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 1044.084243774414 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 37.921607971191406, delay: 2500 },
      environment: { around: 0 },
      loopStart: { around: 37.921607971191406, delay: 2500 },
      loopExit: -1
    }
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 1437.6282119750977 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around:...

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs-private/node-private/pull/342/, nodejs/node#44758, nodejs/node#44779)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2, test-orka-macos10.14-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46702/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46756/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 45.55.90.237/45.55.90.237:35276' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy92.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs-private/node-private/pull/350/, nodejs/node#44763)
Appeared test-softlayer-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46720/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46779/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure

Reason ERROR: Error fetching remote repo 'jenkins_tmp'
Type GIT_FAILURE
Failed PR 10 (nodejs/node#44690, nodejs/node#44739, nodejs/node#44758, nodejs/node#44741, nodejs/node#44779, nodejs/node#44693, nodejs/node#44683, nodejs/node#44689, nodejs/node#44778, nodejs/node#44763)
Appeared test-softlayer-rhel8_arm_cross_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46737/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46784/
Example
ERROR: Error fetching remote repo 'jenkins_tmp'
hudson.plugins.git.GitException: Failed to fetch from [email protected]:binary_tmp.git
	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:1003)
	at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1244)
	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1308)
	at hudson.scm.SCM.checkout(SCM.java:540)

Build Failure

Reason FATAL: Connection timed out
Type BUILD_FAILURE
Failed PR 25 (nodejs/node#44412, nodejs/node#44756, nodejs/node#44436, nodejs/node#44690, nodejs/node#44726, nodejs/node#44250, nodejs/node#44758, nodejs/node#41276, nodejs/node#44675, nodejs/node#44775, nodejs/node#44739, nodejs/node#44782, nodejs/node#44774, nodejs/node#44754, nodejs/node#44741, nodejs/node#44779, nodejs/node#44769, nodejs/node#44685, nodejs/node#44686, nodejs/node#44683, nodejs/node#44689, nodejs/node#44778, nodejs/node#44763, nodejs/node#44696, nodejs/node#44693)
Appeared test-equinix-ubuntu2204-x64-1, test-packetnet-ubuntu1804-x64-1, test-ibm-ubuntu1804-x64-1, test-packetnet-ubuntu1804-x64-2, test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46731/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46786/
Example
FATAL: Connection timed out
java.net.ConnectException: Connection timed out
	at java.base/sun.nio.ch.Net.connect0(Native Method)
	at java.base/sun.nio.ch.Net.connect(Net.java:579)
	at java.base/sun.nio.ch.Net.connect(Net.java:568)
	at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:588)

Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 6 (https://github.com/nodejs-private/node-private/pull/350/, nodejs/node#44758, nodejs/node#44250, nodejs/node#44739, nodejs/node#44782, nodejs/node#44689)
Appeared test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46699/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46780/
Example
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 

> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp

Reason Error: socket hang up
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs-private/node-private/pull/352/, nodejs/node#44412, nodejs/node#44754, nodejs/node#44436, nodejs/node#44739)
Appeared test-digitalocean-ubuntu1804-x64-1, test-digitalocean-alpine311_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46708/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46750/
Example
Error: socket hang up
    at connResetException (node:internal/errors:711:14)
    at TLSSocket.socketCloseListener (node:_http_client:461:25)
    at TLSSocket.emit (node:events:525:35)
    at node:net:298:12
    at TCP.done (node:_tls_wrap:587:7) {

Reason ERROR: Step �Publish JUnit test result report� failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs-private/node-private/pull/342/, https://github.com/nodejs-private/node-private/pull/348/, https://github.com/nodejs-private/node-private/pull/352/, https://github.com/nodejs-private/node-private/pull/350/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-4, test-azure_msft-win10_vs2019-x64-3, test-rackspace-win2012r2_vs2019-x64-1, test-rackspace-win2012r2_vs2017-x64-4, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2012r2_vs2013-x64-1, test-azure_msft-win10_vs2019-x64-2, test-rackspace-win2012r2_vs2015-x64-2, test-rackspace-win2012r2_vs2017-x64-3, test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2013-x64-2, test-rackspace-win2012r2_vs2015-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46700/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46720/
Example
ERROR: Step �Publish JUnit test result report� failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason error: The last gc run reported the following. Please correct the root cause
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#44690, nodejs/node#44739, nodejs/node#44758, nodejs/node#44741)
Appeared test-digitalocean-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46737/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46771/
Example
error: The last gc run reported the following. Please correct the root cause
and remove .git/gc.log.
Automatic cleanup will not be performed until the file is removed.

warning: There are too many unreachable loose objects; run 'git prune' to remove them.

Reason FATAL: Channel "hudson.remoting.Channel@6008869b:JNLP4-connect connection from ... Remote call on JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838 failed. The channel is closing down or has closed down
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#44758, nodejs/node#44412)
Appeared test-equinix-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46730/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46731/
Example
FATAL: Channel "hudson.remoting.Channel@6008869b:JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838": Remote call on JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838 failed. The channel is closing down or has closed down
java.nio.channels.ClosedChannelException
	at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:155)
	at org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:143)
	at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:789)
	at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#44744, https://github.com/nodejs-private/node-private/pull/348/)
Appeared test-packetnet-ubuntu1804-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46697/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46710/
Example
Failed to trigger node-test-commit

undefined

Reason Unknown
Type undefined
Failed PR 6 (nodejs/node#44739, nodejs/node#44758, nodejs/node#44779, nodejs/node#44741, nodejs/node#44763, nodejs/node#44696)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/46738/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46785/
Example
Unknown

Progress

  • sequential/test-cpu-prof-drained (5)
  • parallel/test-worker-heap-snapshot (3)
  • sequential/test-cpu-prof-dir-relative (3)
  • sequential/test-watch-mode-inspect (3)
  • parallel/test-crypto-key-objects (2)
  • parallel/test-http2-misbehaving-multiplex (2)
  • sequential/test-perf-hooks (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (3)
  • Build timed out (after 60 minutes). Marking the build as failed. (2)
  • ERROR: Error fetching remote repo 'jenkins_tmp' (10)
  • FATAL: Connection timed out (25)
  • error: remote GitHub already exists. (6)
  • Error: socket hang up (5)
  • ERROR: Step �Publish JUnit test result report� failed: No test report files were found. Configuration error? (4)
  • error: The last gc run reported the following. Please correct the root cause (4)
  • FATAL: Channel "hudson.remoting.Channel@6008869b:JNLP4-connect connection from ... Remote call on JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838 failed. The channel is closing down or has closed down (2)
  • Failed to trigger node-test-commit (2)
  • Unknown (6)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

0 participants