Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI failures: 20180918 #16

Closed
joyeecheung opened this issue Sep 18, 2018 · 4 comments
Closed

CI failures: 20180918 #16

joyeecheung opened this issue Sep 18, 2018 · 4 comments

Comments

@joyeecheung
Copy link
Member

Failures in node-test-pull-request/17202 to node-test-pull-request/17294 that failed more than 2 PRs

Jenkins Failure

Reason java.io.IOException: Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 3 (nodejs/node#22890, nodejs/node#22903, nodejs/node#22418)
Appeared test-digitalocean-freebsd11-x64-2, test-softlayer-ubuntu1804_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/17237/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17294/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:59136' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283)
	at com.sun.proxy.$Proxy85.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1137)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1129)

Build Failure

Reason ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run?
Type BUILD_FAILURE
Failed PR 5 (nodejs/node#22418, nodejs/node#22902, nodejs/node#22861, nodejs/node#22660, nodejs/node#22903)
Appeared test-requireio_williamkapke-debian9-arm64_pi3-1, test-requireio_piccoloaiutante-debian9-arm64_pi3-1, test-requireio_williamkapke-debian9-arm64_pi3-2, test-requireio_continuationlabs-debian9-armv6l_pi1p-1, test-requireio_pivotalagency-debian9-arm64_pi3-1, test-requireio_davglass-debian9-arm64_pi3-1, test-requireio_securogroup-debian9-arm64_pi3-2, test-requireio_kahwee-debian9-arm64_pi3-1, test-requireio_williamkapke-debian9-arm64_pi3-3, test-requireio_pivotalagency-debian9-arm64_pi3-2, test-requireio_securogroup-debian9-armv6l_pi1p-2, test-requireio_notthetup_sayanee-debian9-arm64_pi3-1, test-requireio_securogroup-debian9-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17270/
Example
ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run? 
For example, /home/iojs/build/workspace/node-test-binary-arm/out/junit/test.xml is 7 hr 53 min old

Notifying upstream projects of job completion
Finished: FAILURE

Reason There is not enough space in the file system.
Type BUILD_FAILURE
Failed PR 5 (nodejs/node#22846, nodejs/node#21846, nodejs/node#22740, nodejs/node#22239, nodejs/node#20713)
Appeared test-osuosl-aix61-ppc64_be-2
First CI https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17216/
Example
There is not enough space in the file system.
Assembler:
/tmp//cct4lCKe.s: line 1844736: 1252-161 A system problem occurred while processing file /tmp/asqMDMaa
as: There is not enough space in the file system.
Assembler:
/tmp//ccsG2kv1.s: line 122: 1252-161 A system problem occurred while processing file /tmp/asaMFMaa

Reason sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory
Type BUILD_FAILURE
Failed PR 5 (nodejs/node#22418, nodejs/node#22902, nodejs/node#22861, nodejs/node#22660, nodejs/node#22903)
Appeared test-requireio_ceejbot-debian9-armv6l_pi1p-1, test-requireio_louiscntr-debian9-armv7l_pi2-1, test-requireio_mininodes-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-3, test-requireio_davglass-debian9-armv6l_pi1p-1, test-requireio_mininodes-debian9-armv7l_pi2-1, test-requireio_bengl-debian9-armv6l_pi1p-1, test-requireio_ceejbot-debian9-armv7l_pi2-1, test-requireio_sambthompson-debian9-armv7l_pi2-1, test-requireio_securogroup-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-1, test-requireio_mcollina-debian9-armv7l_pi2-1, test-requireio_rvagg-debian9-armv7l_pi2-1, test-requireio_mhdawson-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-2, test-requireio_andineck-debian9-armv6l_pi1p-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-1, test-requireio_jasnell-debian9-armv7l_pi2-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-2, test-requireio_chrislea-debian9-armv6l_pi1p-1, test-requireio_bengl-debian9-armv6l_pi1p-2, test-requireio_indieisaconcept-debian9-armv6l_pi1p-1, test-requireio_continuationlabs-debian9-armv6l_pi1p-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17270/
Example
sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory

Reason Error: 'NoneType' object has no attribute 'getitem'
Type BUILD_FAILURE
Failed PR 3 (nodejs/node#22418, nodejs/node#22858, nodejs/node#22788)
Appeared test-softlayer-ubuntu1404-x86-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17283/
Example
Error: 'NoneType' object has no attribute '__getitem__'
POST BUILD TASK : FAILURE
END OF POST BUILD TASK : 0
Recording test results
Recording fingerprints
Notifying upstream projects of job completion

Reason error: pathspec ... did not match any file(s) known to git.
Type BUILD_FAILURE
Failed PR 3 (nodejs/node#22880, nodejs/node#22418, nodejs/node#22914)
Appeared test-azure_msft-win10-x64-1, test-azure_msft-win10-x64-4, test-azure_msft-win10-x64-2, test-azure_msft-win10-x64-3, test-rackspace-win2008r2-x64-6, test-azure_msft-win2016-x64-5, test-azure_msft-win2016-x64-2, test-azure_msft-win2016-x64-4, test-azure_msft-win2016-x64-3, test-rackspace-win2012r2-x64-4, test-rackspace-win2012r2-x64-5, test-rackspace-win2012r2-x64-3, test-rackspace-win2012r2-x64-1, test-rackspace-win2008r2-x64-2, test-rackspace-win2008r2-x64-1, test-azure_msft-win2008r2-x64-1, test-azure_msft-win2008r2-x64-2, test-rackspace-win2012r2-x64-9, test-rackspace-win2012r2-x64-2, test-rackspace-win2012r2-x64-7, test-azure_msft-win2012r2-x64-1, test-rackspace-win2012r2-x64-8, test-azure_msft-win2012r2-x64-2, test-rackspace-win2012r2-x64-6, test-azure_msft-win2012r2-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/17218/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17293/
Example
error: pathspec 'refs/remotes/jenkins_tmp/jenkins-node-test-commit-windows-fanned-20827-bin-win-vs2017' did not match any file(s) known to git.

c:\workspace\node-test-binary-windows>if 1 NEQ 0 exit /b 1 
Build step 'Execute Windows batch command' marked build as failure
Run condition [Always] enabling perform for step [[Execute Windows batch command, Execute shell]]
[node-test-binary-windows] $ cmd /c call C:\Users\ADMINI~1\AppData\Local\Temp\jenkins375521525818467789.bat

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#22754, nodejs/node#22920)
Appeared test-digitalocean-freebsd11-x64-2, test-joyent-smartos16-x64-1, test-joyent-smartos17-x64-2, test-joyent-smartos16-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/17231/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17273/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Notifying upstream projects of job completion
Finished: FAILURE

Reason fatal: Could not read from remote repository.
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#22878, nodejs/node#22550)
Appeared test-azure_msft-win2016-x64-4, test-azure_msft-win10-x64-1, test-azure_msft-win2016-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/17207/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17211/
Example
fatal: Could not read from remote repository.

JSTest Failure

Reason parallel/test-heapdump-worker
Type JS_TEST_FAILURE
Failed PR 7 (nodejs/node#22846, nodejs/node#22911, nodejs/node#22797, nodejs/node#22868, nodejs/node#22932, nodejs/node#22861, nodejs/node#22218)
Appeared test-azure_msft-win2016-x64-4, test-azure_msft-win2016-x64-2, test-digitalocean-ubuntu1604_sharedlibs_container-x64-6, test-joyent-ubuntu1604_sharedlibs_container-x64-3, test-digitalocean-ubuntu1604_sharedlibs_container-x64-10, test-digitalocean-ubuntu1604_sharedlibs_container-x64-1, test-digitalocean-alpine37_container-x64-2, test-softlayer-centos6-x64-1, test-rackspace-centos7-x64-1, test-rackspace-fedora27-x64-1, test-softlayer-ubuntu1404-x64-1, test-rackspace-ubuntu1604-x64-1, test-joyent-ubuntu1710-x64-1, test-digitalocean-ubuntu1804_container-x64-2, test-macstadium-macos10.11-x64-2, test-osuosl-ubuntu1404-ppc64_le-1, test-joyent-smartos16-x64-1, test-joyent-smartos17-x64-2, test-scaleway-ubuntu1604-armv7l-1, test-packetnet-ubuntu1604-arm64-2, test-requireio_indieisaconcept-debian9-armv6l_pi1p-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-1, test-requireio_pivotalagency-debian9-arm64_pi3-2, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17290/
Example
not ok 187 parallel/test-heapdump-worker
  ---
  duration_ms: 2.562
  severity: fail
  exitcode: 134
  stack: |-
    npm[7204]: src\inspector_agent.cc:729: Assertion `(client_) != nullptr' failed.
     1: 00007FF7D0FB0B05 
     2: 00007FF7D0F8A0E6 
     3: 00007FF7D0F8A1B1 
     4: 00007FF7D0E9B476 
     5: 00007FF7D0EEEA9C 
     6: 00007FF7D0FE9AE4 
     7: 00007FF7D1A43080 
     8: 00007FF8A2648364 
     9: 00007FF8A3EDE851 
  ...


Reason parallel/test-zlib-convenience-methods
Type JS_TEST_FAILURE
Failed PR 6 (nodejs/node#22846, nodejs/node#22331, nodejs/node#22904, nodejs/node#22660, nodejs/node#22927, nodejs/node#22932)
Appeared test-softlayer-ubuntu1404-x86-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17285/
Example
not ok 2030 parallel/test-zlib-convenience-methods
  ---
  duration_ms: 0.282
  severity: crashed
  exitcode: -6
  stack: |-
    *** Error in `out/Release/node': double free or corruption (!prev): 0x0d3f3800 ***
  ...


Reason parallel/test-http2-pipe
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#22858, nodejs/node#22914, nodejs/node#22932)
Appeared test-rackspace-win2008r2-x64-6, test-rackspace-win2008r2-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/17238/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17285/
Example
not ok 270 parallel/test-http2-pipe
  ---
  duration_ms: 0.321
  severity: fail
  exitcode: 1
  stack: |-
    events.js:167
          throw er; // Unhandled 'error' event
          ^
    
    Error: read ECONNRESET
        at TCP.onStreamRead (internal/stream_base_commons.js:111:27)
    Emitted 'error' event at:
        at emitErrorNT (internal/streams/destroy.js:82:8)
        at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
        at process._tickCallback (internal/process/next_tick.js:63:19)
  ...


Reason addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#22880, nodejs/node#22888)
Appeared test-requireio-osx1010-x64-1, test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/17208/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17221/
Example
not ok 1905 addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary
  ---
  duration_ms: 120.707
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-worker-syntax-error
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#22843, nodejs/node#22239)
Appeared test-azure_msft-win10-x64-3, test-rackspace-win2012r2-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17202/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17215/
Example
not ok 521 parallel/test-worker-syntax-error
  ---
  duration_ms: 0.195
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
        at Object.mustCall (c:\workspace\node-test-binary-windows\test\common\index.js:310:10)
        at Object.<anonymous> (c:\workspace\node-test-binary-windows\test\parallel\test-worker-syntax-error.js:12:24)
        at Module._compile (internal/modules/cjs/loader.js:693:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:704:10)
        at Module.load (internal/modules/cjs/loader.js:603:32)
        at tryModuleLoad (internal/modules/cjs/loader.js:542:12)
        at Function.Module._load (internal/modules/cjs/loader.js:534:3)
        at Function.Module.runMain (internal/modules/cjs/loader.js:746:12)
        at startup (internal/bootstrap/node.js:270:19)
  ...


Git Failure

Reason warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87
Type GIT_FAILURE
Failed PR 16 (nodejs/node#22239, nodejs/node#22888, nodejs/node#22788, nodejs/node#22331, nodejs/node#22845, nodejs/node#22754, nodejs/node#22898, nodejs/node#22861, nodejs/node#22902, nodejs/node#22418, nodejs/node#22890, nodejs/node#22858, nodejs/node#22834, nodejs/node#22903, nodejs/node#21846, nodejs/node#22900)
Appeared test-requireio_continuationlabs-debian9-armv6l_pi1p-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17215/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17251/
Example
warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87
@joyeecheung
Copy link
Member Author

joyeecheung commented Sep 18, 2018

Progress

  • addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary

In progress

  • java.io.IOException: Backing channel 'JNLP4-connect connection from ... is disconnected.
    • I've marked test-softlayer-ubuntu1804_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-1 and test-softlayer-ubuntu1604_sharedlibs_container-x64-5 offline. These are all docker containers running on test-softlayer-ubuntu1604_docker-x64-1
  • Fanned jobs not resuming properly: Keeping old binaries to allow resuming fanned jobs build#1496
    • ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run?
    • sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory:
    • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
    • error: pathspec ... did not match any file(s) known to git.
    • fatal: Could not read from remote repository.

Fixed

@refack
Copy link

refack commented Sep 18, 2018

  • There is not enough space in the file system.
    test-osuosl-aix61-ppc64_be-2
    fixed

    • ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them
    • sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory
    • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?

    This just means tests didn't run. From what I've seen it's resumes of *-fanned.
    Keeping old binaries to allow resuming fanned jobs build#1496 is a WIP
    The real signature is 15:19:08 fatal: Couldn't find remote ref refs/heads/jenkins-node-test-commit-arm-fanned-3558-binary-pi1p/cc-armv6

  • Fails in parallel/test-zlib-convenience-methods
    on test-softlayer-ubuntu1404-x86-1
    Stopped testing node >= v10 on x86 platforms ci: no ubuntu1?04-32 since node 10 build#1498

@joaocgreis
Copy link
Member

The fatal: Could not read from remote repository. should be fixed. I have a PR on the slow simmer with temp repo updates, but this part is already there.

refack pushed a commit to JaneaSystems/node that referenced this issue Sep 19, 2018
Refs: nodejs#20750
Refs: nodejs#22327
Refs: nodejs#22762
Refs: nodejs/reliability#16

PR-URL: nodejs#22941
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: Ruben Bridgewater <[email protected]>
Reviewed-By: Anna Henningsen <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Refael Ackermann <[email protected]>
@refack
Copy link

refack commented Sep 19, 2018

nodejs/node#22941 landed marking 4 windows flaky test

targos pushed a commit to nodejs/node that referenced this issue Sep 20, 2018
Refs: #20750
Refs: #22327
Refs: #22762
Refs: nodejs/reliability#16

PR-URL: #22941
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: Ruben Bridgewater <[email protected]>
Reviewed-By: Anna Henningsen <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Refael Ackermann <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants