Assertion failed: (!uv__io_active(&stream->io_watcher, UV__POLLOUT

[DominicBoettger]

Assertion failed: (!uv__io_active(&stream->io_watcher, UV__POLLOUT) || !ngx_queue_empty(&stream->write_completed_queue) || !ngx_queue_empty(&stream->write_queue) || stream->shutdown_req != NULL || stream->connect_req != NULL), function uv_read_stop, file

Since upgrading to node > 0.10.5 I get this error. Could be possible that it comes from redis library, but i am not sure.

Any ideas?

Regards
Dominic

[bnoordhuis]

Try this:

gdb --args node script.js
> run
# wait until you hit the assert
> backtrace full

Please post the backtrace here.

[DominicBoettger]

Assertion failed: (!uv__io_active(&stream->io_watcher, UV__POLLOUT) || !ngx_queue_empty(&stream->write_completed_queue) || !ngx_queue_empty(&stream->write_queue) || stream->shutdown_req != NULL || stream->connect_req != NULL), function uv_read_stop, file ../deps/uv/src/unix/stream.c, line 1329.

Program received signal SIGABRT, Aborted.
0x00007fff8fe65212 in __pthread_kill ()
(gdb) backtrace full
#0  0x00007fff8fe65212 in __pthread_kill ()
No symbol table info available.
#1  0x00007fff90125b54 in pthread_kill ()
No symbol table info available.
#2  0x00007fff90169dce in abort ()
No symbol table info available.
#3  0x00007fff9016ae2a in __assert_rtn ()
No symbol table info available.
#4  0x000000010012a64d in uv_read_stop ()
No symbol table info available.
#5  0x000000010012a6d9 in uv__stream_close ()
No symbol table info available.
#6  0x0000000100125193 in uv_close ()
No symbol table info available.
#7  0x0000000100005b5b in node::HandleWrap::Close ()
No symbol table info available.
#8  0x0000000100170718 in v8::internal::Builtin_HandleApiCall ()
No symbol table info available.
#9  0x00002c8634906362 in ?? ()
No symbol table info available.
#10 0x00002c863575551f in ?? ()
No symbol table info available.
#11 0x00002c863490ccce in ?? ()
No symbol table info available.
#12 0x00002c86357550a1 in ?? ()
No symbol table info available.
#13 0x00002c863490ccce in ?? ()
No symbol table info available.
#14 0x00002c8635754e3f in ?? ()
No symbol table info available.
#15 0x00002c8634f7603d in ?? ()
No symbol table info available.
#16 0x00002c8635754af9 in ?? ()
No symbol table info available.
#17 0x00002c8635751c61 in ?? ()
No symbol table info available.
#18 0x00002c8634e93b9e in ?? ()
No symbol table info available.
#19 0x00002c863579ff1a in ?? ()
No symbol table info available.
#20 0x00002c863490ccce in ?? ()
No symbol table info available.
#21 0x00002c86355b3c11 in ?? ()
No symbol table info available.
#22 0x00002c863490d507 in ?? ()
No symbol table info available.
#23 0x00002c8634906116 in ?? ()
No symbol table info available.
#24 0x000000010019ff38 in v8::internal::Invoke ()
No symbol table info available.
#25 0x0000000100150e14 in v8::Function::Call ()
No symbol table info available.
#26 0x0000000100009a75 in node::MakeCallback ()
No symbol table info available.
#27 0x000000010000a533 in node::MakeCallback ()
No symbol table info available.
#28 0x000000010001e98e in node::StreamWrap::AfterWrite ()
No symbol table info available.
#29 0x000000010012c640 in uv__stream_io ()
No symbol table info available.
#30 0x0000000100131173 in uv__io_poll ()
No symbol table info available.
#31 0x0000000100124f59 in uv_run ()
No symbol table info available.
#32 0x0000000100009e3f in node::Start ()
No symbol table info available.
#33 0x0000000100001a74 in start ()
No symbol table info available.

[bnoordhuis]

Thanks. The backtrace suggests you're on OS X. What version of node is it? If it's not v0.10.9, please upgrade first.

It doesn't seem related to redis, there are only node.js and v8 frames on the stack. If you have some kind of reduced test case (no dependencies on non-core modules), that would be great.

Failing that, can you try inspecting the uv_read_stop stack frame? Here's how:

> set print pretty
> set pagination off
> frame 4  # or wherever uv_read_stop() is
> print *(uv_stream_t*) handle

If it's complaining that handle is optimized away, try the uv__stream_close frame.

[DominicBoettger]

(gdb) set print pretty
(gdb) set pagination off
(gdb) frame 4
#4  0x000000010012a64d in uv_read_stop ()
(gdb) print *(uv_stream_t*) handle
No symbol "uv_stream_t" in current context.
(gdb) frame 5
#5  0x000000010012a6d9 in uv__stream_close ()
(gdb) print *(uv_stream_t*) handle
No symbol "uv_stream_t" in current context.

Am i doing something wrong?

[bnoordhuis]

No, it's pretty common with optimized builds. The compiler has optimized away the function argument. Can you try it with a debug build? make -j8 BUILDTYPE=Debug will build one.

[jonathanong]

Got the same thing on Mac OS X 10.8.3 using node v0.10.8-9. v0.10.7 works fine. Followed the steps above if that helps at all:

Assertion failed: (!uv__io_active(&stream->io_watcher, UV__POLLOUT) || !ngx_queue_empty(&stream->write_completed_queue) || !ngx_queue_empty(&stream->write_queue) || stream->shutdown_req != NULL || stream->connect_req != NULL), function uv_read_stop, file ../deps/uv/src/unix/stream.c, line 1329.

Program received signal SIGABRT, Aborted.
0x00007fff89f98212 in __pthread_kill ()
(gdb) backtrace full
#0  0x00007fff89f98212 in __pthread_kill ()
No symbol table info available.
#1  0x00007fff88048b54 in pthread_kill ()
No symbol table info available.
#2  0x00007fff8808cdce in abort ()
No symbol table info available.
#3  0x00007fff8808de2a in __assert_rtn ()
No symbol table info available.
#4  0x000000010012a64d in uv_read_stop ()
No symbol table info available.
#5  0x000000010012a6d9 in uv__stream_close ()
No symbol table info available.
#6  0x0000000100125193 in uv_close ()
No symbol table info available.
#7  0x0000000100005b5b in node::HandleWrap::Close ()
No symbol table info available.
#8  0x0000000100170718 in v8::internal::Builtin_HandleApiCall ()
No symbol table info available.
#9  0x00002bf3f4206362 in ?? ()
No symbol table info available.
#10 0x00002bf3f456c65f in ?? ()
No symbol table info available.
#11 0x00002bf3f420ccce in ?? ()
No symbol table info available.
#12 0x00002bf3f456c1e1 in ?? ()
No symbol table info available.
#13 0x00002bf3f420ccce in ?? ()
No symbol table info available.
#14 0x00002bf3f49b681f in ?? ()
No symbol table info available.
#15 0x00002bf3f47b54bd in ?? ()
No symbol table info available.
#16 0x00002bf3f49b6439 in ?? ()
No symbol table info available.
#17 0x00002bf3f48e375c in ?? ()
No symbol table info available.
#18 0x00002bf3f4949a96 in ?? ()
No symbol table info available.
#19 0x00002bf3f46ce91a in ?? ()
No symbol table info available.
#20 0x00002bf3f420ccce in ?? ()
No symbol table info available.
#21 0x00002bf3f4567411 in ?? ()
No symbol table info available.
#22 0x00002bf3f420d507 in ?? ()
No symbol table info available.
#23 0x00002bf3f4206116 in ?? ()
No symbol table info available.
#24 0x000000010019ff38 in v8::internal::Invoke ()
No symbol table info available.
#25 0x0000000100150e14 in v8::Function::Call ()
No symbol table info available.
#26 0x0000000100009a75 in node::MakeCallback ()
No symbol table info available.
#27 0x000000010000a533 in node::MakeCallback ()
No symbol table info available.
#28 0x000000010001e98e in node::StreamWrap::AfterWrite ()
No symbol table info available.
#29 0x000000010012c640 in uv__stream_io ()
No symbol table info available.
#30 0x0000000100131173 in uv__io_poll ()
No symbol table info available.
#31 0x0000000100124f59 in uv_run ()
No symbol table info available.
#32 0x0000000100009e3f in node::Start ()
No symbol table info available.
#33 0x0000000100001a74 in start ()
No symbol table info available.
(gdb) set print pretty
(gdb) set pagination off 
(gdb) frame 4
#4  0x000000010012a64d in uv_read_stop ()
(gdb) print *(uv_stream_t*) handle
No symbol "uv_stream_t" in current context.

I think it's a https://github.com/LearnBoost/knox issue with client.putBuffer(), but I'm not 100% sure yet.

[jonathanong]

@bnoordhuis i have a test case. it doesn't use any other node modules, but it requires imagemagick:

var fs = require('fs')
var spawn = require('child_process').spawn

var proc = spawn('identify', ['-'])
proc.stdout.on('data', onData)
proc.stderr.on('data', onData)
fs.createReadStream(__dirname + '/png.png').pipe(proc.stdin)

function onData(chunk) {
  console.log(chunk.toString())
}

OS: Mac OS X 10.8.3
ImageMagick: 6.8.0-10 installed via brew

this happens with any image I throw at it.

let me know if you need any more details.

[bnoordhuis]

Confirmed, thanks. Seems to be an OS X issue, node.js on Linux is not affected.

[bnoordhuis]

Fixed in joyent/libuv@8e4b248.

[jonathanong]

i just hit this bug on heroku running 0.10.10. i don't know what stack they're running, but i'm pretty sure it's not OS X. hopefully 0.10.11 fixes it.

[bnoordhuis]

I've removed the assert from the v0.10 branch in 3ab3543 because I'm not 100% sure it always catches legitimate bugs. To be revisited in the master branch.