GapInStream(memcache) exception.

[dkvk]

For confirmed bugs, please report:

• Version: packetbeat version 1.1.1 (amd64)
• Operating System: Ubuntu
• Steps to Reproduce: I believe the issue is due to the high volume of packets that memcache is producing. Commenting out and disable the memcached protocol makes the issue dissapears.

Mar 15 23:41:48 vps-53498 /usr/bin/packetbeat[4313]: log.go:113: GapInStream(memcache) exception. Recovering, but please report this: runtime error: invalid memory address or nil pointer dereference.
Mar 15 23:41:48 vps-53498 /usr/bin/packetbeat[4313]: log.go:114: Stacktrace: /go/src/github.com/elastic/beats/libbeat/logp/log.go:114 (0x4aa716)#012/usr/local/go/src/runtime/asm_amd64.s:437 (0x4621ee)#012/usr/local/go/src/runtime/panic.go:423 (0x4307c9)#012/usr/local/go/src/runtime/panic.go:42 (0x42ee89)#012/usr/local/go/src/runtime/sigpanic_unix.go:24 (0x44589a)#012/go/src/github.com/elastic/beats/packetbeat/protos/memcache/plugin_tcp.go:335 (0x4de83d)#012/go/src/github.com/elastic/beats/packetbeat/protos/tcp/tcp.go:112 (0x51172d)#012/go/src/github.com/elastic/beats/packetbeat/protos/tcp/tcp.go:148 (0x511f3c)#012/go/src/github.com/elastic/beats/packetbeat/decoder/decoder.go:183 (0x6f80a7)#012/go/src/github.com/elastic/beats/packetbeat/decoder/decoder.go:101 (0x6f75e1)#012/go/src/github.com/elastic/beats/packetbeat/sniffer/sniffer.go:356 (0x526299)#012/go/src/github.com/elastic/beats/packetbeat/beat/packetbeat.go:232 (0x4676fb)#012/usr/local/go/src/runtime/asm_amd64.s:1721 (0x464561)

[urso]

Thanks for reporting. Indeed, this one is triggered by packet loss.

In general the error is not 'that critical' in a sense it does not break processing. GapInStream will check if the current buffered message can still be processed somehow (even on packet loss), but drops the TCP connection afterwards. Generating the panic enforces the TCP connection being dropped.

[serialdoom]

i can see that with the latest (packetbeat version 1.2.0 (amd64)) as well

Mar 31 13:29:15 d031-uk /usr/bin/packetbeat[32523]: log.go:114: Stacktrace: /go/src/github.com/elastic/beats/libbeat/logp/log.go:114 (0x4c5a66)#012/usr/local/go/src/runtime/asm_amd64.s:437 (0x47c88e)#012/usr/local/go/src/runtime/panic.go:423 (0x44b119)#012/usr/local/go/src/runtime/panic.go:42 (0x4497d9)#012/usr/local/go/src/runtime/sigpanic_unix.go:24 (0x46024a)#012/go/src/github.com/elastic/beats/packetbeat/protos/memcache/plugin_tcp.go:335 (0x4f9b7d)#012/go/src/github.com/elastic/beats/packetbeat/protos/tcp/tcp.go:112 (0x52cc6d)#012/go/src/github.com/elastic/beats/packetbeat/protos/tcp/tcp.go:148 (0x52d47c)#012/go/src/github.com/elastic/beats/packetbeat/decoder/decoder.go:183 (0x713787)#012/go/src/github.com/elastic/beats/packetbeat/decoder/decoder.go:101 (0x712cc1)#012/go/src/github.com/elastic/beats/packetbeat/sniffer/sniffer.go:356 (0x5417c9)#012/go/src/github.com/elastic/beats/packetbeat/beat/packetbeat.go:232 (0x481d4b)#012/usr/local/go/src/runtime/asm_amd64.s:1696 (0x47ebd1)

[dfr0]

I've the same problem but in my case this errors collapsed the space on my machines, saturates the system logs.

[dfr0]

I've the packetbeat version 1.2.3 on ubuntu server