manticore 3.4.2 crash #365

tomindo · 2020-07-03T00:49:08Z

Hi,
The manticore ran pretty well until it crashed today. Here is the crash dump from the log:
------- FATAL: CRASH DUMP -------
[Thu Jul 2 12:02:10.503 2020] [37678]

--- crashed invalid query ---

--- request dump end ---
--- local index:
Manticore 3.4.2 6903305@200410 release
Handling signal 11
-------------- backtrace begins here ---------------
Program compiled with 4.8.5
Configured with flags: Configured by CMake with these definitions: -DCMAKE_BUILD_TYPE=RelWithDebInfo -DDISTR_BUILD=rhel7 -DUSE_SSL=ON -DDL_UNIXODBC=1 -DUNIXODBC_LIB=libodbc.so.2 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DUSE_LIBICONV=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DDL_PGSQL=1 -DPGSQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/data -DFULL_SHARE_DIR=/usr/share/manticore -DUSE_ICU=1 -DUSE_BISON=ON -DUSE_FLEX=ON -DUSE_SYSLOG=1 -DWITH_EXPAT=1 -DWITH_ICONV=ON -DWITH_MYSQL=1 -DWITH_ODBC=ON -DWITH_PGSQL=1 -DWITH_RE2=1 -DWITH_STEMMER=1 -DWITH_ZLIB=ON -DGALERA_SOVERSION=31 -DSYSCONFDIR=/etc/manticoresearch
Host OS is Linux runner-ed2dce3a-project-3858465-concurrent-0 4.19.78-coreos #1 SMP Mon Oct 14 22:56:39 -00 2019 x86_64 x86_64 x86_64 GNU/Linux
Stack bottom = 0x7f9230253d7f, thread stack size = 0x100000
Trying manual backtrace:
Frame pointer is null, manual backtrace failed (did you build with -fomit-frame-pointer?)
Trying system backtrace:
begin of system symbols:
/usr/bin/searchd(_Z12sphBacktraceib 0x90)[0x710e50]
/usr/bin/searchd(_ZN16SphCrashLogger_c11HandleCrashEi 0x1fe)[0x58409e]
/lib64/libpthread.so.0( 0xf5f0)[0x7f937dac35f0]
/usr/bin/searchd[0x85a41f]
/usr/bin/searchd(_ZN7Threads19CompletionHandler_cISt8functionIFvvEEE10DoCompleteEPvPNS_20SchedulerOperation_tE 0x4d)[0x90430d]
/usr/bin/searchd(_ZNSt17_Function_handlerIFvvEZN7Threads12ThreadPool_c6Impl_tC1EmPKcEUlvE_E9_M_invokeERKSt9_Any_data 0x17a)[0x903ffa]
/usr/bin/searchd[0x902ff8]
/usr/bin/searchd(_Z20sphThreadProcWrapperPv 0x23)[0x7149d3]
/lib64/libpthread.so.0( 0x7e65)[0x7f937dabbe65]
/lib64/libc.so.6(clone 0x6d)[0x7f937c2d288d]
-------------- backtrace ends here ---------------
Please, create a bug report in our bug tracker (https://github.com/manticoresoftware/manticore/issues)
and attach there:
a) searchd log, b) searchd binary, c) searchd symbols.
Look into the chapter 'Reporting bugs' in the documentation
(http://docs.manticoresearch.com/latest/html/reporting_bugs.html)
Dump with GDB via watchdog
[Thu Jul 2 12:02:10.918 2020] [37677] watchdog: got USR1, performing dump of child's stack
Will run gdb on '/usr/bin/searchd', pid '37678'
--- 1362 active threads ---
thd 0, proto sphinxql, state query, command select
thd 1, proto sphinxql, state query, command select
thd 2, proto sphinxql, state query, command select
thd 3, proto sphinxql, state query, command select
thd 4, proto sphinxql, state query, command select
thd 5, proto sphinxql, state query, command select
thd 6, proto sphinxql, state query, command select
thd 7, proto sphinxql, state query, command select
thd 8, proto sphinxql, state query, command select
thd 9, proto sphinxql, state query, command select
thd 10, proto sphinxql, state query, command select
thd 11, proto sphinxql, state query, command select
thd 12, proto sphinxql, state query, command select
thd 13, proto sphinxql, state query, command select
thd 14, proto sphinxql, state query, command select
thd 15, proto sphinxql, state query, command select
thd 16, proto sphinxql, state query, command select
thd 17, proto sphinxql, state query, command select
thd 18, proto sphinxql, state query, command select
thd 19, proto sphinxql, state query, command select
thd 20, proto sphinxql, state query, command select
thd 21, proto sphinxql, state query, command select
thd 22, proto sphinxql, state query, command select
thd 23, proto sphinxql, state query, command select
thd 24, proto sphinxql, state query, command select
thd 25, proto sphinxql, state query, command select
thd 26, proto sphinxql, state query, command select
thd 27, proto sphinxql, state query, command select
thd 28, proto sphinxql, state query, command select
thd 29, proto sphinxql, state query, command select
thd 30, proto sphinxql, state query, command select
thd 31, proto sphinxql, state query, command select
thd 32, proto sphinxql, state query, command select
thd 33, proto sphinxql, state query, command select
thd 34, proto sphinxql, state query, command select
thd 35, proto sphinxql, state query, command select
thd 36, proto sphinxql, state query, command select
thd 37, proto sphinxql, state query, command select
thd 38, proto sphinxql, state query, command select
thd 39, proto sphinxql, state query, command select
thd 40, proto sphinxql, state query, command select
thd 41, proto sphinxql, state query, command select
thd 42, proto sphinxql, state query, command select
thd 43, proto sphinxql, state query, command select
thd 44, proto sphinxql, state query, command select
thd 45, proto sphinxql, state query, command select
thd 46, proto sphinxql, state query, command select
thd 47, proto sphinxql, state query, command select
thd 48, proto sphinxql, state query, command select
thd 49, proto sphinxql, state query, command select
thd 50, proto sphinxql, state query, command select
thd 51, proto sphinxql, state query, command select
thd 52, proto sphinxql, state query, command select
thd 53, proto sphinxql, state query, command select
thd 54, proto sphinxql, state query, command select
thd 55, proto sphinxql, state query, command select
thd 56, proto sphinxql, state query, command select
thd 57, proto sphinxql, state query, command select
thd 58, proto sphinxql, state query, command select
thd 59, proto sphinxql, state query, command select
thd 60, proto sphinxql, state query, command select
thd 61, proto sphinxql, state query, command select
thd 62, proto sphinxql, state query, command select
thd 63, proto sphinxql, state query, command select
thd 64, proto sphinxql, state query, command select
thd 65, proto sphinxql, state query, command select
thd 66, proto sphinxql, state query, command select
thd 67, proto sphinxql, state query, command select
thd 68, proto sphinxql, state query, command select
thd 69, proto sphinxql, state query, command select
thd 70, proto sphinxql, state query, command select
thd 71, proto sphinxql, state query, command select
thd 72, proto sphinxql, state query, command select
thd 73, proto sphinxql, state query, command select
thd 74, proto sphinxql, state query, command select
thd 75, proto sphinxql, state query, command select
thd 76, proto sphinxql, state query, command select
thd 77, proto sphinxql, state query, command select
thd 78, proto sphinxql, state query, command select
thd 79, proto sphinxql, state query, command select
thd 80, proto sphinxql, state query, command select
thd 81, proto sphinxql, state query, command select
thd 82, proto sphinxql, state query, command select
thd 83, proto sphinxql, state query, command select
thd 84, proto sphinxql, state query, command select
thd 85, proto sphinxql, state query, command select
thd 86, proto sphinxql, state query, command select
thd 87, proto sphinxql, state query, command select
thd 88, proto sphinxql, state query, command select
thd 89, proto sphinxql, state query, command select
thd 90, proto sphinxql, state query, command select
thd 91, proto sphinxql, state query, command select
thd 92, proto sphinxql, state query, command select
thd 93, proto sphinxql, state query, command select
thd 94, proto sphinxql, state query, command select
thd 95, proto sphinxql, state query, command select
thd 96, proto sphinxql, state query, command select
thd 97, proto sphinxql, state query, command select
thd 98, proto sphinxql, state query, command select
thd 99, proto sphinxql, state query, command select
thd 100, proto sphinxql, state query, command select
thd 101, proto sphinxql, state query, command select
thd 102, proto sphinxql, state query, command select
thd 103, proto sphinxql, state query, command select
thd 104, proto sphinxql, state query, command select
thd 105, proto sphinxql, state query, command select
thd 106, proto sphinxql, state query, command select
thd 107, proto sphinxql, state query, command select
thd 108, proto sphinxql, state query, command select
thd 109, proto sphinxql, state query, command select
thd 110, proto sphinxql, state query, command select
thd 111, proto sphinxql, state query, command select
thd 112, proto sphinxql, state query, command select
thd 113, proto sphinxql, state query, command select
thd 114, proto sphinxql, state query, command select
thd 115, proto sphinxql, state query, command select
thd 116, proto sphinxql, state query, command select
thd 117, proto sphinxql, state query, command select
thd 118, proto sphinxql, state query, command select
thd 119, proto sphinxql, state query, command select
thd 120, proto sphinxql, state query, command select
thd 121, proto sphinxql, state query, command select
thd 122, proto sphinxql, state query, command select
thd 123, proto sphinxql, state query, command select
thd 124, proto sphinxql, state query, command select
thd 125, proto sphinxql, state query, command select
thd 126, proto sphinxql, state query, command select
thd 127, proto sphinxql, state query, command select
thd 128, proto sphinxql, state query, command select
thd 129, proto sphinxql, state query, command select
thd 130, proto sphinxql, state query, command select
thd 131, proto sphinxql, state query, command select
thd 132, proto sphinxql, state query, command select
thd 133, proto sphinxql, state query, command select
thd 134, proto sphinxql, state query, command select
thd 135, proto sphinxql, state query, command select
thd 136, proto sphinxql, state query, command select
thd 137, proto sphinxql, state query, command select
thd 138, proto sphinxql, state query, command select
thd 139, proto sphinxql, state query, command select
thd 140, proto sphinxql, state query, command select
thd 141, proto sphinxql, state query, command select
thd 142, proto sphinxql, state query, command select
thd 143, proto sphinxql, state query, command select
thd 144, proto sphinxql, state query, command select
thd 145, proto sphinxql, state query, command select
thd 146, proto sphinxql, state query, command select
thd 147, proto sphinxql, state query, command select
thd 148, proto sphinxql, state query, command select
thd 149, proto sphinxql, state query, command select
thd 150, proto sphinxql, state query, command select
thd 151, proto sphinxql, state query, command select
thd 152, proto sphinxql, state query, command select
thd 153, proto sphinxql, state query, command select
thd 154, proto sphinxql, state query, command select
thd 155, proto sphinxql, state query, command select
thd 156, proto sphinxql, state query, command select
thd 157, proto sphinxql, state query, command select
thd 158, proto sphinxql, state query, command select
thd 159, proto sphinxql, state query, command select
thd 160, proto sphinxql, state query, command select
thd 161, proto sphinxql, state query, command select
thd 162, proto sphinxql, state query, command select
thd 163, proto sphinxql, state query, command select
thd 164, proto sphinxql, state query, command select
thd 165, proto sphinxql, state query, command select
thd 166, proto sphinxql, state query, command select
thd 167, proto sphinxql, state query, command select
thd 168, proto sphinxql, state query, command select
thd 169, proto sphinxql, state query, command select
thd 170, proto sphinxql, state query, command select
thd 171, proto sphinxql, state query, command select
thd 172, proto sphinxql, state query, command select
thd 173, proto sphinxql, state query, command select
thd 174, proto sphinxql, state query, command select
thd 175, proto sphinxql, state query, command select
thd 176, proto sphinxql, state query, command select
thd 177, proto sphinxql, state query, command select
thd 178, proto sphinxql, state query, command select
thd 179, proto sphinxql, state query, command select
thd 180, proto sphinxql, state query, command select
thd 181, proto sphinxql, state query, command select
thd 182, proto sphinxql, state query, command select
thd 183, proto sphinxql, state query, command select
thd 184, proto sphinxql, state query, command select
thd 185, proto sphinxql, state query, command select
thd 186, proto sphinxql, state query, command select
thd 187, proto sphinxql, state query, command select
thd 188, proto sphinxql, state query, command select
thd 189, proto sphinxql, state query, command select
thd 190, proto sphinxql, state query, command select
thd 191, proto sphinxql, state query, command select
thd 192, proto sphinxql, state query, command select
thd 193, proto sphinxql, state query, command select
thd 194, proto sphinxql, state query, command select
thd 195, proto sphinxql, state query, command select
thd 196, proto sphinxql, state query, command select
thd 197, proto sphinxql, state query, command select
thd 198, proto sphinxql, state query, command select
thd 199, proto sphinxql, state query, command select
thd 200, proto sphinxql, state query, command select
thd 201, proto sphinxql, state query, command select
thd 202, proto sphinxql, state query, command select
thd 203, proto sphinxql, state query, command select
thd 204, proto sphinxql, state query, command select
thd 205, proto sphinxql, state query, command select
thd 206, proto sphinxql, state query, command select
thd 207, proto sphinxql, state query, command select
thd 208, proto sphinxql, state query, command select
thd 209, proto sphinxql, state query, command select
thd 210, proto sphinxql, state query, command select
thd 211, proto sphinxql, state query, command select
thd 212, proto sphinxql, state query, command select
thd 213, proto sphinxql, state query, command select
thd 214, proto sphinxql, state query, command select
thd 215, proto sphinxql, state query, command select
thd 216, proto sphinxql, state query, command select
thd 217, proto sphinxql, state query, command select
thd 218, proto sphinxql, state query, command select
thd 219, proto sphinxql, state query, command select
thd 220, proto sphinxql, state query, command select
thd 221, proto sphinxql, state query, command select
thd 222, proto sphinxql, state query, command select
thd 223, proto sphinxql, state query, command select
thd 224, proto sphinxql, state query, command select
thd 225, proto sphinxql, state query, command select
thd 226, proto sphinxql, state query, command select
thd 227, proto sphinxql, state query, command select
thd 228, proto sphinxql, state query, command select
thd 229, proto sphinxql, state query, command select
thd 230, proto sphinxql, state query, command select
thd 231, proto sphinxql, state query, command select
thd 232, proto sphinxql, state query, command select
thd 233, proto sphinxql, state query, command select
thd 234, proto sphinxql, state query, command select
thd 235, proto sphinxql, state query, command select
thd 236, proto sphinxql, state query, command select
thd 237, proto sphinxql, state query, command select
thd 238, proto sphinxql, state query, command select
thd 239, proto sphinxql, state query, command select
thd 240, proto sphinxql, state query, command select
thd 241, proto sphinxql, state query, command select
thd 242, proto sphinxql, state query, command select
thd 243, proto sphinxql, state query, command select
thd 244, proto sphinxql, state query, command select
thd 245, proto sphinxql, state query, command select
thd 246, proto sphinxql, state query, command select
thd 247, proto sphinxql, state query, command select
thd 248, proto sphinxql, state query, command select
thd 249, proto sphinxql, state query, command select
thd 250, proto sphinxql, state query, command select
thd 251, proto sphinxql, state query, command select
thd 252, proto sphinxql, state query, command select
thd 253, proto sphinxql, state query, command select
thd 254, proto sphinxql, state query, command select
thd 255, proto sphinxql, state query, command select
thd 256, proto sphinxql, state query, command select
thd 257, proto sphinxql, state query, command select
thd 258, proto sphinxql, state query, command select
thd 259, proto sphinxql, state query, command select
thd 260, proto sphinxql, state query, command select
thd 261, proto sphinxql, state query, command select
thd 262, proto sphinxql, state query, command select
thd 263, proto sphinxql, state query, command select
thd 264, proto sphinxql, state query, command select
thd 265, proto sphinxql, state query, command select
thd 266, proto sphinxql, state query, command select
thd 267, proto sphinxql, state query, command select
thd 268, proto sphinxql, state query, command select
thd 269, proto sphinxql, state query, command select
thd 270, proto sphinxql, state query, command select
thd 271, proto sphinxql, state query, command select
thd 272, proto sphinxql, state query, command select
thd 273, proto sphinxql, state query, command select
thd 274, proto sphinxql, state query, command select
thd 275, proto sphinxql, state query, command select
thd 276, proto sphinxql, state query, command select
thd 277, proto sphinxql, state query, command select
thd 278, proto sphinxql, state query, command select
thd 279, proto sphinxql, state query, command select
thd 280, proto sphinxql, state query, command select
thd 281, proto sphinxql, state query, command select
thd 282, proto sphinxql, state query, command select
thd 283, proto sphinxql, state query, command select
thd 284, proto sphinxql, state query, command select
thd 285, proto sphinxql, state query, command select
thd 286, proto sphinxql, state query, command select
thd 287, proto sphinxql, state query, command select
thd 288, proto sphinxql, state query, command select
thd 289, proto sphinxql, state query, command select
thd 290, proto sphinxql, state query, command select
thd 291, proto sphinxql, state query, command select
thd 292, proto sphinxql, state query, command select
thd 293, proto sphinxql, state query, command select
thd 294, proto sphinxql, state query, command select
thd 295, proto sphinxql, state query, command select
thd 296, proto sphinxql, state query, command select
thd 297, proto sphinxql, state query, command select
thd 298, proto sphinxql, state query, command select
thd 299, proto sphinxql, state query, command select
thd 300, proto sphinxql, state query, command select
thd 301, proto sphinxql, state query, command select
thd 302, proto sphinxql, state query, command select
thd 303, proto sphinxql, state query, command select
thd 304, proto sphinxql, state query, command select
thd 305, proto sphinxql, state query, command select
thd 306, proto sphinxql, state query, command select
thd 307, proto sphinxql, state query, command select
thd 308, proto sphinxql, state query, command select
thd 309, proto sphinxql, state query, command select
thd 310, proto sphinxql, state query, command select
thd 311, proto sphinxql, state query, command select
thd 312, proto sphinxql, state query, command select
thd 313, proto sphinxql, state query, command select
thd 314, proto sphinxql, state query, command select
thd 315, proto sphinxql, state query, command select
thd 316, proto sphinxql, state query, command select
thd 317, proto sphinxql, state query, command select
thd 318, proto sphinxql, state query, command select
thd 319, proto sphinxql, state query, command select
thd 320, proto sphinxql, state query, command select
thd 321, proto sphinxql, state query, command select
thd 322, proto sphinxql, state query, command select
thd 323, proto sphinxql, state query, command select
thd 324, proto sphinxql, state query, command select
thd 325, proto sphinxql, state query, command select
thd 326, proto sphinxql, state query, command select
thd 327, proto sphinxql, state query, command select
thd 328, proto sphinxql, state query, command select
thd 329, proto sphinxql, state query, command select
thd 330, proto sphinxql, state query, command select
thd 331, proto sphinxql, state query, command select
thd 332, proto sphinxql, state query, command select
thd 333, proto sphinxql, state query, command select
thd 334, proto sphinxql, state query, command select
thd 335, proto sphinxql, state query, command select
thd 336, proto sphinxql, state query, command select
thd 337, proto sphinxql, state query, command select
thd 338, proto sphinxql, state query, command select
thd 339, proto sphinxql, state query, command select
thd 340, proto sphinxql, state query, command select
thd 341, proto sphinxql, state query, command select
thd 342, proto sphinxql, state query, command select
thd 343, proto sphinxql, state query, command select
thd 344, proto sphinxql, state query, command select
thd 345, proto sphinxql, state query, command select
thd 346, proto sphinxql, state query, command select
thd 347, proto sphinxql, state query, command select
thd 348, proto sphinxql, state query, command select
thd 349, proto sphinxql, state query, command select
thd 350, proto sphinxql, state query, command select
thd 351, proto sphinxql, state query, command select
thd 352, proto sphinxql, state query, command select
thd 353, proto sphinxql, state query, command select
thd 354, proto sphinxql, state query, command select
thd 355, proto sphinxql, state query, command select
thd 356, proto sphinxql, state query, command select
thd 357, proto sphinxql, state query, command select
thd 358, proto sphinxql, state query, command select
thd 359, proto sphinxql, state query, command select
thd 360, proto sphinxql, state query, command select
thd 361, proto sphinxql, state query, command select
thd 362, proto sphinxql, state query, command select
thd 363, proto sphinxql, state query, command select
thd 364, proto sphinxql, state query, command select
thd 365, proto sphinxql, state query, command select
thd 366, proto sphinxql, state query, command select
thd 367, proto sphinxql, state query, command select
thd 368, proto sphinxql, state query, command select
thd 369, proto sphinxql, state query, command select
thd 370, proto sphinxql, state query, command select
thd 371, proto sphinxql, state query, command select
thd 372, proto sphinxql, state query, command select
thd 373, proto sphinxql, state query, command select
thd 374, proto sphinxql, state query, command select
thd 375, proto sphinxql, state query, command select
thd 376, proto sphinxql, state query, command select
thd 377, proto sphinxql, state query, command select
thd 378, proto sphinxql, state query, command select
thd 379, proto sphinxql, state query, command select
thd 380, proto sphinxql, state query, command select
thd 381, proto sphinxql, state query, command select
thd 382, proto sphinxql, state query, command select
thd 383, proto sphinxql, state query, command select
thd 384, proto sphinxql, state query, command select
thd 385, proto sphinxql, state query, command select
thd 386, proto sphinxql, state query, command select
thd 387, proto sphinxql, state query, command select
thd 388, proto sphinxql, state query, command select
thd 389, proto sphinxql, state query, command select
thd 390, proto sphinxql, state query, command select
thd 391, proto sphinxql, state query, command select
thd 392, proto sphinxql, state query, command select
thd 393, proto sphinxql, state query, command select
thd 394, proto sphinxql, state query, command select
thd 395, proto sphinxql, state query, command select
thd 396, proto sphinxql, state query, command select
thd 397, proto sphinxql, state query, command select
thd 398, proto sphinxql, state query, command select
thd 399, proto sphinxql, state query, command select
thd 400, proto sphinxql, state query, command select
thd 401, proto sphinxql, state query, command select
thd 402, proto sphinxql, state query, command select
thd 403, proto sphinxql, state query, command select
thd 404, proto sphinxql, state query, command select
thd 405, proto sphinxql, state query, command select
thd 406, proto sphinxql, state query, command select
thd 407, proto sphinxql, state query, command select
thd 408, proto sphinxql, state query, command select
thd 409, proto sphinxql, state query, command select
thd 410, proto sphinxql, state query, command select
thd 411, proto sphinxql, state query, command select
thd 412, proto sphinxql, state query, command select
thd 413, proto sphinxql, state query, command select
thd 414, proto sphinxql, state query, command select
thd 415, proto sphinxql, state query, command select
thd 416, proto sphinxql, state query, command select
thd 417, proto sphinxql, state query, command select
thd 418, proto sphinxql, state query, command select
thd 419, proto sphinxql, state query, command select
thd 420, proto sphinxql, state query, command select
thd 421, proto sphinxql, state query, command select
thd 422, proto sphinxql, state query, command select
thd 423, proto sphinxql, state query, command select
thd 424, proto sphinxql, state query, command select
thd 425, proto sphinxql, state query, command select
thd 426, proto sphinxql, state query, command select
thd 427, proto sphinxql, state query, command select
thd 428, proto sphinxql, state query, command select
thd 429, proto sphinxql, state query, command select
thd 430, proto sphinxql, state query, command select
thd 431, proto sphinxql, state query, command select
thd 432, proto sphinxql, state query, command select
thd 433, proto sphinxql, state query, command select
thd 434, proto sphinxql, state query, command select
thd 435, proto sphinxql, state query, command select
thd 436, proto sphinxql, state query, command select
thd 437, proto sphinxql, state query, command select
thd 438, proto sphinxql, state query, command select
thd 439, proto sphinxql, state query, command select
thd 440, proto sphinxql, state query, command select
thd 441, proto sphinxql, state query, command select
thd 442, proto sphinxql, state query, command select
thd 443, proto sphinxql, state query, command select
thd 444, proto sphinxql, state query, command select
thd 445, proto sphinxql, state query, command select
thd 446, proto sphinxql, state query, command select
thd 447, proto sphinxql, state query, command select
thd 448, proto sphinxql, state query, command select
thd 449, proto sphinxql, state query, command select
thd 450, proto sphinxql, state query, command select
thd 451, proto sphinxql, state query, command select
thd 452, proto sphinxql, state query, command select
thd 453, proto sphinxql, state query, command select
thd 454, proto sphinxql, state query, command select
thd 455, proto sphinxql, state query, command select
thd 456, proto sphinxql, state query, command select
thd 457, proto sphinxql, state query, command select
thd 458, proto sphinxql, state query, command select
thd 459, proto sphinxql, state query, command select
thd 460, proto sphinxql, state query, command select
thd 461, proto sphinxql, state query, command select
thd 462, proto sphinxql, state query, command select
thd 463, proto sphinxql, state query, command select
thd 464, proto sphinxql, state query, command select
thd 465, proto sphinxql, state query, command select
thd 466, proto sphinxql, state query, command select
thd 467, proto sphinxql, state query, command select
thd 468, proto sphinxql, state query, command select
thd 469, proto sphinxql, state query, command select
thd 470, proto sphinxql, state query, command select
thd 471, proto sphinxql, state query, command select
thd 472, proto sphinxql, state query, command select
thd 473, proto sphinxql, state query, command select
thd 474, proto sphinxql, state query, command select
thd 475, proto sphinxql, state query, command select
thd 476, proto sphinxql, state query, command select
thd 477, proto sphinxql, state query, command select
thd 478, proto sphinxql, state query, command select
thd 479, proto sphinxql, state query, command select
thd 480, proto sphinxql, state query, command select
thd 481, proto sphinxql, state query, command select
thd 482, proto sphinxql, state query, command select
thd 483, proto sphinxql, state query, command select
thd 484, proto sphinxql, state query, command select
thd 485, proto sphinxql, state query, command select
thd 486, proto sphinxql, state query, command select
thd 487, proto sphinxql, state query, command select
thd 488, proto sphinxql, state query, command select
thd 489, proto sphinxql, state query, command select
thd 490, proto sphinxql, state query, command select
thd 491, proto sphinxql, state query, command select
thd 492, proto sphinxql, state query, command select
thd 493, proto sphinxql, state query, command select
thd 494, proto sphinxql, state query, command select
thd 495, proto sphinxql, state query, command select
thd 496, proto sphinxql, state query, command select
thd 497, proto sphinxql, state query, command select
thd 498, proto sphinxql, state query, command select
thd 499, proto sphinxql, state query, command select
thd 500, proto sphinxql, state query, command select
thd 501, proto sphinxql, state query, command select
thd 502, proto sphinxql, state query, command select
thd 503, proto sphinxql, state query, command select
thd 504, proto sphinxql, state query, command select
thd 505, proto sphinxql, state query, command select
thd 506, proto sphinxql, state query, command select
thd 507, proto sphinxql, state query, command select
thd 508, proto sphinxql, state query, command select
thd 509, proto sphinxql, state query, command select
thd 510, proto sphinxql, state query, command select
thd 511, proto sphinxql, state query, command select
thd 512, proto sphinxql, state query, command select
thd 513, proto sphinxql, state query, command select
thd 514, proto sphinxql, state query, command select
thd 515, proto sphinxql, state query, command select
thd 516, proto sphinxql, state query, command select
thd 517, proto sphinxql, state query, command select
thd 518, proto sphinxql, state query, command select
thd 519, proto sphinxql, state query, command select
thd 520, proto sphinxql, state query, command select
thd 521, proto sphinxql, state query, command select
thd 522, proto sphinxql, state query, command select
thd 523, proto sphinxql, state query, command select
thd 524, proto sphinxql, state query, command select
thd 525, proto sphinxql, state query, command select
thd 526, proto sphinxql, state query, command select
thd 527, proto sphinxql, state query, command select
thd 528, proto sphinxql, state query, command select
thd 529, proto sphinxql, state query, command select
thd 530, proto sphinxql, state query, command select
thd 531, proto sphinxql, state query, command select
thd 532, proto sphinxql, state query, command select
thd 533, proto sphinxql, state query, command select
thd 534, proto sphinxql, state query, command select
thd 535, proto sphinxql, state query, command select
thd 536, proto sphinxql, state query, command select
thd 537, proto sphinxql, state query, command select
thd 538, proto sphinxql, state query, command select
thd 539, proto sphinxql, state query, command select
thd 540, proto sphinxql, state query, command select
thd 541, proto sphinxql, state query, command select
thd 542, proto sphinxql, state query, command select
thd 543, proto sphinxql, state query, command select
thd 544, proto sphinxql, state query, command select
thd 545, proto sphinxql, state query, command select
thd 546, proto sphinxql, state query, command select
thd 547, proto sphinxql, state query, command select
thd 548, proto sphinxql, state query, command select
thd 549, proto sphinxql, state query, command select
thd 550, proto sphinxql, state query, command select
thd 551, proto sphinxql, state query, command select
thd 552, proto sphinxql, state query, command select
thd 553, proto sphinxql, state query, command select
thd 554, proto sphinxql, state query, command select
thd 555, proto sphinxql, state query, command select
thd 556, proto sphinxql, state query, command select
thd 557, proto sphinxql, state query, command select
thd 558, proto sphinxql, state query, command select
thd 559, proto sphinxql, state query, command select
thd 560, proto sphinxql, state query, command select
thd 561, proto sphinxql, state query, command select
thd 562, proto sphinxql, state query, command select
thd 563, proto sphinxql, state query, command select
thd 564, proto sphinxql, state query, command select
thd 565, proto sphinxql, state query, command select
thd 566, proto sphinxql, state query, command select
thd 567, proto sphinxql, state query, command select
thd 568, proto sphinxql, state query, command select
thd 569, proto sphinxql, state query, command select
thd 570, proto sphinxql, state query, command select
thd 571, proto sphinxql, state query, command select
thd 572, proto sphinxql, state query, command select
thd 573, proto sphinxql, state query, command select
thd 574, proto sphinxql, state query, command select
thd 575, proto sphinxql, state query, command select
thd 576, proto sphinxql, state query, command select
thd 577, proto sphinxql, state query, command select
thd 578, proto sphinxql, state query, command select
thd 579, proto sphinxql, state query, command select
thd 580, proto sphinxql, state query, command select
thd 581, proto sphinxql, state query, command select
thd 582, proto sphinxql, state query, command select
thd 583, proto sphinxql, state query, command select
thd 584, proto sphinxql, state query, command select
thd 585, proto sphinxql, state query, command select
thd 586, proto sphinxql, state query, command select
thd 587, proto sphinxql, state query, command select
thd 588, proto sphinxql, state query, command select
thd 589, proto sphinxql, state query, command select
thd 590, proto sphinxql, state query, command select
thd 591, proto sphinxql, state query, command select
thd 592, proto sphinxql, state query, command select
thd 593, proto sphinxql, state query, command select
thd 594, proto sphinxql, state query, command select
thd 595, proto sphinxql, state query, command select
thd 596, proto sphinxql, state query, command select
thd 597, proto sphinxql, state query, command select
thd 598, proto sphinxql, state query, command select
thd 599, proto sphinxql, state query, command select
thd 600, proto sphinxql, state query, command select
thd 601, proto sphinxql, state query, command select
thd 602, proto sphinxql, state query, command select
thd 603, proto sphinxql, state query, command select
thd 604, proto sphinxql, state query, command select
thd 605, proto sphinxql, state query, command select
thd 606, proto sphinxql, state query, command select
thd 607, proto sphinxql, state query, command select
thd 608, proto sphinxql, state query, command select
thd 609, proto sphinxql, state query, command select
thd 610, proto sphinxql, state query, command select
thd 611, proto sphinxql, state query, command select
thd 612, proto sphinxql, state query, command select
thd 613, proto sphinxql, state query, command select
thd 614, proto sphinxql, state query, command select
thd 615, proto sphinxql, state query, command select
thd 616, proto sphinxql, state query, command select
thd 617, proto sphinxql, state query, command select
thd 618, proto sphinxql, state query, command select
thd 619, proto sphinxql, state query, command select
thd 620, proto sphinxql, state query, command select
thd 621, proto sphinxql, state query, command select
thd 622, proto sphinxql, state query, command select
thd 623, proto sphinxql, state query, command select
thd 624, proto sphinxql, state query, command select
thd 625, proto sphinxql, state query, command select
thd 626, proto sphinxql, state query, command select
thd 627, proto sphinxql, state query, command select
thd 628, proto sphinxql, state query, command select
thd 629, proto sphinxql, state query, command select
thd 630, proto sphinxql, state query, command select
thd 631, proto sphinxql, state query, command select
thd 632, proto sphinxql, state query, command select
thd 633, proto sphinxql, state query, command select
thd 634, proto sphinxql, state query, command select
thd 635, proto sphinxql, state query, command select
thd 636, proto sphinxql, state query, command select
thd 637, proto sphinxql, state query, command select
thd 638, proto sphinxql, state query, command select
thd 639, proto sphinxql, state query, command select
thd 640, proto sphinxql, state query, command select
thd 641, proto sphinxql, state query, command select
thd 642, proto sphinxql, state query, command select
thd 643, proto sphinxql, state query, command select
thd 644, proto sphinxql, state query, command select
thd 645, proto sphinxql, state query, command select
thd 646, proto sphinxql, state query, command select
thd 647, proto sphinxql, state query, command select
thd 648, proto sphinxql, state query, command select
thd 649, proto sphinxql, state query, command select
thd 650, proto sphinxql, state query, command select
thd 651, proto sphinxql, state query, command select
thd 652, proto sphinxql, state query, command select
thd 653, proto sphinxql, state query, command select
thd 654, proto sphinxql, state query, command select
thd 655, proto sphinxql, state query, command select
thd 656, proto sphinxql, state query, command select
thd 657, proto sphinxql, state query, command select
thd 658, proto sphinxql, state query, command select
thd 659, proto sphinxql, state query, command select
thd 660, proto sphinxql, state query, command select
thd 661, proto sphinxql, state query, command select
thd 662, proto sphinxql, state query, command select
thd 663, proto sphinxql, state query, command select
thd 664, proto sphinxql, state query, command select
thd 665, proto sphinxql, state query, command select
thd 666, proto sphinxql, state query, command select
thd 667, proto sphinxql, state query, command select
thd 668, proto sphinxql, state query, command select
thd 669, proto sphinxql, state query, command select
thd 670, proto sphinxql, state query, command select
thd 671, proto sphinxql, state query, command select
thd 672, proto sphinxql, state query, command select
thd 673, proto sphinxql, state query, command select
thd 674, proto sphinxql, state query, command select
thd 675, proto sphinxql, state query, command select
thd 676, proto sphinxql, state query, command select
thd 677, proto sphinxql, state query, command select
thd 678, proto sphinxql, state query, command select
thd 679, proto sphinxql, state query, command select
thd 680, proto sphinxql, state query, command select
thd 681, proto sphinxql, state query, command select
thd 682, proto sphinxql, state query, command select
thd 683, proto sphinxql, state query, command select
thd 684, proto sphinxql, state query, command select
thd 685, proto sphinxql, state query, command select
thd 686, proto sphinxql, state query, command select
thd 687, proto sphinxql, state query, command select
thd 688, proto sphinxql, state query, command select
thd 689, proto sphinxql, state query, command select
thd 690, proto sphinxql, state query, command select
thd 691, proto sphinxql, state query, command select
thd 692, proto sphinxql, state query, command select
thd 693, proto sphinxql, state query, command select
thd 694, proto sphinxql, state query, command select
thd 695, proto sphinxql, state query, command select
thd 696, proto sphinxql, state query, command select
thd 697, proto sphinxql, state query, command select
thd 698, proto sphinxql, state query, command select
thd 699, proto sphinxql, state query, command select
thd 700, proto sphinxql, state query, command select
thd 701, proto sphinxql, state query, command select
thd 702, proto sphinxql, state query, command select
thd 703, proto sphinxql, state query, command select
thd 704, proto sphinxql, state query, command select
thd 705, proto sphinxql, state query, command select
thd 706, proto sphinxql, state query, command select
thd 707, proto sphinxql, state query, command select
thd 708, proto sphinxql, state query, command select
thd 709, proto sphinxql, state query, command select
thd 710, proto sphinxql, state query, command select
thd 711, proto sphinxql, state query, command select
thd 712, proto sphinxql, state query, command select
thd 713, proto sphinxql, state query, command select
thd 714, proto sphinxql, state query, command select
thd 715, proto sphinxql, state query, command select
thd 716, proto sphinxql, state query, command select
thd 717, proto sphinxql, state query, command select
thd 718, proto sphinxql, state query, command select
thd 719, proto sphinxql, state query, command select
thd 720, proto sphinxql, state query, command select
thd 721, proto sphinxql, state query, command select
thd 722, proto sphinxql, state query, command select
thd 723, proto sphinxql, state query, command select
thd 724, proto sphinxql, state query, command select
thd 725, proto sphinxql, state query, command select
thd 726, proto sphinxql, state query, command select
thd 727, proto sphinxql, state query, command select
thd 728, proto sphinxql, state query, command select
thd 729, proto sphinxql, state query, command select
thd 730, proto sphinxql, state query, command select
thd 731, proto sphinxql, state query, command select
thd 732, proto sphinxql, state query, command select
thd 733, proto sphinxql, state query, command select
thd 734, proto sphinxql, state query, command select
thd 735, proto sphinxql, state query, command select
thd 736, proto sphinxql, state query, command select
thd 737, proto sphinxql, state query, command select
thd 738, proto sphinxql, state query, command select
thd 739, proto sphinxql, state query, command select
thd 740, proto sphinxql, state query, command select
thd 741, proto sphinxql, state query, command select
thd 742, proto sphinxql, state query, command select
thd 743, proto sphinxql, state query, command select
thd 744, proto sphinxql, state query, command select
thd 745, proto sphinxql, state query, command select
thd 746, proto sphinxql, state query, command select
thd 747, proto sphinxql, state query, command select
thd 748, proto sphinxql, state query, command select
thd 749, proto sphinxql, state query, command select
thd 750, proto sphinxql, state query, command select
thd 751, proto sphinxql, state query, command select
thd 752, proto sphinxql, state query, command select
thd 753, proto sphinxql, state query, command select
thd 754, proto sphinxql, state query, command select
thd 755, proto sphinxql, state query, command select
thd 756, proto sphinxql, state query, command select
thd 757, proto sphinxql, state query, command select
thd 758, proto sphinxql, state query, command select
thd 759, proto sphinxql, state query, command select
thd 760, proto sphinxql, state query, command select
thd 761, proto sphinxql, state query, command select
thd 762, proto sphinxql, state query, command select
thd 763, proto sphinxql, state query, command select
thd 764, proto sphinxql, state query, command select
thd 765, proto sphinxql, state query, command select
thd 766, proto sphinxql, state query, command select
thd 767, proto sphinxql, state query, command select
thd 768, proto sphinxql, state query, command select
thd 769, proto sphinxql, state query, command select
thd 770, proto sphinxql, state query, command select
thd 771, proto sphinxql, state query, command select
thd 772, proto sphinxql, state query, command select
thd 773, proto sphinxql, state query, command select
thd 774, proto sphinxql, state query, command select
thd 775, proto sphinxql, state query, command select
thd 776, proto sphinxql, state query, command select
thd 777, proto sphinxql, state query, command select
thd 778, proto sphinxql, state query, command select
thd 779, proto sphinxql, state query, command select
thd 780, proto sphinxql, state query, command select
thd 781, proto sphinxql, state query, command select
thd 782, proto sphinxql, state query, command select
thd 783, proto sphinxql, state query, command select
thd 784, proto sphinxql, state query, command select
thd 785, proto sphinxql, state query, command select
thd 786, proto sphinxql, state query, command select
thd 787, proto sphinxql, state query, command select
thd 788, proto sphinxql, state query, command select
thd 789, proto sphinxql, state query, command select
thd 790, proto sphinxql, state query, command select
thd 791, proto sphinxql, state query, command select
thd 792, proto sphinxql, state query, command select
thd 793, proto sphinxql, state query, command select
thd 794, proto sphinxql, state query, command select
thd 795, proto sphinxql, state query, command select
thd 796, proto sphinxql, state query, command select
thd 797, proto sphinxql, state query, command select
thd 798, proto sphinxql, state query, command select
thd 799, proto sphinxql, state query, command select
thd 800, proto sphinxql, state query, command select
thd 801, proto sphinxql, state query, command select
thd 802, proto sphinxql, state query, command select
thd 803, proto sphinxql, state query, command select
thd 804, proto sphinxql, state query, command select
thd 805, proto sphinxql, state query, command select
thd 806, proto sphinxql, state query, command select
thd 807, proto sphinxql, state query, command select
thd 808, proto sphinxql, state query, command select
thd 809, proto sphinxql, state query, command select
thd 810, proto sphinxql, state query, command select
thd 811, proto sphinxql, state query, command select
thd 812, proto sphinxql, state query, command select
thd 813, proto sphinxql, state query, command select
thd 814, proto sphinxql, state query, command select
thd 815, proto sphinxql, state query, command select
thd 816, proto sphinxql, state query, command select
thd 817, proto sphinxql, state query, command select
thd 818, proto sphinxql, state query, command select
thd 819, proto sphinxql, state query, command select
thd 820, proto sphinxql, state query, command select
thd 821, proto sphinxql, state query, command select
thd 822, proto sphinxql, state query, command select
thd 823, proto sphinxql, state query, command select
thd 824, proto sphinxql, state query, command select
thd 825, proto sphinxql, state query, command select
thd 826, proto sphinxql, state query, command select
thd 827, proto sphinxql, state query, command select
thd 828, proto sphinxql, state query, command select
thd 829, proto sphinxql, state query, command select
thd 830, proto sphinxql, state query, command select
thd 831, proto sphinxql, state query, command select
thd 832, proto sphinxql, state query, command select
thd 833, proto sphinxql, state query, command select
thd 834, proto sphinxql, state query, command select
thd 835, proto sphinxql, state query, command select
thd 836, proto sphinxql, state query, command select
thd 837, proto sphinxql, state query, command select
thd 838, proto sphinxql, state query, command select
thd 839, proto sphinxql, state query, command select
thd 840, proto sphinxql, state query, command select
thd 841, proto sphinxql, state query, command select
thd 842, proto sphinxql, state query, command select
thd 843, proto sphinxql, state query, command select
thd 844, proto sphinxql, state query, command select
thd 845, proto sphinxql, state query, command select
thd 846, proto sphinxql, state query, command select
thd 847, proto sphinxql, state query, command select
thd 848, proto sphinxql, state query, command select
thd 849, proto sphinxql, state query, command select
thd 850, proto sphinxql, state query, command select
thd 851, proto sphinxql, state query, command select
thd 852, proto sphinxql, state query, command select
thd 853, proto sphinxql, state query, command select
thd 854, proto sphinxql, state query, command select
thd 855, proto sphinxql, state query, command select
thd 856, proto sphinxql, state query, command select
thd 857, proto sphinxql, state query, command select
thd 858, proto sphinxql, state query, command select
thd 859, proto sphinxql, state query, command select
thd 860, proto sphinxql, state query, command select
thd 861, proto sphinxql, state query, command select
thd 862, proto sphinxql, state query, command select
thd 863, proto sphinxql, state query, command select
thd 864, proto sphinxql, state query, command select
thd 865, proto sphinxql, state query, command select
thd 866, proto sphinxql, state query, command select
thd 867, proto sphinxql, state query, command select
thd 868, proto sphinxql, state query, command select
thd 869, proto sphinxql, state query, command select
thd 870, proto sphinxql, state query, command select
thd 871, proto sphinxql, state query, command select
thd 872, proto sphinxql, state query, command select
thd 873, proto sphinxql, state query, command select
thd 874, proto sphinxql, state query, command select
thd 875, proto sphinxql, state query, command select
thd 876, proto sphinxql, state query, command select
thd 877, proto sphinxql, state query, command select
thd 878, proto sphinxql, state query, command select
thd 879, proto sphinxql, state query, command select
thd 880, proto sphinxql, state query, command select
thd 881, proto sphinxql, state query, command select
thd 882, proto sphinxql, state query, command select
thd 883, proto sphinxql, state query, command select
thd 884, proto sphinxql, state query, command select
thd 885, proto sphinxql, state query, command select
thd 886, proto sphinxql, state query, command select
thd 887, proto sphinxql, state query, command select
thd 888, proto sphinxql, state query, command select
thd 889, proto sphinxql, state query, command select
thd 890, proto sphinxql, state query, command select
thd 891, proto sphinxql, state query, command select
thd 892, proto sphinxql, state query, command select
thd 893, proto sphinxql, state query, command select
thd 894, proto sphinxql, state query, command select
thd 895, proto sphinxql, state query, command select
thd 896, proto sphinxql, state query, command select
thd 897, proto sphinxql, state query, command select
thd 898, proto sphinxql, state query, command select
thd 899, proto sphinxql, state query, command select
thd 900, proto sphinxql, state query, command select
thd 901, proto sphinxql, state query, command select
thd 902, proto sphinxql, state query, command select
thd 903, proto sphinxql, state query, command select
thd 904, proto sphinxql, state query, command select
thd 905, proto sphinxql, state query, command select
thd 906, proto sphinxql, state query, command select
thd 907, proto sphinxql, state query, command select
thd 908, proto sphinxql, state query, command select
thd 909, proto sphinxql, state query, command select
thd 910, proto sphinxql, state query, command select
thd 911, proto sphinxql, state query, command select
thd 912, proto sphinxql, state query, command select
thd 913, proto sphinxql, state query, command select
thd 914, proto sphinxql, state query, command select
thd 915, proto sphinxql, state query, command select
thd 916, proto sphinxql, state query, command select
thd 917, proto sphinxql, state query, command select
thd 918, proto sphinxql, state query, command select
thd 919, proto sphinxql, state query, command select
thd 920, proto sphinxql, state query, command select
thd 921, proto sphinxql, state query, command select
thd 922, proto sphinxql, state query, command select
thd 923, proto sphinxql, state query, command select
thd 924, proto sphinxql, state query, command select
thd 925, proto sphinxql, state query, command select
thd 926, proto sphinxql, state query, command select
thd 927, proto sphinxql, state query, command select
thd 928, proto sphinxql, state query, command select
thd 929, proto sphinxql, state query, command select
thd 930, proto sphinxql, state query, command select
thd 931, proto sphinxql, state query, command select
thd 932, proto sphinxql, state query, command select
thd 933, proto sphinxql, state query, command select
thd 934, proto sphinxql, state query, command select
thd 935, proto sphinxql, state query, command select
thd 936, proto sphinxql, state query, command select
thd 937, proto sphinxql, state query, command select
thd 938, proto sphinxql, state query, command select
thd 939, proto sphinxql, state query, command select
thd 940, proto sphinxql, state query, command select
thd 941, proto sphinxql, state query, command select
thd 942, proto sphinxql, state query, command select
thd 943, proto sphinxql, state query, command select
thd 944, proto sphinxql, state query, command select
thd 945, proto sphinxql, state query, command select
thd 946, proto sphinxql, state query, command select
thd 947, proto sphinxql, state query, command select
thd 948, proto sphinxql, state query, command select
thd 949, proto sphinxql, state query, command select
thd 950, proto sphinxql, state query, command select
thd 951, proto sphinxql, state query, command select
thd 952, proto sphinxql, state query, command select
thd 953, proto sphinxql, state query, command select
thd 954, proto sphinxql, state query, command select
thd 955, proto sphinxql, state query, command select
thd 956, proto sphinxql, state query, command select
thd 957, proto sphinxql, state query, command select
thd 958, proto sphinxql, state query, command select
thd 959, proto sphinxql, state query, command select
thd 960, proto sphinxql, state query, command select
thd 961, proto sphinxql, state query, command select
thd 962, proto sphinxql, state query, command select
thd 963, proto sphinxql, state query, command select
thd 964, proto sphinxql, state query, command select
thd 965, proto sphinxql, state query, command select
thd 966, proto sphinxql, state query, command select
thd 967, proto sphinxql, state query, command select
thd 968, proto sphinxql, state query, command select
thd 969, proto sphinxql, state query, command select
thd 970, proto sphinxql, state query, command select
thd 971, proto sphinxql, state query, command select
thd 972, proto sphinxql, state query, command select
thd 973, proto sphinxql, state query, command select
thd 974, proto sphinxql, state query, command select
thd 975, proto sphinxql, state query, command select
thd 976, proto sphinxql, state query, command select
thd 977, proto sphinxql, state query, command select
thd 978, proto sphinxql, state query, command select
thd 979, proto sphinxql, state query, command select
thd 980, proto sphinxql, state query, command select
thd 981, proto sphinxql, state query, command select
thd 982, proto sphinxql, state query, command select
thd 983, proto sphinxql, state query, command select
thd 984, proto sphinxql, state query, command select
thd 985, proto sphinxql, state query, command select
thd 986, proto sphinxql, state query, command select
thd 987, proto sphinxql, state query, command select
thd 988, proto sphinxql, state query, command select
thd 989, proto sphinxql, state query, command select
thd 990, proto sphinxql, state query, command select
thd 991, proto sphinxql, state query, command select
thd 992, proto sphinxql, state query, command select
thd 993, proto sphinxql, state query, command select
thd 994, proto sphinxql, state query, command select
thd 995, proto sphinxql, state query, command select
thd 996, proto sphinxql, state query, command select
thd 997, proto sphinxql, state query, command select
thd 998, proto sphinxql, state query, command select
thd 999, proto sphinxql, state query, command select
thd 1000, proto sphinxql, state query, command select
thd 1001, proto sphinxql, state query, command select
thd 1002, proto sphinxql, state query, command select
thd 1003, proto sphinxql, state query, command select
thd 1004, proto sphinxql, state query, command select
thd 1005, proto sphinxql, state query, command select
thd 1006, proto sphinxql, state query, command select
thd 1007, proto sphinxql, state query, command select
thd 1008, proto sphinxql, state query, command select
thd 1009, proto sphinxql, state query, command select
thd 1010, proto sphinxql, state query, command select
thd 1011, proto sphinxql, state query, command select
thd 1012, proto sphinxql, state query, command select
thd 1013, proto sphinxql, state query, command select
thd 1014, proto sphinxql, state query, command select
thd 1015, proto sphinxql, state query, command select
thd 1016, proto sphinxql, state query, command select
thd 1017, proto sphinxql, state query, command select
thd 1018, proto sphinxql, state query, command select
thd 1019, proto sphinxql, state query, command select
thd 1020, proto sphinxql, state query, command select
thd 1021, proto sphinxql, state query, command select
thd 1022, proto sphinxql, state query, command select
thd 1023, proto sphinxql, state query, command select
thd 1024, proto sphinxql, state query, command select
thd 1025, proto sphinxql, state query, command select
thd 1026, proto sphinxql, state query, command select
thd 1027, proto sphinxql, state query, command select
thd 1028, proto sphinxql, state query, command select
thd 1029, proto sphinxql, state query, command select
thd 1030, proto sphinxql, state query, command select
thd 1031, proto sphinxql, state query, command select
thd 1032, proto sphinxql, state query, command select
thd 1033, proto sphinxql, state query, command select
thd 1034, proto sphinxql, state query, command select
thd 1035, proto sphinxql, state query, command select
thd 1036, proto sphinxql, state query, command select
thd 1037, proto sphinxql, state query, command select
thd 1038, proto sphinxql, state query, command select
thd 1039, proto sphinxql, state query, command select
thd 1040, proto sphinxql, state query, command select
thd 1041, proto sphinxql, state query, command select
thd 1042, proto sphinxql, state query, command select
thd 1043, proto sphinxql, state query, command select
thd 1044, proto sphinxql, state query, command select
thd 1045, proto sphinxql, state query, command select
thd 1046, proto sphinxql, state query, command select
thd 1047, proto sphinxql, state query, command select
thd 1048, proto sphinxql, state query, command select
thd 1049, proto sphinxql, state query, command select
thd 1050, proto sphinxql, state query, command select
thd 1051, proto sphinxql, state query, command select
thd 1052, proto sphinxql, state query, command select
thd 1053, proto sphinxql, state query, command select
thd 1054, proto sphinxql, state query, command select
thd 1055, proto sphinxql, state query, command select
thd 1056, proto sphinxql, state query, command select
thd 1057, proto sphinxql, state query, command select
thd 1058, proto sphinxql, state query, command select
thd 1059, proto sphinxql, state query, command select
thd 1060, proto sphinxql, state query, command select
thd 1061, proto sphinxql, state query, command select
thd 1062, proto sphinxql, state query, command select
thd 1063, proto sphinxql, state query, command select
thd 1064, proto sphinxql, state query, command select
thd 1065, proto sphinxql, state query, command select
thd 1066, proto sphinxql, state query, command select
thd 1067, proto sphinxql, state query, command select
thd 1068, proto sphinxql, state query, command select
thd 1069, proto sphinxql, state query, command select
thd 1070, proto sphinxql, state query, command select
thd 1071, proto sphinxql, state query, command select
thd 1072, proto sphinxql, state query, command select
thd 1073, proto sphinxql, state query, command select
thd 1074, proto sphinxql, state query, command select
thd 1075, proto sphinxql, state query, command select
thd 1076, proto sphinxql, state query, command select
thd 1077, proto sphinxql, state query, command select
thd 1078, proto sphinxql, state query, command select
thd 1079, proto sphinxql, state query, command select
thd 1080, proto sphinxql, state query, command select
thd 1081, proto sphinxql, state query, command select
thd 1082, proto sphinxql, state query, command select
thd 1083, proto sphinxql, state query, command select
thd 1084, proto sphinxql, state query, command select
thd 1085, proto sphinxql, state query, command select
thd 1086, proto sphinxql, state query, command select
thd 1087, proto sphinxql, state query, command select
thd 1088, proto sphinxql, state query, command select
thd 1089, proto sphinxql, state query, command select
thd 1090, proto sphinxql, state query, command select
thd 1091, proto sphinxql, state query, command select
thd 1092, proto sphinxql, state query, command select
thd 1093, proto sphinxql, state query, command select
thd 1094, proto sphinxql, state query, command select
thd 1095, proto sphinxql, state query, command select
thd 1096, proto sphinxql, state query, command select
thd 1097, proto sphinxql, state query, command select
thd 1098, proto sphinxql, state query, command select
thd 1099, proto sphinxql, state query, command select
thd 1100, proto sphinxql, state query, command select
thd 1101, proto sphinxql, state query, command select
thd 1102, proto sphinxql, state query, command select
thd 1103, proto sphinxql, state query, command select
thd 1104, proto sphinxql, state query, command select
thd 1105, proto sphinxql, state query, command select
thd 1106, proto sphinxql, state query, command select
thd 1107, proto sphinxql, state query, command select
thd 1108, proto sphinxql, state query, command select
thd 1109, proto sphinxql, state query, command select
thd 1110, proto sphinxql, state query, command select
thd 1111, proto sphinxql, state query, command select
thd 1112, proto sphinxql, state query, command select
thd 1113, proto sphinxql, state query, command select
thd 1114, proto sphinxql, state query, command select
thd 1115, proto sphinxql, state query, command select
thd 1116, proto sphinxql, state query, command select
thd 1117, proto sphinxql, state query, command select
thd 1118, proto sphinxql, state query, command select
thd 1119, proto sphinxql, state query, command select
thd 1120, proto sphinxql, state query, command select
thd 1121, proto sphinxql, state query, command select
thd 1122, proto sphinxql, state query, command select
thd 1123, proto sphinxql, state query, command select
thd 1124, proto sphinxql, state query, command select
thd 1125, proto sphinxql, state query, command select
thd 1126, proto sphinxql, state query, command select
thd 1127, proto sphinxql, state query, command select
thd 1128, proto sphinxql, state query, command select
thd 1129, proto sphinxql, state query, command select
thd 1130, proto sphinxql, state query, command select
thd 1131, proto sphinxql, state query, command select
thd 1132, proto sphinxql, state query, command select
thd 1133, proto sphinxql, state query, command select
thd 1134, proto sphinxql, state query, command select
thd 1135, proto sphinxql, state query, command select
thd 1136, proto sphinxql, state query, command select
thd 1137, proto sphinxql, state query, command select
thd 1138, proto sphinxql, state query, command select
thd 1139, proto sphinxql, state query, command select
thd 1140, proto sphinxql, state query, command select
thd 1141, proto sphinxql, state query, command select
thd 1142, proto sphinxql, state query, command select
thd 1143, proto sphinxql, state query, command select
thd 1144, proto sphinxql, state query, command select
thd 1145, proto sphinxql, state query, command select
thd 1146, proto sphinxql, state query, command select
thd 1147, proto sphinxql, state query, command select
thd 1148, proto sphinxql, state query, command select
thd 1149, proto sphinxql, state query, command select
thd 1150, proto sphinxql, state query, command select
thd 1151, proto sphinxql, state query, command select
thd 1152, proto sphinxql, state query, command select
thd 1153, proto sphinxql, state query, command select
thd 1154, proto sphinxql, state query, command select
thd 1155, proto sphinxql, state query, command select
thd 1156, proto sphinxql, state query, command select
thd 1157, proto sphinxql, state query, command select
thd 1158, proto sphinxql, state query, command select
thd 1159, proto sphinxql, state query, command select
thd 1160, proto sphinxql, state query, command select
thd 1161, proto sphinxql, state query, command select
thd 1162, proto sphinxql, state query, command select
thd 1163, proto sphinxql, state query, command select
thd 1164, proto sphinxql, state query, command select
thd 1165, proto sphinxql, state query, command select
thd 1166, proto sphinxql, state query, command select
thd 1167, proto sphinxql, state query, command select
thd 1168, proto sphinxql, state query, command select
thd 1169, proto sphinxql, state query, command select
thd 1170, proto sphinxql, state query, command select
thd 1171, proto sphinxql, state query, command select
thd 1172, proto sphinxql, state query, command select
thd 1173, proto sphinxql, state query, command select
thd 1174, proto sphinxql, state query, command select
thd 1175, proto sphinxql, state query, command select
thd 1176, proto sphinxql, state query, command select
thd 1177, proto sphinxql, state query, command select
thd 1178, proto sphinxql, state query, command select
thd 1179, proto sphinxql, state query, command select
thd 1180, proto sphinxql, state query, command select
thd 1181, proto sphinxql, state query, command select
thd 1182, proto sphinxql, state query, command select
thd 1183, proto sphinxql, state query, command select
thd 1184, proto sphinxql, state query, command select
thd 1185, proto sphinxql, state query, command select
thd 1186, proto sphinxql, state query, command select
thd 1187, proto sphinxql, state query, command select
thd 1188, proto sphinxql, state query, command select
thd 1189, proto sphinxql, state query, command select
thd 1190, proto sphinxql, state query, command select
thd 1191, proto sphinxql, state query, command select
thd 1192, proto sphinxql, state query, command select
thd 1193, proto sphinxql, state query, command select
thd 1194, proto sphinxql, state query, command select
thd 1195, proto sphinxql, state query, command select
thd 1196, proto sphinxql, state query, command select
thd 1197, proto sphinxql, state query, command select
thd 1198, proto sphinxql, state query, command select
thd 1199, proto sphinxql, state query, command select
thd 1200, proto sphinxql, state query, command select
thd 1201, proto sphinxql, state query, command select
thd 1202, proto sphinxql, state query, command select
thd 1203, proto sphinxql, state query, command select
thd 1204, proto sphinxql, state query, command select
thd 1205, proto sphinxql, state query, command select
thd 1206, proto sphinxql, state query, command select
thd 1207, proto sphinxql, state query, command select
thd 1208, proto sphinxql, state query, command select
thd 1209, proto sphinxql, state query, command select
thd 1210, proto sphinxql, state query, command select
thd 1211, proto sphinxql, state query, command select
thd 1212, proto sphinxql, state query, command select
thd 1213, proto sphinxql, state query, command select
thd 1214, proto sphinxql, state query, command select
thd 1215, proto sphinxql, state query, command select
thd 1216, proto sphinxql, state query, command select
thd 1217, proto sphinxql, state query, command select
thd 1218, proto sphinxql, state query, command select
thd 1219, proto sphinxql, state query, command select
thd 1220, proto sphinxql, state query, command select
thd 1221, proto sphinxql, state query, command select
thd 1222, proto sphinxql, state query, command select
thd 1223, proto sphinxql, state query, command select
thd 1224, proto sphinxql, state query, command select
thd 1225, proto sphinxql, state query, command select
thd 1226, proto sphinxql, state query, command select
thd 1227, proto sphinxql, state query, command select
thd 1228, proto sphinxql, state query, command select
thd 1229, proto sphinxql, state query, command select
thd 1230, proto sphinxql, state query, command select
thd 1231, proto sphinxql, state query, command select
thd 1232, proto sphinxql, state query, command select
thd 1233, proto sphinxql, state query, command select
thd 1234, proto sphinxql, state query, command select
thd 1235, proto sphinxql, state query, command select
thd 1236, proto sphinxql, state query, command select
thd 1237, proto sphinxql, state query, command select
thd 1238, proto sphinxql, state query, command select
thd 1239, proto sphinxql, state query, command select
thd 1240, proto sphinxql, state query, command select
thd 1241, proto sphinxql, state query, command select
thd 1242, proto sphinxql, state query, command select
thd 1243, proto sphinxql, state query, command select
thd 1244, proto sphinxql, state query, command select
thd 1245, proto sphinxql, state query, command select
thd 1246, proto sphinxql, state query, command select
thd 1247, proto sphinxql, state query, command select
thd 1248, proto sphinxql, state query, command select
thd 1249, proto sphinxql, state query, command select
thd 1250, proto sphinxql, state query, command select
thd 1251, proto sphinxql, state query, command select
thd 1252, proto sphinxql, state query, command select
thd 1253, proto sphinxql, state query, command select
thd 1254, proto sphinxql, state query, command select
thd 1255, proto sphinxql, state query, command select
thd 1256, proto sphinxql, state query, command select
thd 1257, proto sphinxql, state query, command select
thd 1258, proto sphinxql, state query, command select
thd 1259, proto sphinxql, state query, command select
thd 1260, proto sphinxql, state query, command select
thd 1261, proto sphinxql, state query, command select
thd 1262, proto sphinxql, state query, command select
thd 1263, proto sphinxql, state query, command select
thd 1264, proto sphinxql, state query, command select
thd 1265, proto sphinxql, state query, command select
thd 1266, proto sphinxql, state query, command select
thd 1267, proto sphinxql, state query, command select
thd 1268, proto sphinxql, state query, command select
thd 1269, proto sphinxql, state query, command select
thd 1270, proto sphinxql, state query, command select
thd 1271, proto sphinxql, state query, command select
thd 1272, proto sphinxql, state query, command select
thd 1273, proto sphinxql, state query, command select
thd 1274, proto sphinxql, state query, command select
thd 1275, proto sphinxql, state query, command select
thd 1276, proto sphinxql, state query, command select
thd 1277, proto sphinxql, state query, command select
thd 1278, proto sphinxql, state query, command select
thd 1279, proto sphinxql, state query, command select
thd 1280, proto sphinxql, state query, command select
thd 1281, proto sphinxql, state query, command select
thd 1282, proto sphinxql, state query, command select
thd 1283, proto sphinxql, state query, command select
thd 1284, proto sphinxql, state query, command select
thd 1285, proto sphinxql, state query, command select
thd 1286, proto sphinxql, state query, command select
thd 1287, proto sphinxql, state query, command select
thd 1288, proto sphinxql, state query, command select
thd 1289, proto sphinxql, state query, command select
thd 1290, proto sphinxql, state query, command select
thd 1291, proto sphinxql, state query, command select
thd 1292, proto sphinxql, state query, command select
thd 1293, proto sphinxql, state query, command select
thd 1294, proto sphinxql, state query, command select
thd 1295, proto sphinxql, state query, command select
thd 1296, proto sphinxql, state query, command select
thd 1297, proto sphinxql, state query, command select
thd 1298, proto sphinxql, state query, command select
thd 1299, proto sphinxql, state query, command select
thd 1300, proto sphinxql, state query, command select
thd 1301, proto sphinxql, state query, command select
thd 1302, proto sphinxql, state query, command select
thd 1303, proto sphinxql, state query, command select
thd 1304, proto sphinxql, state query, command select
thd 1305, proto sphinxql, state query, command select
thd 1306, proto sphinxql, state query, command select
thd 1307, proto sphinxql, state query, command select
thd 1308, proto sphinxql, state query, command select
thd 1309, proto sphinxql, state query, command select
thd 1310, proto sphinxql, state query, command select
thd 1311, proto sphinxql, state query, command select
thd 1312, proto sphinxql, state query, command select
thd 1313, proto sphinxql, state query, command select
thd 1314, proto sphinxql, state query, command select
thd 1315, proto sphinxql, state query, command select
thd 1316, proto sphinxql, state query, command select
thd 1317, proto sphinxql, state query, command select
thd 1318, proto sphinxql, state query, command select
thd 1319, proto sphinxql, state query, command select
thd 1320, proto sphinxql, state query, command select
thd 1321, proto sphinxql, state query, command select
thd 1322, proto sphinxql, state query, command select
thd 1323, proto sphinxql, state query, command select
thd 1324, proto sphinxql, state query, command select
thd 1325, proto sphinxql, state query, command select
thd 1326, proto sphinxql, state query, command select
thd 1327, proto sphinxql, state query, command select
thd 1328, proto sphinxql, state query, command select
thd 1329, proto sphinxql, state query, command select
thd 1330, proto sphinxql, state query, command select
thd 1331, proto sphinxql, state query, command select
thd 1332, proto sphinxql, state query, command select
thd 1333, proto sphinxql, state query, command select
thd 1334, proto sphinxql, state query, command select
thd 1335, proto sphinxql, state query, command select
thd 1336, proto sphinxql, state query, command select
thd 1337, proto sphinxql, state query, command select
thd 1338, proto sphinxql, state query, command select
thd 1339, proto sphinxql, state query, command select
thd 1340, proto sphinxql, state query, command select
thd 1341, proto sphinxql, state query, command select
thd 1342, proto sphinxql, state query, command select
thd 1343, proto sphinxql, state query, command select
thd 1344, proto sphinxql, state query, command select
thd 1345, proto sphinxql, state query, command select
thd 1346, proto sphinxql, state query, command select
thd 1347, proto sphinxql, state query, command select
thd 1348, proto sphinxql, state query, command select
thd 1349, proto sphinxql, state query, command select
thd 1350, proto sphinxql, state query, command select
thd 1351, proto sphinxql, state query, command select
thd 1352, proto sphinxql, state query, command select
thd 1353, proto sphinxql, state query, command select
thd 1354, proto sphinxql, state query, command select
thd 1355, proto sphinxql, state query, command select
thd 1356, proto sphinxql, state query, command select
thd 1357, proto sphinxql, state query, command select
thd 1358, proto sphinxql, state query, command select
thd 1359, proto sphinxql, state query, command select
thd 1360, proto sphinxql, state query, command select
thd 1361, proto sphinxql, state query, command select
------- CRASH DUMP END -------
Config file:
searchd
{
listen = 12.102.23.234:9312
listen = 12.102.23.234:9306:mysql41
listen = 12.102.23.234:9360-9370:replication
log = /var/log/manticore/searchd.log
#query_log = /var/log/manticore/query.log
query_log = /sdb/manticore/log/query.log
read_timeout = 5
net_workers = 32
max_children = 10000
listen_backlog = 200
shutdown_timeout = 60m
persistent_connections_limit = 5000
read_buffer = 1M
pid_file = /var/run/manticore/searchd.pid
seamless_rotate = 1
preopen_indexes = 1
unlink_old = 1
binlog_path = #disabled /var/lib/manticore
binlog_flush = 1
#data_dir = /var/lib/manticore/replication
data_dir = /var/lib/manticore/
server_id = 96

    listen                   = 127.0.0.1:9308:http    
    query_log_format = sphinxql

}
is there any known bug for this crash ?
Thanks

The text was updated successfully, but these errors were encountered:

tomatolog · 2020-07-03T07:58:15Z

that crash log is not very informative (it has little stack at crash and no query that causes the crash)

Could you provide full log?
Could you check your dmesg output about this crash?

Are you sure that you box has 10k cores CPU as you defined at daemon option max_children = 10000 ?

tomindo · 2020-07-04T03:41:21Z

dmesg doesn't show any suspicious. Also , here are some additional log right after the crash dump
[Thu Jul 2 12:01:47.452 2020] [42543] WARNING: failed to send data (client=a.b.c.114:4098(1435745)), error: 32 'Broken pipe', sock=2190
[Thu Jul 2 12:01:47.458 2020] [38590] WARNING: failed to send data (client=a.b.c.117:6883(1435748)), error: 32 'Broken pipe', sock=2191
[Thu Jul 2 12:01:47.470 2020] [42462] WARNING: failed to send data (client=a.b.c.122:26171(1435753)), error: 32 'Broken pipe', sock=2196
[Thu Jul 2 12:01:47.525 2020] [41426] WARNING: failed to send data (client=a.b.c.120:43440(1435757)), error: 32 'Broken pipe', sock=2195
[Thu Jul 2 12:01:47.534 2020] [42475] WARNING: failed to send data (client=a.b.c.249:63231(1435759)), error: 32 'Broken pipe', sock=2197
[Thu Jul 2 12:01:47.543 2020] [40281] WARNING: failed to send data (client=a.b.c.120:43458(1435760)), error: 32 'Broken pipe', sock=2198
[Thu Jul 2 12:01:47.561 2020] [42051] WARNING: failed to send data (client=a.b.c.116:24349(1435765)), error: 32 'Broken pipe', sock=2199
[Thu Jul 2 12:01:47.568 2020] [38894] WARNING: failed to send data (client=a.b.c.248:19126(1435767)), error: 32 'Broken pipe', sock=2202
[Thu Jul 2 12:01:47.586 2020] [39849] WARNING: failed to send data (client=a.b.c.248:19143(1435768)), error: 32 'Broken pipe', sock=2203
[Thu Jul 2 12:01:47.593 2020] [39799] WARNING: failed to send data (client=a.b.c.249:63262(1435769)), error: 32 'Broken pipe', sock=2204
[Thu Jul 2 12:01:52.151 2020] [42208] WARNING: failed to send data (client=a.b.c.120:43490(1435774)), error: 32 'Broken pipe', sock=2207
[Thu Jul 2 12:01:52.485 2020] [39094] WARNING: failed to send data (client=a.b.c.118:12882(1435777)), error: 32 'Broken pipe', sock=2209
[Thu Jul 2 12:01:52.495 2020] [39855] WARNING: failed to send data (client=a.b.c.114:4177(1435781)), error: 32 'Broken pipe', sock=2211
[Thu Jul 2 12:01:52.504 2020] [37785] WARNING: failed to send data (client=a.b.c.6:50744(1435782)), error: 32 'Broken pipe', sock=2212
[Thu Jul 2 12:01:52.511 2020] [40930] WARNING: failed to send data (client=a.b.c.120:43503(1435784)), error: 32 'Broken pipe', sock=2214
[Thu Jul 2 12:01:58.147 2020] [39105] WARNING: failed to send data (client=a.b.c.3:35576(1435396)), error: 32 'Broken pipe', sock=1976
[Thu Jul 2 12:01:58.153 2020] [40074] WARNING: failed to send data (client=a.b.c.10:15898(1435403)), error: 32 'Broken pipe', sock=1982
[Thu Jul 2 12:01:58.167 2020] [40014] WARNING: failed to send data (client=a.b.c.123:56434(1435404)), error: 32 'Broken pipe', sock=1983
[Thu Jul 2 12:01:58.167 2020] [39648] WARNING: failed to send data (client=a.b.c.122:25693(1435409)), error: 32 'Broken pipe', sock=1988
[Thu Jul 2 12:01:58.168 2020] [40296] WARNING: failed to send data (client=a.b.c.9:7726(1435411)), error: 32 'Broken pipe', sock=1858
[Thu Jul 2 12:01:58.176 2020] [41732] WARNING: failed to send data (client=a.b.c.252:48207(1435412)), error: 32 'Broken pipe', sock=1880
[Thu Jul 2 12:01:58.400 2020] [38100] WARNING: failed to send data (client=a.b.c.249:63302(1435787)), error: 32 'Broken pipe', sock=1835
[Thu Jul 2 12:01:58.417 2020] [38730] WARNING: failed to send data (client=a.b.c.5:16382(1435794)), error: 32 'Broken pipe', sock=1883
[Thu Jul 2 12:02:05.233 2020] [37890] WARNING: failed to send data (client=a.b.c.248:19196(1435798)), error: 32 'Broken pipe', sock=1888
[Thu Jul 2 12:02:05.407 2020] [38148] WARNING: failed to send data (client=a.b.c.250:33688(1435803)), error: 32 'Broken pipe', sock=1905
[Thu Jul 2 12:02:05.567 2020] [42061] WARNING: failed to send data (client=a.b.c.123:57078(1435806)), error: 32 'Broken pipe', sock=1916
[Thu Jul 2 12:02:05.577 2020] [42270] WARNING: failed to send data (client=a.b.c.6:50886(1435807)), error: 32 'Broken pipe', sock=2216
[Thu Jul 2 12:02:05.617 2020] [39772] WARNING: failed to send data (client=a.b.c.114:4254(1435811)), error: 32 'Broken pipe', sock=2219
[Thu Jul 2 12:02:05.696 2020] [42565] WARNING: failed to send data (client=a.b.c.5:16438(1435813)), error: 32 'Broken pipe', sock=2221
[Thu Jul 2 12:02:05.706 2020] [39254] WARNING: failed to send data (client=a.b.c.123:57097(1435814)), error: 32 'Broken pipe', sock=2222
[Thu Jul 2 12:02:09.517 2020] [37988] WARNING: failed to send data (client=a.b.c.6:50920(1435815)), error: 32 'Broken pipe', sock=2223
[Thu Jul 2 12:02:09.525 2020] [41537] WARNING: failed to send data (client=a.b.c.249:63337(1435824)), error: 32 'Broken pipe', sock=2250
[Thu Jul 2 12:02:09.784 2020] [42615] WARNING: failed to send data (client=a.b.c.116:24445(1435825)), error: 32 'Broken pipe', sock=2227
[Thu Jul 2 12:02:09.821 2020] [40560] WARNING: failed to send data (client=a.b.c.8:49864(1435828)), error: 32 'Broken pipe', sock=2244
[Thu Jul 2 12:02:10.389 2020] [38566] WARNING: failed to send data (client=a.b.c.5:16498(1435827)), error: 32 'Broken pipe', sock=2228
[Thu Jul 2 12:02:10.691 2020] [38938] WARNING: failed to send data (client=a.b.c.248:19231(1435829)), error: 32 'Broken pipe', sock=2229
[Thu Jul 2 12:02:10.715 2020] [39416] WARNING: failed to send data (client=a.b.c.116:24465(1435832)), error: 32 'Broken pipe', sock=2231
[Thu Jul 2 12:02:10.807 2020] [42608] WARNING: failed to send data (client=a.b.c.6:50974(1435837)), error: 32 'Broken pipe', sock=2232
[Thu Jul 2 12:02:10.877 2020] [38021] WARNING: failed to send data (client=a.b.c.120:43614(1435839)), error: 32 'Broken pipe', sock=2234
[Thu Jul 2 12:02:10.885 2020] [42183] WARNING: failed to send data (client=a.b.c.123:57178(1435842)), error: 32 'Broken pipe', sock=2235
[Thu Jul 2 12:02:10.893 2020] [38406] WARNING: failed to send data (client=a.b.c.4:56664(1435844)), error: 32 'Broken pipe', sock=2237

tomatolog · 2020-07-06T07:12:56Z

from crash log you provided I can not figure out the root of the crash. I think it might due to resource depleting at your box as 1400 running threads seems unusual scenario.

Could you provide reproducible example or a way how to reproduce such crash?

tomindo · 2020-07-07T19:16:45Z

the other server in the cluster crashed today same error , i noticed the dmesg log:
[1299886.140908] TaskSched[32420]: segfault at fffffffb22096250 ip 00000000006235f7 sp 00007f1afbb22cd0 error 7 in searchd[400000+80d000]

stale · 2020-08-12T06:28:23Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Feel free to re-open the issue in case it becomes actual.

githubmanticore changed the title ~~manticore 3.4.2 crash~~ manticore 3.4.2 crash Jul 6, 2020

githubmanticore added the bug label Jul 6, 2020

githubmanticore added the waiting Waiting for the original poster (in most cases) or something else label Jul 6, 2020

stale bot added the wontfix label Aug 12, 2020

stale bot closed this as completed Aug 15, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

manticore 3.4.2 crash #365

manticore 3.4.2 crash #365

tomindo commented Jul 3, 2020 •

edited by githubmanticore

Loading

tomatolog commented Jul 3, 2020

tomindo commented Jul 4, 2020

tomatolog commented Jul 6, 2020

tomindo commented Jul 7, 2020

stale bot commented Aug 12, 2020

manticore 3.4.2 crash #365

manticore 3.4.2 crash #365

Comments

tomindo commented Jul 3, 2020 • edited by githubmanticore Loading

tomatolog commented Jul 3, 2020

tomindo commented Jul 4, 2020

tomatolog commented Jul 6, 2020

tomindo commented Jul 7, 2020

stale bot commented Aug 12, 2020

tomindo commented Jul 3, 2020 •

edited by githubmanticore

Loading