Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crash dump #443

Closed
KarelWintersky opened this issue Nov 9, 2020 · 2 comments
Closed

Crash dump #443

KarelWintersky opened this issue Nov 9, 2020 · 2 comments
Labels

Comments

@KarelWintersky
Copy link
Contributor

KarelWintersky commented Nov 9, 2020

Describe the bug

[Mon Nov  9 18:17:11.581 2020] [23878] watchdog: main process 23879 exited cleanly (exit code 0), shutting down  
[Mon Nov  9 18:17:11.581 2020] [23878] watchdog: got error 10, No child processes  
[Mon Nov  9 18:18:52.715 2020] [17005] watchdog: main process 17006 forked ok  
[Mon Nov  9 18:18:52.717 2020] [17006] listening on 127.0.0.1:9312 for sphinx and http(s)  
[Mon Nov  9 18:18:52.717 2020] [17006] listening on 127.0.0.1:9306 for mysql  
[Mon Nov  9 18:18:52.951 2020] [17006] accepting connections  
[Mon Nov  9 18:18:52.951 2020] [17017] prereading 13 indexes  
[Mon Nov  9 18:18:53.092 2020] [17017] prereaded 13 indexes in 0.141 sec  
[Mon Nov  9 18:24:20.582 2020] [17009] rt: index rt_47newsru_articles: diskchunk 15(1), segments 32 saved in 5.091 sec  
  
  
------- FATAL: CRASH DUMP -------  
[Mon Nov  9 18:57:35.790 2020] [21583]  
  
--- crashed invalid query ---  
  
--- request dump end ---  
--- local index:  
Manticore 3.4.2 69033058@200410 release  
Handling signal 11  
-------------- backtrace begins here ---------------  
Program compiled with 8  
Configured with flags: Configured by CMake with these definitions: -DCMAKE_BUILD_TYPE=RelWithDebInfo -DDISTR_BUILD=buster -DUSE_SSL=ON -DDL_UNIXODBC=1 -DUNIXODBC_LIB=libodbc.so.2 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DUSE_LI  
Host OS is Linux runner-0277ea0f-project-3858465-concurrent-0 4.19.78-coreos #1 SMP Mon Oct 14 22:56:39 -00 2019 x86_64 GNU/Linux  
Stack bottom = 0x7fd890208e9f, thread stack size = 0x100000  
Trying manual backtrace:  
Frame pointer is null, manual backtrace failed (did you build with -fomit-frame-pointer?)  
Trying system backtrace:  
begin of system symbols:  
/usr/bin/searchd(_Z12sphBacktraceib 0x9b)[0x55694999efcb]  
/usr/bin/searchd(_ZN16SphCrashLogger_c11HandleCrashEi 0x20a)[0x556949817aca]  
/lib/x86_64-linux-gnu/libpthread.so.0( 0x12730)[0x7fd8a0ac7730]  
/usr/bin/searchd( 0x4e7950)[0x556949aa8950]  
/usr/bin/searchd(_ZNK12Filter_RangeILb1ELb0ELb1ELb0EE4EvalERK9CSphMatch 0x24)[0x556949ab0794]  
/usr/bin/searchd(_ZNK13CSphIndex_VLN11EarlyRejectEP16CSphQueryContextR9CSphMatch 0x4d)[0x5569498fa40d]  
/usr/bin/searchd(_ZN11ExtRanker_TILb1EE15GetFilteredDocsEv 0xe8)[0x556949abba38]  
/usr/bin/searchd(_ZN21ExtRanker_WeightSum_cILb1EE10GetMatchesEv 0x134)[0x556949ac1eb4]  
/usr/bin/searchd(_ZNK13CSphIndex_VLN13MatchExtendedILb1ELb0ELb0EEEvP16CSphQueryContextPK9CSphQueryiPP15ISphMatchSorterP10ISphRankerii 0x8b)[0x55694994ebfb]  
/usr/bin/searchd(_ZNK13CSphIndex_VLN16ParsedMultiQueryEPK9CSphQueryP15CSphQueryResultiPP15ISphMatchSorterRK9XQQuery_tP8CSphDictRK18CSphMultiQueryArgsP18CSphQueryNodeCache 0xedd)[0x556949912aad]  
/usr/bin/searchd(_ZNK13CSphIndex_VLN10MultiQueryEPK9CSphQueryP15CSphQueryResultiPP15ISphMatchSorterRK18CSphMultiQueryArgs 0x5e1)[0x556949936fb1]  
/usr/bin/searchd( 0x52cf73)[0x556949aedf73]  
/usr/bin/searchd(_ZN7Threads19CompletionHandler_cISt8functionIFvvEEE10DoCompleteEPvPNS_20SchedulerOperation_tE 0x5b)[0x556949bb2c3b]  
/usr/bin/searchd(_ZNSt17_Function_handlerIFvvEZN7Threads12ThreadPool_c6Impl_tC4EmPKcEUlvE_E9_M_invokeERKSt9_Any_data 0xf6)[0x556949bb2866]  
/usr/bin/searchd( 0x5ee506)[0x556949baf506]  
/usr/bin/searchd(_Z20sphThreadProcWrapperPv 0x23)[0x5569499a6933]  
/lib/x86_64-linux-gnu/libpthread.so.0( 0x7fa3)[0x7fd8a0abcfa3]  
/lib/x86_64-linux-gnu/libc.so.6(clone 0x3f)[0x7fd8a01264cf]  
-------------- backtrace ends here ---------------  
Please, create a bug report in our bug tracker (https://github.com/manticoresoftware/manticore/issues)  
and attach there:  
a) searchd log, b) searchd binary, c) searchd symbols.  
Look into the chapter 'Reporting bugs' in the documentation  
(http://docs.manticoresearch.com/latest/html/reporting_bugs.html)  
Dump with GDB via watchdog  
[Mon Nov  9 18:57:36.158 2020] [21582] watchdog: got USR1, performing dump of child's stack  
Will run gdb on '/usr/bin/searchd', pid '21583'  
--- 2 active threads ---  
thd 0, proto sphinxql, state query, command select  
thd 1, proto sphinxql, state query, command select  
------- CRASH DUMP END -------  
  
  
[Mon Nov  9 18:57:39.226 2020] [21582] watchdog: main process 21583 crashed via CRASH_EXIT (exit code 2), will be restarted  
[Mon Nov  9 18:57:39.226 2020] [21582] watchdog: got error 10, No child processes  
[Mon Nov  9 18:57:39.227 2020] [21582] watchdog: main process 18919 forked ok  
[Mon Nov  9 18:57:39.234 2020] [18919] FATAL: failed to lock pid file '/var/run/manticore/searchd.pid': Resource temporarily unavailable (searchd already running?)  
[Mon Nov  9 18:57:42.244 2020] [18919] shutdown complete  
  

Describe the environment:

  • Manticore Search version - Manticore 3.5.2 8b2c175@201002 release
  • OS version: Linux source 4.19.0-10-amd64 #1 SMP Debian 4.19.132-1 (2020-07-24) x86_64 GNU/Linux

Messages from log files:
Messages from searchd.log and query.log (if applicable).

Additional context
Всё что могу сказать - искали "Зеленский".

@KarelWintersky
Copy link
Contributor Author

Почему в логе версия 3.4.2 , а на сервере 3.5.2 - объяснить не могу.

Делали

sudo systemctl stop manticore
sudo dpkg --remove manticore-bin
sudo dpkg --install manticore_3.5.2.deb
sudo systemctl start manticore

и получили в логах:

[Mon Nov  9 18:17:08.806 2020] [23879] caught SIGTERM, shutting down
[Mon Nov  9 18:17:09.535 2020] [23879] rt: index rt_47newsru_articles: ramchunk saved in 0.699 sec
... (другие индексы, аналогичные строчки)
[Mon Nov  9 18:17:11.533 2020] [23879] shutdown complete
[Mon Nov  9 18:17:11.581 2020] [23878] watchdog: main process 23879 exited cleanly (exit code 0), shutting down
[Mon Nov  9 18:17:11.581 2020] [23878] watchdog: got error 10, No child processes

@sanikolaev
Copy link
Collaborator

This might have been already fixed in 3.5.2, so I'm closing the issue. If you can reproduce it in 3.5.2+ please reopen.

🇷🇺 Закрываю, т.к. в 3.5.2 возможно уже пофикшено. Переоткройте, если удастся повторить в 3.5.2+

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants