Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BE crash when perform tpcds query with hive external table #1211

Closed
tiannan-sr opened this issue Nov 11, 2021 · 0 comments · Fixed by #1226
Closed

BE crash when perform tpcds query with hive external table #1211

tiannan-sr opened this issue Nov 11, 2021 · 0 comments · Fixed by #1226
Labels
external/hive type/bug Something isn't working

Comments

@tiannan-sr
Copy link

tiannan-sr commented Nov 11, 2021

Steps to reproduce the behavior (Required)

  1. test environment:
    stability_master
    use test_hive_hdfs_orc_tpcds1t_1636601168286;

  2. perform tpcds query:
    select count(*) from ( select s_acctbal, s_name, n_name, p_partkey, p_mfgr, s_address, s_phone, s_comment from part, supplier, partsupp, nation, region where p_partkey = ps_partkey and s_suppkey = ps_suppkey and p_size = 15 and p_type like '%BRASS' and s_nationkey = n_nationkey and n_regionkey = r_regionkey and r_name = 'EUROPE' and ps_supplycost = ( select min(ps_supplycost) from partsupp, supplier, nation, region where p_partkey = ps_partkey and s_suppkey = ps_suppkey and s_nationkey = n_nationkey and n_regionkey = r_regionkey and r_name = 'EUROPE' ) order by s_acctbal desc, n_name, s_name, p_partkey ) as t1;

Expected behavior (Required)

Returns the correct result set

Real behavior (Required)

BE coredump:
Program terminated with signal 11, Segmentation fault.
#0 0x00007fa51ff38d3c in jni_invoke_nonstatic(JNIEnv_, JavaValue, _jobject*, JNICallType, jmethodID*, JNI_ArgumentPusher*, Thread*) () from /home/disk1/dorisdb/manager-stability/agent/java-se-8u41-ri/jre/lib/amd64/server/libjvm.so
Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.6-13.el7.x86_64 elfutils-libelf-0.176-4.el7.x86_64 elfutils-libs-0.176-4.el7.x86_64 glibc-2.17-324.el7_9.x86_64 libattr-2.4.46-13.el7.x86_64 libcap-2.22-11.el7.x86_64 libgcc-4.8.5-44.el7.x86_64 systemd-libs-219-73.el7_8.9.x86_64 xz-libs-5.2.2-1.el7.x86_64 zlib-1.2.7-18.el7.x86_64
(gdb) bt
#0 0x00007fa51ff38d3c in jni_invoke_nonstatic(JNIEnv
, JavaValue, _jobject*, JNICallType, _jmethodID*, JNI_ArgumentPusher*, Thread*) () from /home/disk1/dorisdb/manager-stability/agent/java-se-8u41-ri/jre/lib/amd64/server/libjvm.so
#1 0x00007fa51ff3ca61 in jni_CallObjectMethodV ()
from /home/disk1/dorisdb/manager-stability/agent/java-se-8u41-ri/jre/lib/amd64/server/libjvm.so
#2 0x0000000002e4bfcc in invokeMethodOnJclass ()
#3 0x0000000002e4c31f in invokeMethod ()
#4 0x0000000002e455bd in hdfsFileGetReadStatistics ()
#5 0x00000000022f9cc3 in starrocks::vectorized::HdfsScanner::update_counter() ()
#6 0x00000000022f9da1 in starrocks::vectorized::HdfsParquetScanner::update_counter() ()
#7 0x00000000022fe645 in starrocks::vectorized::HdfsParquetScanner::do_close(starrocks::RuntimeState*) ()
#8 0x00000000022f9b55 in starrocks::vectorized::HdfsScanner::close(starrocks::RuntimeState*) ()
#9 0x0000000002275947 in starrocks::vectorized::HdfsScanNode::_close_pending_scanners() ()
#10 0x0000000002275f6a in starrocks::vectorized::HdfsScanNode::close(starrocks::RuntimeState*) ()
#11 0x0000000001b3b6c3 in starrocks::PlanFragmentExecutor::close() ()
#12 0x0000000001ae25f4 in starrocks::FragmentExecState::execute() ()
#13 0x0000000001ae62b5 in starrocks::FragmentMgr::exec_actual(std::shared_ptrstarrocks::FragmentExecState, std::function<void (starrocks::PlanFragmentExecutor)> const&) ()
#14 0x0000000001c08a69 in starrocks::ThreadPool::dispatch_thread() ()
#15 0x0000000001c172f5 in starrocks::Thread::supervise_thread(void*) ()
#16 0x00007fa51f6aaea5 in start_thread () from /lib64/libpthread.so.0
#17 0x00007fa51eaaf9fd in clone () from /lib64/libc.so.6
(gdb)

StarRocks version (Required)

  • You can get the StarRocks version by executing SQL select current_version()
    mysql> select current_version();
    +-------------------+
    | current_version() |
    +-------------------+
    | UNKNOWN a315975 |
    +-------------------+
    1 row in set (0.19 sec)
@tiannan-sr tiannan-sr added type/bug Something isn't working external/hive labels Nov 11, 2021
caneGuy pushed a commit to caneGuy/starrocks that referenced this issue Mar 28, 2023
* Update SparkLoad.md

* Update SparkLoad.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
external/hive type/bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant