Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JVM crash with grpc-netty-shaded 1.54.x and alpine docker image #10947

Closed
Hemadri513 opened this issue Feb 23, 2024 · 3 comments
Closed

JVM crash with grpc-netty-shaded 1.54.x and alpine docker image #10947

Hemadri513 opened this issue Feb 23, 2024 · 3 comments
Labels

Comments

@Hemadri513
Copy link

Hemadri513 commented Feb 23, 2024

An attempt to upgrade from grpc-netty-shaded 1.44.1 to 1.54.0 ends with a JVM crash.

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00000000000207d6, pid=20, tid=0x00007f6350d11b20
#
# JRE version: OpenJDK Runtime Environment (8.0_275-b01) (build 1.8.0_275-b01)
# Java VM: OpenJDK 64-Bit Server VM (25.275-b01 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 3.17.1
# Distribution: Custom build (Mon Feb 15 21:48:28 UTC 2021)
# Problematic frame:
# C  0x00000000000207d6
#
# Core dump written. Default location: /app/jetty/core or core.20
#
# An error report file with more information is saved as:
# /app/jetty/hs_err_pid20.log
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
#   https://icedtea.classpath.org/bugzilla
#
Aborted (core dumped)

I tried the below approaches:-

Solution 1: A suggested workaround solution for issues encountered while using GRPC on Alpine:

Reference: #8751

RUN apk add gcompat
ENV LD_PRELOAD=/lib/libgcompat.so.0

After applying the fix, the Java crash issue has been resolved. However, it has introduced a new problem where we encounter the exception java.net.UnknownHostException: contentrights: Name does not resolve.

Solution 2 (Attempted Solution): Some GRPC Git repositories suggest upgrading the GRPC Netty Shaded version. Therefore, I updated to the latest version, GRPC Netty Shaded (1.61.0). Despite upgrading to the latest GRPC Netty Shaded version, the same issue persists.

Reference: #10096

Solution 3:- And tried to include netty-tcnative-alpine version. with suggested dependency version.

https://github.com/grpc/grpc-java/blob/master/SECURITY.md#netty
googleapis/google-cloud-java#3536

but still, we are getting the same exceptions again and again, A fatal error that has been detected by the Java Runtime Environment

can anyone please help me to resolve this error?

@ejona86 can you please take a look

And attaching the dump logs also.

---------------  T H R E A D  ---------------

Current thread (0x00005577cba3f000):  JavaThread "lwsEnforceRestriction 1" [_thread_in_native, id=346, stack(0x00007f6350c11000,0x00007f6350d11ae0)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x00000000000207d6

Registers:
RAX=0x0000000000010006, RBX=0x00005577cba3f250, RCX=0x00005577cd273500, RDX=0x00007f638d36f66c
RSP=0x00007f6350d0e498, RBP=0x00007f6350d0e4e0, RSI=0x0000000000000014, RDI=0x00005577c8309f80
R8 =0x00007f6350d0e308, R9 =0x00007f6350d0e310, R10=0x00005577c8f39e98, R11=0x0000000000000002
R12=0x00005577c8f36ba0, R13=0x00005577c8f39300, R14=0x00005577c8309f80, R15=0x00005577c8f36c00
RIP=0x00000000000207d6, EFLAGS=0x0000000000010202, CSGSFS=0x002b000000000033, ERR=0x0000000000000014
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007f6350d0e498)
0x00007f6350d0e498:   00007f634fd5e193 00007f6350d0e4e0
0x00007f6350d0e4a8:   0000000000000000 00005577c8309f80
0x00007f6350d0e4b8:   00005577cba3f250 00005577c8309f80
0x00007f6350d0e4c8:   00007f634fd59d90 00005577c830a238
0x00007f6350d0e4d8:   0000000000000000 00007f6350d0e540
0x00007f6350d0e4e8:   00007f634fd5a00a 00007f6350d0e540
0x00007f6350d0e4f8:   00007f6350d0e554 0000000000000015
0x00007f6350d0e508:   00007f634fed896c 00005577c830a0c0
0x00007f6350d0e518:   0000000000000000 00007f634fed896c
0x00007f6350d0e528:   00007f634fd59d90 00005577c830a238
0x00007f6350d0e538:   00005577c830a0c0 00007f6350d0e5a0
0x00007f6350d0e548:   00007f634fd5eb44 00000000c8309100
0x00007f6350d0e558:   00005577cba3f250 00005577c830a238
0x00007f6350d0e568:   00007f634fd35000 0000000000000000
0x00007f6350d0e578:   0000000000000000 0000000000000000
0x00007f6350d0e588:   00005577c8309220 00007f6350d0e7b0
0x00007f6350d0e598:   00007f6350d0e7b8 00007f6350d0e5b0
0x00007f6350d0e5a8:   00007f634fd5a54e 00005577cba3f250
0x00007f6350d0e5b8:   00007f638c7dfafe 00007f634fd5a530
0x00007f6350d0e5c8:   00007f6350d0e620 00007f6350d0e630
0x00007f6350d0e5d8:   00007f638d344000 00005577cba3f000
0x00007f6350d0e5e8:   00007f638ce8a81b 00000004864385e0
0x00007f6350d0e5f8:   00005577cc5a7a30 000000000000000e
0x00007f6350d0e608:   0000000450d0e450 00007f636944de60
0x00007f6350d0e618:   00005577cba3f000 00007f636944de60
0x00007f6350d0e628:   00005577cba3f000 0000000000000000
0x00007f6350d0e638:   000000048643e8b8 000055000000001e
0x00007f6350d0e648:   00007f638d44b8a0 000000048643e390
0x00007f6350d0e658:   00005577cba3f250 00005577c8309fe0
0x00007f6350d0e668:   00007f638d41516e 00007f6350d0e688
0x00007f6350d0e678:   00000004864301c0 000000048643e7b0
0x00007f6350d0e688:   00007f6350d0e638 00007f6350d0e679 

Instructions: (pc=0x00000000000207d6)
0x00000000000207b6:   
[error occurred during error reporting (printing registers, top of stack, instructions near pc), id 0xb]

Register to memory mapping:

RAX=0x0000000000010006 is an unknown value
RBX=0x00005577cba3f250 is an unknown value
RCX=0x00005577cd273500 is an unknown value
RDX=0x00007f638d36f66c: <offset 0x8f266c> in /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so at 0x00007f638ca7d000
RSP=0x00007f6350d0e498 is pointing into the stack for thread: 0x00005577cba3f000
RBP=0x00007f6350d0e4e0 is pointing into the stack for thread: 0x00005577cba3f000
RSI=0x0000000000000014 is an unknown value
RDI=0x00005577c8309f80 is an unknown value
R8 =0x00007f6350d0e308 is pointing into the stack for thread: 0x00005577cba3f000
R9 =0x00007f6350d0e310 is pointing into the stack for thread: 0x00005577cba3f000
R10=0x00005577c8f39e98 is an unknown value
R11=0x0000000000000002 is an unknown value
R12=0x00005577c8f36ba0 is an unknown value
R13=0x00005577c8f39300 is an unknown value
R14=0x00005577c8309f80 is an unknown value
R15=0x00005577c8f36c00 is an unknown value


Stack: [0x00007f6350c11000,0x00007f6350d11ae0],  sp=0x00007f6350d0e498,  free space=1013k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  0x00000000000207d6
C  [libio_grpc_netty_shaded_netty_tcnative_linux_x86_647164261382416403313.so+0x2500a]  _init+0x4cc2
C  [libio_grpc_netty_shaded_netty_tcnative_linux_x86_647164261382416403313.so+0x29b44]  netty_jni_util_JNI_OnLoad+0x74
C  [libio_grpc_netty_shaded_netty_tcnative_linux_x86_647164261382416403313.so+0x2554e]  JNI_OnLoad+0x1e
C  [libjava.so+0xeafe]  Java_java_lang_ClassLoader_00024NativeLibrary_load+0xae

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+0
j  java.lang.ClassLoader.loadLibrary0(Ljava/lang/Class;Ljava/io/File;)Z+328
j  java.lang.ClassLoader.loadLibrary(Ljava/lang/Class;Ljava/lang/String;Z)V+70
j  java.lang.Runtime.load0(Ljava/lang/Class;Ljava/lang/String;)V+57
j  java.lang.System.load(Ljava/lang/String;)V+7
j  io.grpc.netty.shaded.io.netty.util.internal.NativeLibraryUtil.loadLibrary(Ljava/lang/String;Z)V+5
v  ~StubRoutines::call_stub
J 4475  sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0x00007f637ddb9a77 [0x00007f637ddb9a00+0x77]
J 11081 C1 sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (104 bytes) @ 0x00007f637f41eb14 [0x00007f637f41d940+0x11d4]
J 6129 C2 java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (62 bytes) @ 0x00007f637e9437e8 [0x00007f637e943740+0xa8]
j  io.grpc.netty.shaded.io.netty.util.internal.NativeLibraryLoader$1.run()Ljava/lang/Object;+53
v  ~StubRoutines::call_stub
J 571  java.security.AccessController.doPrivileged(Ljava/security/PrivilegedAction;)Ljava/lang/Object; (0 bytes) @ 0x00007f637d98130f [0x00007f637d9812c0+0x4f]
j  io.grpc.netty.shaded.io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(Ljava/lang/Class;Ljava/lang/String;Z)V+10
j  io.grpc.netty.shaded.io.netty.util.internal.NativeLibraryLoader.loadLibrary(Ljava/lang/ClassLoader;Ljava/lang/String;Z)V+15
j  io.grpc.netty.shaded.io.netty.util.internal.NativeLibraryLoader.load(Ljava/lang/String;Ljava/lang/ClassLoader;)V+352
j  io.grpc.netty.shaded.io.netty.util.internal.NativeLibraryLoader.loadFirstAvailable(Ljava/lang/ClassLoader;[Ljava/lang/String;)V+33
j  io.grpc.netty.shaded.io.netty.handler.ssl.OpenSsl.loadTcNative()V+307
j  io.grpc.netty.shaded.io.netty.handler.ssl.OpenSsl.<clinit>()V+183
v  ~StubRoutines::call_stub
j  io.grpc.netty.shaded.io.grpc.netty.GrpcSslContexts.defaultSslProvider()Lio/grpc/netty/shaded/io/netty/handler/ssl/SslProvider;+0
j  io.grpc.netty.shaded.io.grpc.netty.GrpcSslContexts.configure(Lio/grpc/netty/shaded/io/netty/handler/ssl/SslContextBuilder;)Lio/grpc/netty/shaded/io/netty/handler/ssl/SslContextBuilder;+1
j  io.grpc.netty.shaded.io.grpc.netty.GrpcSslContexts.forClient()Lio/grpc/netty/shaded/io/netty/handler/ssl/SslContextBuilder;+3
j  com.cts.d2cmodules.grpc.client.GrpcClientChannelFactory.maybeEnableTls(Lio/grpc/netty/shaded/io/grpc/netty/NettyChannelBuilder;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;)V+106
j  com.cts.d2cmodules.grpc.client.GrpcClientChannelFactory.managedChannelFor(Lcom/typesafe/config/Config;)Lio/grpc/Channel;+167
j  com.cts.d2cmodules.grpc.client.AbstractGrpcClient.<init>(Lcom/typesafe/config/Config;)V+114
j  client.GrantDenyServiceClient.<init>(Lcom/typesafe/config/Config;)V+8
j  com.cts.grantdeny.client.GrantDenyClientFactory$gdsClient$2.invoke()Lclient/GrantDenyServiceClient;+17
j  com.cts.grantdeny.client.GrantDenyClientFactory$gdsClient$2.invoke()Ljava/lang/Object;+1
j  kotlin.SynchronizedLazyImpl.getValue()Ljava/lang/Object;+51
j

<internal packages removed due to security reasons?


j  com.theplatform.module.pipeline.Phase.execute(Lcom/theplatform/module/pipeline/PhaseContext;Lcom/theplatform/module/pipeline/NextPhaseTrigger;Lcom/theplatform/module/pipeline/thread/PrePhaseExecutionStatistics;)V+38
j  com.theplatform.selector.pipeline.phase.StatusReportingPhase.execute(Lcom/theplatform/selector/pipeline/context/AbstractPhaseContext;Lcom/theplatform/module/pipeline/NextPhaseTrigger;Lcom/theplatform/module/pipeline/thread/PrePhaseExecutionStatistics;)V+113
j  com.theplatform.selector.pipeline.phase.StatusReportingPhase.execute(Lcom/theplatform/module/pipeline/PhaseContext;Lcom/theplatform/module/pipeline/NextPhaseTrigger;Lcom/theplatform/module/pipeline/thread/PrePhaseExecutionStatistics;)V+7
j  com.theplatform.module.pipeline.thread.PhaseExecution.run()V+138
j  com.theplatform.module.pipeline.thread.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+59
j  com.theplatform.module.pipeline.thread.ThreadPoolExecutor$Worker.run()V+68
J 4792 C1 java.lang.Thread.run()V (17 bytes) @ 0x00007f637dd14c84 [0x00007f637dd14b40+0x144]
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
=>0x00005577cba3f000 JavaThread "lwsEnforceRestriction 1" [_thread_in_native, id=346, stack(0x00007f6350c11000,0x00007f6350d11ae0)]
  0x00005577c9afb000 JavaThread "Notification Client - Selector" [_thread_in_native, id=345, stack(0x00007f6350fa6000,0x00007f63510a6ae0)]
  0x00005577c8c24000 JavaThread "enforcePolicy 1" [_thread_blocked, id=344, stack(0x00007f63510a7000,0x00007f63511a7ae0)]
  0x00005577cdba8000 JavaThread "validateIpAddress 1" [_thread_blocked, id=343, stack(0x00007f63511a8000,0x00007f63512a8ae0)]
  0x00005577ce6b6000 JavaThread "fulfillAccountBillingCode 1" [_thread_blocked, id=342, stack(0x00007f63512a9000,0x00007f63513a9ae0)]
  0x00005577cc474000 JavaThread "fulfillRegistryByAccountCache 1" [_thread_blocked, id=341, stack(0x00007f63513aa000,0x00007f63514aaae0)]
  0x00005577cc846800 JavaThread "Notification Client - Selector]]" [_thread_in_native, id=340, stack(0x00007f63514ab000,0x00007f63515abae0)]
  0x00005577c8cec800 JavaThread "fulfillMediaCache 1" [_thread_blocked, id=339, stack(0x00007f63516a8000,0x00007f63517a8ae0)]
  0x00005577cb9ce800 JavaThread "fulfillRegistryCache 1" [_thread_blocked, id=338, stack(0x00007f63531df000,0x00007f63532dfae0)]
  0x00005577c9bc1000 JavaThread "checkRegistryCache 1" [_thread_blocked, id=337, stack(0x00007f63534e2000,0x00007f63535e2ae0)]
  0x00005577c9d17800 JavaThread "prometheus-http-1-5" [_thread_blocked, id=336, stack(0x00007f63517a9000,0x00007f63518a9ae0)]
  0x00005577c788a800 JavaThread "prometheus-http-1-4" [_thread_blocked, id=335, stack(0x00007f63518aa000,0x00007f63519aaae0)]
  0x00005577c920f800 JavaThread "prometheus-http-1-3" [_thread_blocked, id=334, stack(0x00007f63519ab000,0x00007f6351aabae0)]
  0x00005577c9cda800 JavaThread "prometheus-http-1-2" [_thread_blocked, id=333, stack(0x00007f6351aac000,0x00007f6351bacae0)]
  0x00005577cf127000 JavaThread "prometheus-http-1-1" [_thread_blocked, id=332, stack(0x00007f635659a000,0x00007f635669aae0)]
  0x00005577cd5f3800 JavaThread "DestroyJavaVM" [_thread_blocked, id=21, stack(0x00007f638c813000,0x00007f638c913ae0)]
  0x00005577cd411000 JavaThread "CfCidrReloadTimer" daemon [_thread_blocked, id=331, stack(0x00007f6351fad000,0x00007f63520adae0)]
  0x00005577cf201800 JavaThread "Notification Client - AccountCacheUpdateListener-100.123.101.136" [_thread_in_native, id=329, stack(0x00007f6352577000,0x00007f6352677ae0)]
  0x00005577cd477800 JavaThread "Thread-264" [_thread_blocked, id=328, stack(0x00007f63521c1000,0x00007f63522c1ae0)]
  0x00005577cabe1800 JavaThread "pool-9-thread-1" [_thread_blocked, id=327, stack(0x00007f63520ae000,0x00007f63521aeae0)]
  0x00005577c8320800 JavaThread "Report Logger" [_thread_blocked, id=326, stack(0x00007f6352cdc000,0x00007f6352ddcae0)]
  0x00005577cbdf4800 JavaThread "metrics-graphite-reporter-1-thread-1" daemon [_thread_blocked, id=325, stack(0x00007f6352923000,0x00007f6352a23ae0)]
  0x00005577c81cd800 JavaThread "Thread-262" [_thread_in_native, id=324, stack(0x00007f6352ddd000,0x00007f6352eddae0)]
  0x00005577cc66a000 JavaThread "server-timer1" daemon [_thread_blocked, id=323, stack(0x00007f6352ede000,0x00007f6352fdeae0)]
  0x00005577ccd5e800 JavaThread "server-timer" daemon [_thread_blocked, id=322, stack(0x00007f63537e5000,0x00007f63538e5ae0)]
  0x00005577cbcba800 JavaThread "RMI RenewClean-[127.0.0.1:11201]" daemon [_thread_blocked, id=320, stack(0x00007f63532e0000,0x00007f63533e0ae0)]
  0x00005577cd46b000 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=319, stack(0x00007f63533e1000,0x00007f63534e1ae0)]
  0x00005577caa63000 JavaThread "GC Daemon" daemon [_thread_blocked, id=317, stack(0x00007f63535e3000,0x00007f63536e3ae0)]
  0x00005577ccb95000 JavaThread "RMI Reaper" [_thread_blocked, id=316, stack(0x00007f63536e4000,0x00007f63537e4ae0)]
  0x00005577cc48a000 JavaThread "RMI TCP Accept-11201" daemon [_thread_in_native, id=314, stack(0x00007f6353b12000,0x00007f6353c12ae0)]
  0x00005577cc5a3000 JavaThread "dd-jmx-collector" daemon [_thread_blocked, id=313, stack(0x00007f6353e13000,0x00007f6353f13ae0)]
  0x00005577cd7df800 JavaThread "StatsD-Sender-1" daemon [_thread_blocked, id=312, stack(0x00007f6353f14000,0x00007f6354014ae0)]
  0x00005577cd7df000 JavaThread "StatsD-Processor-1" daemon [_thread_blocked, id=311, stack(0x00007f6354015000,0x00007f6354115ae0)]
  0x00005577ca8b0800 JavaThread "statsd-aggregator-thread" daemon [_thread_blocked, id=310, stack(0x00007f6354116000,0x00007f6354216ae0)]
  0x00005577cb8fe800 JavaThread "MultiThreadedHttpConnectionManager cleanup" daemon [_thread_blocked, id=309, stack(0x00007f635455a000,0x00007f635465aae0)]
  0x00005577ccdb2000 JavaThread "Attach Listener" daemon [_thread_blocked, id=308, stack(0x00007f6354417000,0x00007f6354517ae0)]
  0x00005577c8948000 JavaThread "ehcacheManager" daemon [_thread_blocked, id=307, stack(0x00007f6354a5b000,0x00007f6354b5bae0)]
  0x00005577cca9c800 JavaThread "net.sf.ehcache.CacheManager@54d35ed5" daemon [_thread_blocked, id=306, stack(0x00007f6354c9d000,0x00007f6354d9dae0)]
  0x00005577cc30e800 JavaThread "defaultAsynchronousEventDispatcher-0" [_thread_blocked, id=305, stack(0x00007f6355286000,0x00007f6355386ae0)]
  0x00005577c996d800 JavaThread "Format client refresh timer - 1708620929461" daemon [_thread_blocked, id=304, stack(0x00007f6355387000,0x00007f6355487ae0)]
  0x00005577c8fa0000 JavaThread "refreshTimer" daemon [_thread_blocked, id=303, stack(0x00007f6354f9e000,0x00007f635509eae0)]
  0x00005577c8fa2800 JavaThread "pool-6-thread-1" [_thread_blocked, id=302, stack(0x00007f635512e000,0x00007f635522eae0)]
  0x00005577c992e000 JavaThread "pool-4-thread-1" [_thread_blocked, id=301, stack(0x00007f6355488000,0x00007f6355588ae0)]
  0x00005577c7f33800 JavaThread "Okio Watchdog" daemon [_thread_blocked, id=299, stack(0x00007f6355873000,0x00007f6355973ae0)]
  0x00005577c7f31800 JavaThread "OkHttp ConnectionPool" daemon [_thread_blocked, id=298, stack(0x00007f6355974000,0x00007f6355a74ae0)]
  0x00005577c8cda000 JavaThread "Scheduler-1164394344-1" [_thread_blocked, id=297, stack(0x00007f63568c1000,0x00007f63569c1ae0)]
  0x00005577c9c44800 JavaThread "Scanner-0" daemon [_thread_blocked, id=296, stack(0x00007f6357036000,0x00007f6357136ae0)]
  0x00005577c9706000 JavaThread "qtp626626764-268" [_thread_blocked, id=295, stack(0x00007f6357337000,0x00007f6357437ae0)]
  0x00005577c9704000 JavaThread "qtp626626764-267" [_thread_in_native, id=294, stack(0x00007f6357438000,0x00007f6357538ae0)]
  0x00005577c9702000 JavaThread "qtp626626764-266" [_thread_blocked, id=293, stack(0x00007f6357539000,0x00007f6357639ae0)]
  0x00005577c9700800 JavaThread "qtp626626764-265" [_thread_in_native, id=292, stack(0x00007f635763a000,0x00007f635773aae0)]
  0x00005577c98a2000 JavaThread "qtp626626764-264" [_thread_blocked, id=291, stack(0x00007f635773b000,0x00007f635783bae0)]
  0x00005577c989f800 JavaThread "qtp626626764-263-acceptor-1@67cdcd19-ServerConnector@7602da1a{HTTP/1.1, (http/1.1)}{0.0.0.0:11200}" [_thread_in_native, id=290, stack(0x00007f635783c000,0x00007f635793cae0)]
  0x00005577c989d800 JavaThread "qtp626626764-262-acceptor-0@53c0f02f-ServerConnector@7602da1a{HTTP/1.1, (http/1.1)}{0.0.0.0:11200}" [_thread_blocked, id=289, stack(0x00007f635793d000,0x00007f6357a3dae0)]
  0x00005577c989b000 JavaThread "qtp626626764-261" [_thread_blocked, id=288, stack(0x00007f6357a3e000,0x00007f6357b3eae0)]
  0x00005577c9899000 JavaThread "qtp626626764-260" [_thread_blocked, id=287, stack(0x00007f6357b3f000,0x00007f6357c3fae0)]
  0x00005577c9765800 JavaThread "qtp626626764-259" [_thread_in_native, id=286, stack(0x00007f6357c40000,0x00007f6357d40ae0)]
  0x00005577c9763000 JavaThread "qtp626626764-258" [_thread_blocked, id=285, stack(0x00007f6357d41000,0x00007f6357e41ae0)]
  0x00005577c9761000 JavaThread "qtp626626764-257" [_thread_blocked, id=284, stack(0x00007f6357e42000,0x00007f6357f42ae0)]
  0x00005577c9771800 JavaThread "qtp626626764-256" [_thread_blocked, id=283, stack(0x00007f6357f43000,0x00007f6358043ae0)]
  0x00005577c976f800 JavaThread "qtp626626764-255" [_thread_blocked, id=282, stack(0x00007f6358044000,0x00007f6358144ae0)]
  0x00005577c976d000 JavaThread "qtp626626764-254" [_thread_blocked, id=281, stack(0x00007f6358145000,0x00007f6358245ae0)]
  0x00005577c976b000 JavaThread "qtp626626764-253" [_thread_blocked, id=280, stack(0x00007f6358246000,0x00007f6358346ae0)]
  0x00005577c9769000 JavaThread "qtp626626764-252" [_thread_blocked, id=279, stack(0x00007f6358347000,0x00007f6358447ae0)]
  0x00005577c9766800 JavaThread "qtp626626764-251" [_thread_blocked, id=278, stack(0x00007f6358448000,0x00007f6358548ae0)]
  0x00005577c98a9000 JavaThread "qtp626626764-250" [_thread_blocked, id=277, stack(0x00007f6358549000,0x00007f6358649ae0)]
  0x00005577c98a6800 JavaThread "qtp626626764-249" [_thread_blocked, id=276, stack(0x00007f635864a000,0x00007f635874aae0)]
  0x00005577c98a4800 JavaThread "qtp626626764-248" [_thread_blocked, id=275, stack(0x00007f635874b000,0x00007f635884bae0)]
  0x00005577c9895000 JavaThread "qtp626626764-247" [_thread_blocked, id=274, stack(0x00007f635884c000,0x00007f635894cae0)]
  0x00005577c9893000 JavaThread "qtp626626764-246" [_thread_blocked, id=273, stack(0x00007f635894d000,0x00007f6358a4dae0)]
  0x00005577c9890800 JavaThread "qtp626626764-245" [_thread_blocked, id=272, stack(0x00007f6358a4e000,0x00007f6358b4eae0)]
  0x00005577c988e800 JavaThread "qtp626626764-244" [_thread_blocked, id=271, stack(0x00007f6358b4f000,0x00007f6358c4fae0)]
  0x00005577c98ad000 JavaThread "qtp626626764-243" [_thread_blocked, id=270, stack(0x00007f6358c50000,0x00007f6358d50ae0)]
  0x00005577c98ab000 JavaThread "qtp626626764-242" [_thread_blocked, id=269, stack(0x00007f6358d51000,0x00007f6358e51ae0)]
  0x00005577c97b0800 JavaThread "qtp626626764-241" [_thread_blocked, id=268, stack(0x00007f6358e52000,0x00007f6358f52ae0)]
  0x00005577c97ae800 JavaThread "qtp626626764-240" [_thread_blocked, id=267, stack(0x00007f6358f53000,0x00007f6359053ae0)]
  0x00005577c97ac800 JavaThread "qtp626626764-239" [_thread_blocked, id=266, stack(0x00007f6359054000,0x00007f6359154ae0)]
  0x00005577c97aa000 JavaThread "qtp626626764-238" [_thread_blocked, id=265, stack(0x00007f6359155000,0x00007f6359255ae0)]
  0x00005577c97bb000 JavaThread "qtp626626764-237" [_thread_blocked, id=264, stack(0x00007f6359256000,0x00007f6359356ae0)]
  0x00005577c97b9000 JavaThread "qtp626626764-236" [_thread_blocked, id=263, stack(0x00007f6359357000,0x00007f6359457ae0)]
  0x00005577c97b7000 JavaThread "qtp626626764-235" [_thread_blocked, id=262, stack(0x00007f6359458000,0x00007f6359558ae0)]
  0x00005577c97b5000 JavaThread "qtp626626764-234" [_thread_blocked, id=261, stack(0x00007f6359559000,0x00007f6359659ae0)]
  0x00005577c97b3000 JavaThread "qtp626626764-233" [_thread_blocked, id=260, stack(0x00007f635965a000,0x00007f635975aae0)]
  0x00005577c97a6800 JavaThread "qtp626626764-232" [_thread_blocked, id=259, stack(0x00007f635975b000,0x00007f635985bae0)]
  0x00005577c97a4000 JavaThread "qtp626626764-231" [_thread_blocked, id=258, stack(0x00007f635985c000,0x00007f635995cae0)]
  0x00005577c972f800 JavaThread "qtp626626764-230" [_thread_blocked, id=257, stack(0x00007f635995d000,0x00007f6359a5dae0)]
  0x00005577c972d800 JavaThread "qtp626626764-229" [_thread_blocked, id=256, stack(0x00007f6359a5e000,0x00007f6359b5eae0)]
  0x00005577c972b800 JavaThread "qtp626626764-228" [_thread_blocked, id=255, stack(0x00007f6359b5f000,0x00007f6359c5fae0)]
  0x00005577c9729000 JavaThread "qtp626626764-227" [_thread_blocked, id=254, stack(0x00007f6359c60000,0x00007f6359d60ae0)]
  0x00005577c97d5000 JavaThread "qtp626626764-226" [_thread_blocked, id=253, stack(0x00007f6359d61000,0x00007f6359e61ae0)]
  0x00005577c97d3000 JavaThread "qtp626626764-225" [_thread_blocked, id=252, stack(0x00007f6359e62000,0x00007f6359f62ae0)]
  0x00005577c97d1000 JavaThread "qtp626626764-224" [_thread_blocked, id=251, stack(0x00007f6359f63000,0x00007f635a063ae0)]
  0x00005577c97ce800 JavaThread "qtp626626764-223" [_thread_blocked, id=250, stack(0x00007f635a064000,0x00007f635a164ae0)]
  0x00005577c97cc800 JavaThread "qtp626626764-222" [_thread_blocked, id=249, stack(0x00007f635a165000,0x00007f635a265ae0)]
  0x00005577c97ca800 JavaThread "qtp626626764-221" [_thread_blocked, id=248, stack(0x00007f635a266000,0x00007f635a366ae0)]
  0x00005577c97c9000 JavaThread "qtp626626764-220" [_thread_blocked, id=247, stack(0x00007f635a367000,0x00007f635a467ae0)]
  0x00005577c9734000 JavaThread "qtp626626764-219" [_thread_blocked, id=246, stack(0x00007f635a468000,0x00007f635a568ae0)]
  0x00005577c9732000 JavaThread "qtp626626764-218" [_thread_blocked, id=245, stack(0x00007f635a569000,0x00007f635a669ae0)]
  0x00005577c97c7000 JavaThread "qtp626626764-217" [_thread_blocked, id=244, stack(0x00007f635a66a000,0x00007f635a76aae0)]
  0x00005577c97c5000 JavaThread "qtp626626764-216" [_thread_blocked, id=243, stack(0x00007f635a76b000,0x00007f635a86bae0)]
  0x00005577c97c2800 JavaThread "qtp626626764-215" [_thread_blocked, id=242, stack(0x00007f635a86c000,0x00007f635a96cae0)]
  0x00005577c97c0800 JavaThread "qtp626626764-214" [_thread_blocked, id=241, stack(0x00007f635a96d000,0x00007f635aa6dae0)]
  0x00005577c97be800 JavaThread "qtp626626764-213" [_thread_blocked, id=240, stack(0x00007f635aa6e000,0x00007f635ab6eae0)]
  0x00005577c978c800 JavaThread "qtp626626764-212" [_thread_blocked, id=239, stack(0x00007f635ab6f000,0x00007f635ac6fae0)]
  0x00005577c978a800 JavaThread "qtp626626764-211" [_thread_blocked, id=238, stack(0x00007f635ac70000,0x00007f635ad70ae0)]
  0x00005577c9788800 JavaThread "qtp626626764-210" [_thread_blocked, id=237, stack(0x00007f635ad71000,0x00007f635ae71ae0)]
  0x00005577c9786800 JavaThread "qtp626626764-209" [_thread_blocked, id=236, stack(0x00007f635ae72000,0x00007f635af72ae0)]
  0x00005577c9784000 JavaThread "qtp626626764-208" [_thread_blocked, id=235, stack(0x00007f635af73000,0x00007f635b073ae0)]
  0x00005577c9782000 JavaThread "qtp626626764-207" [_thread_blocked, id=234, stack(0x00007f635b074000,0x00007f635b174ae0)]
  0x00005577c977f800 JavaThread "qtp626626764-206" [_thread_blocked, id=233, stack(0x00007f635b175000,0x00007f635b275ae0)]
  0x00005577c977d000 JavaThread "qtp626626764-205" [_thread_blocked, id=232, stack(0x00007f635b276000,0x00007f635b376ae0)]
  0x00005577c977b000 JavaThread "qtp626626764-204" [_thread_blocked, id=231, stack(0x00007f635b377000,0x00007f635b477ae0)]
  0x00005577c95a9800 JavaThread "qtp626626764-203" [_thread_blocked, id=230, stack(0x00007f635b478000,0x00007f635b578ae0)]
  0x00005577c95a7800 JavaThread "qtp626626764-202" [_thread_blocked, id=229, stack(0x00007f635b579000,0x00007f635b679ae0)]
  0x00005577c95a5000 JavaThread "qtp626626764-201" [_thread_blocked, id=228, stack(0x00007f635b67a000,0x00007f635b77aae0)]
  0x00005577c95a3000 JavaThread "qtp626626764-200" [_thread_blocked, id=227, stack(0x00007f635b77b000,0x00007f635b87bae0)]
  0x00005577c95a1000 JavaThread "qtp626626764-199" [_thread_blocked, id=226, stack(0x00007f635b87c000,0x00007f635b97cae0)]
  0x00005577c959f800 JavaThread "qtp626626764-198" [_thread_blocked, id=225, stack(0x00007f635b97d000,0x00007f635ba7dae0)]
  0x00005577c95e9000 JavaThread "qtp626626764-197" [_thread_blocked, id=224, stack(0x00007f635ba7e000,0x00007f635bb7eae0)]
  0x00005577c95e6800 JavaThread "qtp626626764-196" [_thread_blocked, id=223, stack(0x00007f635bb7f000,0x00007f635bc7fae0)]
  0x00005577c95e4800 JavaThread "qtp626626764-195" [_thread_blocked, id=222, stack(0x00007f635bc80000,0x00007f635bd80ae0)]
  0x00005577c8dd2800 JavaThread "qtp626626764-194" [_thread_blocked, id=221, stack(0x00007f635bd81000,0x00007f635be81ae0)]
  0x00005577c8dd0800 JavaThread "qtp626626764-193" [_thread_blocked, id=220, stack(0x00007f635be82000,0x00007f635bf82ae0)]
  0x00005577c8dce000 JavaThread "qtp626626764-192" [_thread_blocked, id=219, stack(0x00007f635bf83000,0x00007f635c083ae0)]
  0x00005577c8dcc000 JavaThread "qtp626626764-191" [_thread_blocked, id=218, stack(0x00007f635c084000,0x00007f635c184ae0)]
  0x00005577c980b000 JavaThread "qtp626626764-190" [_thread_blocked, id=217, stack(0x00007f635c185000,0x00007f635c285ae0)]
  0x00005577c9808800 JavaThread "qtp626626764-189" [_thread_blocked, id=216, stack(0x00007f635c286000,0x00007f635c386ae0)]
  0x00005577c9806000 JavaThread "qtp626626764-188" [_thread_blocked, id=215, stack(0x00007f635c387000,0x00007f635c487ae0)]
  0x00005577c96b9800 JavaThread "qtp626626764-187" [_thread_blocked, id=214, stack(0x00007f635c488000,0x00007f635c588ae0)]
  0x00005577c96b7800 JavaThread "qtp626626764-186" [_thread_blocked, id=213, stack(0x00007f635c589000,0x00007f635c689ae0)]
  0x00005577c96b5000 JavaThread "qtp626626764-185" [_thread_blocked, id=212, stack(0x00007f635c68a000,0x00007f635c78aae0)]
  0x00005577c96b3000 JavaThread "qtp626626764-184" [_thread_blocked, id=211, stack(0x00007f635c78b000,0x00007f635c88bae0)]
  0x00005577c96b1000 JavaThread "qtp626626764-183" [_thread_blocked, id=210, stack(0x00007f635c88c000,0x00007f635c98cae0)]
  0x00005577c96af000 JavaThread "qtp626626764-182" [_thread_blocked, id=209, stack(0x00007f635c98d000,0x00007f635ca8dae0)]
  0x00005577c95ae000 JavaThread "qtp626626764-181" [_thread_blocked, id=208, stack(0x00007f635ca8e000,0x00007f635cb8eae0)]
  0x00005577c95ac000 JavaThread "qtp626626764-180" [_thread_blocked, id=207, stack(0x00007f635cb8f000,0x00007f635cc8fae0)]
  0x00005577c96ab800 JavaThread "qtp626626764-179" [_thread_blocked, id=206, stack(0x00007f635cc90000,0x00007f635cd90ae0)]
  0x00005577c9817000 JavaThread "qtp626626764-178" [_thread_blocked, id=205, stack(0x00007f635cd91000,0x00007f635ce91ae0)]
  0x00005577c9815000 JavaThread "qtp626626764-177" [_thread_blocked, id=204, stack(0x00007f635ce92000,0x00007f635cf92ae0)]
  0x00005577c9812800 JavaThread "qtp626626764-176" [_thread_blocked, id=203, stack(0x00007f635cf93000,0x00007f635d093ae0)]
  0x00005577c9810800 JavaThread "qtp626626764-175" [_thread_blocked, id=202, stack(0x00007f635d094000,0x00007f635d194ae0)]
  0x00005577c94a2800 JavaThread "qtp626626764-174" [_thread_blocked, id=201, stack(0x00007f635d195000,0x00007f635d295ae0)]
  0x00005577c94a0800 JavaThread "qtp626626764-173" [_thread_blocked, id=200, stack(0x00007f635d296000,0x00007f635d396ae0)]
  0x00005577c949e800 JavaThread "qtp626626764-172" [_thread_blocked, id=199, stack(0x00007f635d397000,0x00007f635d497ae0)]
  0x00005577c988d000 JavaThread "qtp626626764-171" [_thread_blocked, id=198, stack(0x00007f635d498000,0x00007f635d598ae0)]
  0x00005577c95c0000 JavaThread "qtp626626764-170" [_thread_blocked, id=197, stack(0x00007f635d599000,0x00007f635d699ae0)]
  0x00005577c95be000 JavaThread "qtp626626764-169" [_thread_blocked, id=196, stack(0x00007f635d69a000,0x00007f635d79aae0)]
  0x00005577c95bb800 JavaThread "qtp626626764-168" [_thread_blocked, id=195, stack(0x00007f635d79b000,0x00007f635d89bae0)]
  0x00005577c95b9000 JavaThread "qtp626626764-167" [_thread_blocked, id=194, stack(0x00007f635d89c000,0x00007f635d99cae0)]
  0x00005577c95b7000 JavaThread "qtp626626764-166" [_thread_blocked, id=193, stack(0x00007f635d99d000,0x00007f635da9dae0)]
  0x00005577c95b5000 JavaThread "qtp626626764-165" [_thread_blocked, id=192, stack(0x00007f635da9e000,0x00007f635db9eae0)]
  0x00005577c95b3000 JavaThread "qtp626626764-164" [_thread_blocked, id=191, stack(0x00007f635db9f000,0x00007f635dc9fae0)]
  0x00005577c982f000 JavaThread "qtp626626764-163" [_thread_blocked, id=190, stack(0x00007f635dca0000,0x00007f635dda0ae0)]
  0x00005577c982d000 JavaThread "qtp626626764-162" [_thread_blocked, id=189, stack(0x00007f635dda1000,0x00007f635dea1ae0)]
  0x00005577c982b000 JavaThread "qtp626626764-161" [_thread_blocked, id=188, stack(0x00007f635dea2000,0x00007f635dfa2ae0)]
  0x00005577c9829000 JavaThread "qtp626626764-160" [_thread_blocked, id=187, stack(0x00007f635dfa3000,0x00007f635e0a3ae0)]
  0x00005577c9826800 JavaThread "qtp626626764-159" [_thread_blocked, id=186, stack(0x00007f635e0a4000,0x00007f635e1a4ae0)]
  0x00005577c9824800 JavaThread "qtp626626764-158" [_thread_blocked, id=185, stack(0x00007f635e1a5000,0x00007f635e2a5ae0)]
  0x00005577c9822000 JavaThread "qtp626626764-157" [_thread_blocked, id=184, stack(0x00007f635e2a6000,0x00007f635e3a6ae0)]
  0x00005577c9820000 JavaThread "qtp626626764-156" [_thread_blocked, id=183, stack(0x00007f635e3a7000,0x00007f635e4a7ae0)]
  0x00005577c981e000 JavaThread "qtp626626764-155" [_thread_blocked, id=182, stack(0x00007f635e4a8000,0x00007f635e5a8ae0)]
  0x00005577c981c000 JavaThread "qtp626626764-154" [_thread_blocked, id=181, stack(0x00007f635e5a9000,0x00007f635e6a9ae0)]
  0x00005577c9819800 JavaThread "qtp626626764-153" [_thread_blocked, id=180, stack(0x00007f635e6aa000,0x00007f635e7aaae0)]
  0x00005577c95b2000 JavaThread "qtp626626764-152" [_thread_blocked, id=179, stack(0x00007f635e7ab000,0x00007f635e8abae0)]
  0x00005577c95af800 JavaThread "qtp626626764-151" [_thread_blocked, id=178, stack(0x00007f635e8ac000,0x00007f635e9acae0)]
  0x00005577c98ce000 JavaThread "qtp626626764-150" [_thread_blocked, id=177, stack(0x00007f635e9ad000,0x00007f635eaadae0)]
  0x00005577c98cc000 JavaThread "qtp626626764-149" [_thread_blocked, id=176, stack(0x00007f635eaae000,0x00007f635ebaeae0)]
  0x00005577c98ca000 JavaThread "qtp626626764-148" [_thread_blocked, id=175, stack(0x00007f635ebaf000,0x00007f635ecafae0)]
  0x00005577c98c8000 JavaThread "qtp626626764-147" [_thread_blocked, id=174, stack(0x00007f635ecb0000,0x00007f635edb0ae0)]
  0x00005577c98c6000 JavaThread "qtp626626764-146" [_thread_blocked, id=173, stack(0x00007f635edb1000,0x00007f635eeb1ae0)]
  0x00005577c98c3800 JavaThread "qtp626626764-145" [_thread_blocked, id=172, stack(0x00007f635eeb2000,0x00007f635efb2ae0)]
  0x00005577c98c1800 JavaThread "qtp626626764-144" [_thread_blocked, id=171, stack(0x00007f635efb3000,0x00007f635f0b3ae0)]
  0x00005577c98bf000 JavaThread "qtp626626764-143" [_thread_blocked, id=170, stack(0x00007f635f0b4000,0x00007f635f1b4ae0)]
  0x00005577c98bd000 JavaThread "qtp626626764-142" [_thread_blocked, id=169, stack(0x00007f635f1b5000,0x00007f635f2b5ae0)]
  0x00005577c98bb000 JavaThread "qtp626626764-141" [_thread_blocked, id=168, stack(0x00007f635f2b6000,0x00007f635f3b6ae0)]
  0x00005577c98b8800 JavaThread "qtp626626764-140" [_thread_blocked, id=167, stack(0x00007f635f3b7000,0x00007f635f4b7ae0)]
  0x00005577c98b6800 JavaThread "qtp626626764-139" [_thread_blocked, id=166, stack(0x00007f635f4b8000,0x00007f635f5b8ae0)]
  0x00005577c98b4800 JavaThread "qtp626626764-138" [_thread_blocked, id=165, stack(0x00007f635f5b9000,0x00007f635f6b9ae0)]
  0x00005577c98b2000 JavaThread "qtp626626764-137" [_thread_blocked, id=164, stack(0x00007f635f6ba000,0x00007f635f7baae0)]
  0x00005577c98b0000 JavaThread "qtp626626764-136" [_thread_blocked, id=163, stack(0x00007f635f7bb000,0x00007f635f8bbae0)]
  0x00005577c98ae000 JavaThread "qtp626626764-135" [_thread_blocked, id=162, stack(0x00007f635f8bc000,0x00007f635f9bcae0)]
  0x00005577c94eb800 JavaThread "qtp626626764-134" [_thread_blocked, id=161, stack(0x00007f635f9bd000,0x00007f635fabdae0)]
  0x00005577c94e9800 JavaThread "qtp626626764-133" [_thread_blocked, id=160, stack(0x00007f635fabe000,0x00007f635fbbeae0)]
  0x00005577c94e7000 JavaThread "qtp626626764-132" [_thread_blocked, id=159, stack(0x00007f635fbbf000,0x00007f635fcbfae0)]
  0x00005577c94e4800 JavaThread "qtp626626764-131" [_thread_blocked, id=158, stack(0x00007f635fcc0000,0x00007f635fdc0ae0)]
  0x00005577c94e2800 JavaThread "qtp626626764-130" [_thread_blocked, id=157, stack(0x00007f635fdc1000,0x00007f635fec1ae0)]
  0x00005577c94e0800 JavaThread "qtp626626764-129" [_thread_blocked, id=156, stack(0x00007f635fec2000,0x00007f635ffc2ae0)]
  0x00005577c94df000 JavaThread "qtp626626764-128" [_thread_blocked, id=155, stack(0x00007f635ffc3000,0x00007f63600c3ae0)]
  0x00005577c8de0800 JavaThread "qtp626626764-127" [_thread_blocked, id=154, stack(0x00007f63600c4000,0x00007f63601c4ae0)]
  0x00005577c8dde800 JavaThread "qtp626626764-126" [_thread_blocked, id=153, stack(0x00007f63601c5000,0x00007f63602c5ae0)]
  0x00005577c8ddc000 JavaThread "qtp626626764-125" [_thread_blocked, id=152, stack(0x00007f63602c6000,0x00007f63603c6ae0)]
  0x00005577c8dda000 JavaThread "qtp626626764-124" [_thread_blocked, id=151, stack(0x00007f63603c7000,0x00007f63604c7ae0)]
  0x00005577c8dd8000 JavaThread "qtp626626764-123" [_thread_blocked, id=150, stack(0x00007f63604c8000,0x00007f63605c8ae0)]
  0x00005577c8dd5800 JavaThread "qtp626626764-122" [_thread_blocked, id=149, stack(0x00007f63605c9000,0x00007f63606c9ae0)]
  0x00005577c8dd4000 JavaThread "qtp626626764-121" [_thread_blocked, id=148, stack(0x00007f63606ca000,0x00007f63607caae0)]
  0x00005577c95e0000 JavaThread "qtp626626764-120" [_thread_blocked, id=147, stack(0x00007f63607cb000,0x00007f63608cbae0)]
  0x00005577c95dd800 JavaThread "qtp626626764-119" [_thread_blocked, id=146, stack(0x00007f63608cc000,0x00007f63609ccae0)]
  0x00005577c95db800 JavaThread "qtp626626764-118" [_thread_blocked, id=145, stack(0x00007f63609cd000,0x00007f6360acdae0)]
  0x00005577c95d9000 JavaThread "qtp626626764-117" [_thread_blocked, id=144, stack(0x00007f6360ace000,0x00007f6360bceae0)]
  0x00005577c95d7000 JavaThread "qtp626626764-116" [_thread_blocked, id=143, stack(0x00007f6360bcf000,0x00007f6360ccfae0)]
  0x00005577c95d5000 JavaThread "qtp626626764-115" [_thread_blocked, id=142, stack(0x00007f6360cd0000,0x00007f6360dd0ae0)]
  0x00005577c97a1800 JavaThread "qtp626626764-114" [_thread_blocked, id=141, stack(0x00007f6360dd1000,0x00007f6360ed1ae0)]
  0x00005577c979f800 JavaThread "qtp626626764-113" [_thread_blocked, id=140, stack(0x00007f6360ed2000,0x00007f6360fd2ae0)]
  0x00005577c979d000 JavaThread "qtp626626764-112" [_thread_blocked, id=139, stack(0x00007f6360fd3000,0x00007f63610d3ae0)]
  0x00005577c979b000 JavaThread "qtp626626764-111" [_thread_blocked, id=138, stack(0x00007f63610d4000,0x00007f63611d4ae0)]
  0x00005577c9799000 JavaThread "qtp626626764-110" [_thread_blocked, id=137, stack(0x00007f63611d5000,0x00007f63612d5ae0)]
  0x00005577c9796800 JavaThread "qtp626626764-109" [_thread_blocked, id=136, stack(0x00007f63612d6000,0x00007f63613d6ae0)]
  0x00005577c9794800 JavaThread "qtp626626764-108" [_thread_blocked, id=135, stack(0x00007f63613d7000,0x00007f63614d7ae0)]
  0x00005577c94f6000 JavaThread "qtp626626764-107" [_thread_blocked, id=134, stack(0x00007f63614d8000,0x00007f63615d8ae0)]
  0x00005577c94f4000 JavaThread "qtp626626764-106" [_thread_blocked, id=133, stack(0x00007f63615d9000,0x00007f63616d9ae0)]
  0x00005577c94f2000 JavaThread "qtp626626764-105" [_thread_blocked, id=132, stack(0x00007f63616da000,0x00007f63617daae0)]
  0x00005577c94ef800 JavaThread "qtp626626764-104" [_thread_blocked, id=131, stack(0x00007f63617db000,0x00007f63618dbae0)]
  0x00005577c94ee000 JavaThread "qtp626626764-103" [_thread_blocked, id=130, stack(0x00007f63618dc000,0x00007f63619dcae0)]
  0x00005577c95c4000 JavaThread "qtp626626764-102" [_thread_blocked, id=129, stack(0x00007f63619dd000,0x00007f6361addae0)]
  0x00005577c95c2000 JavaThread "qtp626626764-101" [_thread_blocked, id=128, stack(0x00007f6361ade000,0x00007f6361bdeae0)]
  0x00005577c96c7800 JavaThread "qtp626626764-100" [_thread_blocked, id=127, stack(0x00007f6361bdf000,0x00007f6361cdfae0)]
  0x00005577c96c5800 JavaThread "qtp626626764-99" [_thread_blocked, id=126, stack(0x00007f6361ce0000,0x00007f6361de0ae0)]
  0x00005577c96c3000 JavaThread "qtp626626764-98" [_thread_blocked, id=125, stack(0x00007f6361de1000,0x00007f6361ee1ae0)]
  0x00005577c96c1000 JavaThread "qtp626626764-97" [_thread_blocked, id=124, stack(0x00007f6361ee2000,0x00007f6361fe2ae0)]
  0x00005577c96bf000 JavaThread "qtp626626764-96" [_thread_blocked, id=123, stack(0x00007f6361fe3000,0x00007f63620e3ae0)]
  0x00005577c96bd000 JavaThread "qtp626626764-95" [_thread_blocked, id=122, stack(0x00007f63620e4000,0x00007f63621e4ae0)]
  0x00005577c966b800 JavaThread "qtp626626764-94" [_thread_blocked, id=121, stack(0x00007f63621e5000,0x00007f63622e5ae0)]
  0x00005577c9669000 JavaThread "qtp626626764-93" [_thread_blocked, id=120, stack(0x00007f63622e6000,0x00007f63623e6ae0)]
  0x00005577c9667000 JavaThread "qtp626626764-92" [_thread_blocked, id=119, stack(0x00007f63623e7000,0x00007f63624e7ae0)]
  0x00005577c9665000 JavaThread "qtp626626764-91" [_thread_blocked, id=118, stack(0x00007f63624e8000,0x00007f63625e8ae0)]
  0x00005577c9662800 JavaThread "qtp626626764-90" [_thread_blocked, id=117, stack(0x00007f63625e9000,0x00007f63626e9ae0)]
  0x00005577c9661000 JavaThread "qtp626626764-89" [_thread_blocked, id=116, stack(0x00007f63626ea000,0x00007f63627eaae0)]
  0x00005577c965f000 JavaThread "qtp626626764-88" [_thread_blocked, id=115, stack(0x00007f636282e000,0x00007f636292eae0)]
  0x00005577c97e3800 JavaThread "qtp626626764-87" [_thread_blocked, id=114, stack(0x00007f636292f000,0x00007f6362a2fae0)]
  0x00005577c97e1800 JavaThread "qtp626626764-86" [_thread_blocked, id=113, stack(0x00007f6362a30000,0x00007f6362b30ae0)]
  0x00005577c97df800 JavaThread "qtp626626764-85" [_thread_blocked, id=112, stack(0x00007f6362b31000,0x00007f6362c31ae0)]
  0x00005577c97dd800 JavaThread "qtp626626764-84" [_thread_blocked, id=111, stack(0x00007f6362c32000,0x00007f6362d32ae0)]
  0x00005577c97db000 JavaThread "qtp626626764-83" [_thread_blocked, id=110, stack(0x00007f6362d33000,0x00007f6362e33ae0)]
  0x00005577c97d9000 JavaThread "qtp626626764-82" [_thread_blocked, id=109, stack(0x00007f6362e34000,0x00007f6362f34ae0)]
  0x00005577c97d6800 JavaThread "qtp626626764-81" [_thread_blocked, id=108, stack(0x00007f6362f35000,0x00007f6363035ae0)]
  0x00005577c952b800 JavaThread "qtp626626764-80" [_thread_blocked, id=107, stack(0x00007f6363036000,0x00007f6363136ae0)]
  0x00005577c9529000 JavaThread "qtp626626764-79" [_thread_blocked, id=106, stack(0x00007f6363137000,0x00007f6363237ae0)]
  0x00005577c9527000 JavaThread "qtp626626764-78" [_thread_blocked, id=105, stack(0x00007f6363238000,0x00007f6363338ae0)]
  0x00005577c9524800 JavaThread "qtp626626764-77" [_thread_blocked, id=104, stack(0x00007f6363339000,0x00007f6363439ae0)]
  0x00005577c9522800 JavaThread "qtp626626764-76" [_thread_blocked, id=103, stack(0x00007f636343a000,0x00007f636353aae0)]
  0x00005577c9520000 JavaThread "qtp626626764-75" [_thread_blocked, id=102, stack(0x00007f636353b000,0x00007f636363bae0)]
  0x00005577c9574800 JavaThread "qtp626626764-74" [_thread_blocked, id=101, stack(0x00007f636363c000,0x00007f636373cae0)]
  0x00005577c9572800 JavaThread "qtp626626764-73" [_thread_blocked, id=100, stack(0x00007f636373d000,0x00007f636383dae0)]
  0x00005577c9570000 JavaThread "qtp626626764-72" [_thread_blocked, id=99, stack(0x00007f636383e000,0x00007f636393eae0)]
  0x00005577c956d800 JavaThread "qtp626626764-71" [_thread_blocked, id=98, stack(0x00007f636393f000,0x00007f6363a3fae0)]
  0x00005577c956b800 JavaThread "qtp626626764-70" [_thread_blocked, id=97, stack(0x00007f6363a40000,0x00007f6363b40ae0)]
  0x00005577c9569000 JavaThread "qtp626626764-69" [_thread_blocked, id=96, stack(0x00007f6363b41000,0x00007f6363c41ae0)]
  0x00005577c9567800 JavaThread "qtp626626764-68" [_thread_blocked, id=95, stack(0x00007f6363c42000,0x00007f6363d42ae0)]
  0x00005577c8a2a800 JavaThread "qtp626626764-67" [_thread_blocked, id=94, stack(0x00007f6363d43000,0x00007f6363e43ae0)]
  0x00005577c8a28800 JavaThread "qtp626626764-66" [_thread_blocked, id=93, stack(0x00007f6363e44000,0x00007f6363f44ae0)]
  0x00005577c8a26800 JavaThread "qtp626626764-65" [_thread_blocked, id=92, stack(0x00007f6363f45000,0x00007f6364045ae0)]
  0x00005577c8a24800 JavaThread "qtp626626764-64" [_thread_blocked, id=91, stack(0x00007f6364046000,0x00007f6364146ae0)]
  0x00005577c8a22000 JavaThread "qtp626626764-63" [_thread_blocked, id=90, stack(0x00007f6364147000,0x00007f6364247ae0)]
  0x00005577c9563800 JavaThread "qtp626626764-62" [_thread_blocked, id=89, stack(0x00007f6364248000,0x00007f6364348ae0)]
  0x00005577c9561800 JavaThread "qtp626626764-61" [_thread_blocked, id=88, stack(0x00007f6364349000,0x00007f6364449ae0)]
  0x00005577c955f000 JavaThread "qtp626626764-60" [_thread_blocked, id=87, stack(0x00007f636444a000,0x00007f636454aae0)]
  0x00005577c955d000 JavaThread "qtp626626764-59" [_thread_blocked, id=86, stack(0x00007f636454b000,0x00007f636464bae0)]
  0x00005577c955b000 JavaThread "qtp626626764-58" [_thread_blocked, id=85, stack(0x00007f636464c000,0x00007f636474cae0)]
  0x00005577c96e4800 JavaThread "qtp626626764-57" [_thread_blocked, id=84, stack(0x00007f636474d000,0x00007f636484dae0)]
  0x00005577c96e2800 JavaThread "qtp626626764-56" [_thread_blocked, id=83, stack(0x00007f636484e000,0x00007f636494eae0)]
  0x00005577c96e0800 JavaThread "qtp626626764-55" [_thread_blocked, id=82, stack(0x00007f636494f000,0x00007f6364a4fae0)]
  0x00005577c96df000 JavaThread "qtp626626764-54" [_thread_blocked, id=81, stack(0x00007f6364a50000,0x00007f6364b50ae0)]
  0x00005577c94d2000 JavaThread "qtp626626764-53" [_thread_blocked, id=80, stack(0x00007f6364b51000,0x00007f6364c51ae0)]
  0x00005577c94cf800 JavaThread "qtp626626764-52" [_thread_blocked, id=79, stack(0x00007f6364c52000,0x00007f6364d52ae0)]
  0x00005577c94cd800 JavaThread "qtp626626764-51" [_thread_blocked, id=78, stack(0x00007f6364d53000,0x00007f6364e53ae0)]
  0x00005577c95cd000 JavaThread "qtp626626764-50" [_thread_blocked, id=77, stack(0x00007f6364e54000,0x00007f6364f54ae0)]
  0x00005577c95ca800 JavaThread "qtp626626764-49" [_thread_blocked, id=76, stack(0x00007f6364f55000,0x00007f6365055ae0)]
  0x00005577c95c8800 JavaThread "qtp626626764-48" [_thread_blocked, id=75, stack(0x00007f6365056000,0x00007f6365156ae0)]
  0x00005577c95c7800 JavaThread "qtp626626764-47" [_thread_blocked, id=74, stack(0x00007f6365157000,0x00007f6365257ae0)]
  0x00005577c8de5800 JavaThread "qtp626626764-46" [_thread_blocked, id=73, stack(0x00007f6365258000,0x00007f6365358ae0)]
  0x00005577c8de3800 JavaThread "qtp626626764-45" [_thread_blocked, id=72, stack(0x00007f6365359000,0x00007f6365459ae0)]
  0x00005577c8d75000 JavaThread "qtp626626764-44" [_thread_blocked, id=71, stack(0x00007f636545a000,0x00007f636555aae0)]
  0x00005577c8d73000 JavaThread "qtp626626764-43" [_thread_blocked, id=70, stack(0x00007f636555b000,0x00007f636565bae0)]
  0x00005577c8d71000 JavaThread "qtp626626764-42" [_thread_blocked, id=69, stack(0x00007f636565c000,0x00007f636575cae0)]
  0x00005577c947a800 JavaThread "qtp626626764-41" [_thread_blocked, id=68, stack(0x00007f636575d000,0x00007f636585dae0)]
  0x00005577c9478000 JavaThread "qtp626626764-40" [_thread_blocked, id=67, stack(0x00007f636585e000,0x00007f636595eae0)]
  0x00005577c9476000 JavaThread "qtp626626764-39" [_thread_blocked, id=66, stack(0x00007f636595f000,0x00007f6365a5fae0)]
  0x00005577c9474000 JavaThread "qtp626626764-38" [_thread_blocked, id=65, stack(0x00007f6365a60000,0x00007f6365b60ae0)]
  0x00005577c9779000 JavaThread "qtp626626764-37" [_thread_blocked, id=64, stack(0x00007f6365b61000,0x00007f6365c61ae0)]
  0x00005577c9776800 JavaThread "qtp626626764-36" [_thread_blocked, id=63, stack(0x00007f6365c62000,0x00007f6365d62ae0)]
  0x00005577c9774800 JavaThread "qtp626626764-35" [_thread_blocked, id=62, stack(0x00007f6365d63000,0x00007f6365e63ae0)]
  0x00005577c973c800 JavaThread "qtp626626764-34" [_thread_blocked, id=61, stack(0x00007f6365e64000,0x00007f6365f64ae0)]
  0x00005577c973a000 JavaThread "qtp626626764-33" [_thread_blocked, id=60, stack(0x00007f6365f65000,0x00007f6366065ae0)]
  0x00005577c9738000 JavaThread "qtp626626764-32" [_thread_blocked, id=59, stack(0x00007f6366066000,0x00007f6366166ae0)]
  0x00005577c9736800 JavaThread "qtp626626764-31" [_thread_blocked, id=58, stack(0x00007f63661cc000,0x00007f63662ccae0)]
  0x00005577c8e08000 JavaThread "qtp626626764-30" [_thread_blocked, id=57, stack(0x00007f63662cd000,0x00007f63663cdae0)]
  0x00005577c8e06000 JavaThread "qtp626626764-29" [_thread_blocked, id=56, stack(0x00007f63663ce000,0x00007f63664ceae0)]
  0x00005577c8e04000 JavaThread "qtp626626764-28" [_thread_blocked, id=55, stack(0x00007f63664cf000,0x00007f63665cfae0)]
  0x00005577c98d2800 JavaThread "qtp626626764-27" [_thread_blocked, id=54, stack(0x00007f63665d0000,0x00007f63666d0ae0)]
  0x00005577c98d0800 JavaThread "qtp626626764-26" [_thread_blocked, id=53, stack(0x00007f63666d1000,0x00007f63667d1ae0)]
  0x00005577c9792000 JavaThread "qtp626626764-25" [_thread_blocked, id=52, stack(0x00007f63667d2000,0x00007f63668d2ae0)]
  0x00005577c978f800 JavaThread "qtp626626764-24" [_thread_blocked, id=51, stack(0x00007f63668d3000,0x00007f63669d3ae0)]
  0x00005577c978d800 JavaThread "qtp626626764-23" [_thread_blocked, id=50, stack(0x00007f63669d4000,0x00007f6366ad4ae0)]
  0x00005577c95ef800 JavaThread "qtp626626764-22" [_thread_blocked, id=49, stack(0x00007f6366ad5000,0x00007f6366bd5ae0)]
  0x00005577c95ed800 JavaThread "qtp626626764-21" [_thread_blocked, id=48, stack(0x00007f6366bd6000,0x00007f6366cd6ae0)]
  0x00005577c95ec000 JavaThread "qtp626626764-20" [_thread_blocked, id=47, stack(0x00007f6366cd7000,0x00007f6366dd7ae0)]
  0x00005577c95e3000 JavaThread "qtp626626764-19" [_thread_blocked, id=46, stack(0x00007f6366dd8000,0x00007f6366ed8ae0)]
  0x00005577c8eef000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=44, stack(0x00007f636754a000,0x00007f636764aae0)]
  0x00005577c9393800 JavaThread "RMI TCP Accept-11003" daemon [_thread_in_native, id=43, stack(0x00007f636784b000,0x00007f636794bae0)]
  0x00005577c7ec6800 JavaThread "Service Thread" daemon [_thread_blocked, id=42, stack(0x00007f6367c51000,0x00007f6367d51ae0)]
  0x00005577c7ec3000 JavaThread "C1 CompilerThread2" daemon [_thread_blocked, id=41, stack(0x00007f6367d53000,0x00007f6367e53ae0)]
  0x00005577c7ec0800 JavaThread "C2 CompilerThread1" daemon [_thread_in_native, id=40, stack(0x00007f6367e55000,0x00007f6367f55ae0)]
  0x00005577c7ebe000 JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=39, stack(0x00007f6367f57000,0x00007f6368057ae0)]
  0x00005577c7ea2000 JavaThread "dd-trace-processor" daemon [_thread_blocked, id=38, stack(0x00007f636805f000,0x00007f636815fae0)]
  0x00005577c7ea0000 JavaThread "dd-trace-monitor" daemon [_thread_blocked, id=37, stack(0x00007f6368160000,0x00007f6368260ae0)]
  0x00005577c7de8800 JavaThread "dd-task-scheduler" daemon [_thread_blocked, id=36, stack(0x00007f6368461000,0x00007f6368561ae0)]
  0x00005577c7863000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=35, stack(0x00007f6368c27000,0x00007f6368d27ae0)]
  0x00005577c7861000 JavaThread "Surrogate Locker Thread (Concurrent GC)" daemon [_thread_blocked, id=34, stack(0x00007f6368d28000,0x00007f6368e28ae0)]
  0x00005577c782d800 JavaThread "Finalizer" daemon [_thread_blocked, id=33, stack(0x00007f6368e29000,0x00007f6368f29ae0)]
  0x00005577c782a800 JavaThread "Reference Handler" daemon [_thread_blocked, id=32, stack(0x00007f6368f2a000,0x00007f636902aae0)]

Other Threads:
  0x00005577c7820000 VMThread [stack: 0x00007f636902c000,0x00007f636912cae0] [id=31]
  0x00005577c8faf800 WatcherThread [stack: 0x00007f6367449000,0x00007f6367549ae0] [id=45]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

heap address: 0x0000000480000000, size: 13312 MB, Compressed Oops mode: Zero based, Oop shift amount: 3
Narrow klass base: 0x0000000000000000, Narrow klass shift: 3
Compressed class space size: 1073741824 Address: 0x00000007c0000000

Heap:
 par new generation   total 235968K, used 132683K [0x0000000480000000, 0x0000000490000000, 0x0000000490000000)
  eden space 209792K,  52% used [0x0000000480000000, 0x0000000486b0f4c8, 0x000000048cce0000)
  from space 26176K,  88% used [0x000000048cce0000, 0x000000048e363a70, 0x000000048e670000)
  to   space 26176K,   0% used [0x000000048e670000, 0x000000048e670000, 0x0000000490000000)
 concurrent mark-sweep generation total 13369344K, used 476991K [0x0000000490000000, 0x00000007c0000000, 0x00000007c0000000)
 Metaspace       used 77040K, capacity 78755K, committed 78888K, reserved 1118208K
  class space    used 9556K, capacity 9995K, committed 10048K, reserved 1048576K

Card table byte_map: [0x00007f637b3e2000,0x00007f637cde3000] byte_map_base: 0x00007f6378fe2000

Marking Bits: (CMSBitMap*) 0x00005577c76a9188
 Bits: [0x00007f636c85a000, 0x00007f637945a000)

Mod Union Table: (CMSBitMap*) 0x00005577c76a9248
 Bits: [0x00007f636c529000, 0x00007f636c859000)

Polling page: 0x00007f638c7d0000

CodeCache: size=245760Kb used=31048Kb max_used=31095Kb free=214711Kb
 bounds [0x00007f637d7af000, 0x00007f637f65f000, 0x00007f638c7af000]
 total_blobs=9738 nmethods=9035 adapters=615
 compilation: enabled

Compilation events (10 events):
Event: 113.715 Thread 0x00005577c7ec3000 12131       2       net.bytebuddy.asm.Advice$Dispatcher$Inlining$CodeTranslationVisitor::visitAnnotableParameterCount (1 bytes)
Event: 113.715 Thread 0x00005577c7ec3000 nmethod 12131 0x00007f637e16c990 code [0x00007f637e16cae0, 0x00007f637e16cc30]
Event: 113.721 Thread 0x00005577c7ec3000 12132       2       net.bytebuddy.description.type.TypeDescription$AbstractBase$OfSimpleType$WithDelegation::getRecordComponents (10 bytes)
Event: 113.722 Thread 0x00005577c7ec3000 nmethod 12132 0x00007f637e16c5d0 code [0x00007f637e16c740, 0x00007f637e16c8d8]
Event: 113.722 Thread 0x00005577c7ec3000 12133       2       net.bytebuddy.description.type.TypeDescription$AbstractBase$OfSimpleType$WithDelegation::isSealed (10 bytes)
Event: 113.722 Thread 0x00005577c7ec3000 nmethod 12133 0x00007f637eeed690 code [0x00007f637eeed800, 0x00007f637eeed998]
Event: 113.722 Thread 0x00005577c7ec3000 12134       2       net.bytebuddy.description.type.TypeDescription$AbstractBase$OfSimpleType$WithDelegation::getActualModifiers (11 bytes)
Event: 113.722 Thread 0x00005577c7ec3000 nmethod 12134 0x00007f637eeed2d0 code [0x00007f637eeed440, 0x00007f637eeed5d8]
Event: 113.735 Thread 0x00005577c7ec3000 12135       2       net.bytebuddy.asm.Advice$StackMapFrameHandler$Default$ForAdvice::injectCompletionFrame (276 bytes)
Event: 113.736 Thread 0x00005577c7ec3000 nmethod 12135 0x00007f637f01db50 code [0x00007f637f01ddc0, 0x00007f637f01e528]
@ejona86
Copy link
Member

ejona86 commented Feb 23, 2024

Ideally you'd tell me what container you are using (name+version). See also #10930

Solution 3:- And tried to include netty-tcnative-alpine version. with suggested dependency version.

You were probably still using grpc-netty-shaded. As mentioned in the google-cloud-java issue, you would have to exclude grpc-netty-shaded and add grpc-netty dependency instead. grpc-netty-shaded can't work directly with netty-tcnative-alpine.

RUN apk add gcompat
ENV LD_PRELOAD=/lib/libgcompat.so.0

After applying the fix, the Java crash issue has been resolved. However, it has introduced a new problem where we encounter the exception java.net.UnknownHostException: contentrights: Name does not resolve.

That sounds like the fix worked. You got past the crash and now you just are using hostnames that DNS doesn't know about.

Therefore, I updated to the latest version, GRPC Netty Shaded (1.61.0).

For 1.61, you need gcompat and libunwind, as seen in the issue you linked: #10096 (comment) .

RUN apk add gcompat libunwind
ENV LD_PRELOAD=/lib/libgcompat.so.0:/usr/lib/libunwind.so.8

I really recommend you not to use Alpine. These problems go away when using a glibc-based distro. (I'm less bothered by the missing symbols and more bothered by how hard it is for people to debug.)

grpc-java 1.54.x uses netty-tcnative 2.0.56.Final. Doing the normal drill to see what's wrong:

$ docker run --rm -it docker.io/library/alpine:latest
/ # wget https://search.maven.org/remotecontent?filepath=io/netty/netty-tcnative-boringssl-static/2.
0.56.Final/netty-tcnative-boringssl-static-2.0.56.Final-linux-x86_64.jar
/ # unzip netty-tcnative-boringssl-static-2.0.56.Final-linux-x86_64.jar 
/ # apk add gcompat
/ # LD_PRELOAD=/lib/libgcompat.so.0 ldd META-INF/native/libnetty_tcnative_linux_x86_64.so
	/lib/ld-musl-x86_64.so.1 (0x7f428aeb6000)
	/lib/libgcompat.so.0 => /lib/libgcompat.so.0 (0x7f428aea4000)
	librt.so.1 => /lib/ld-musl-x86_64.so.1 (0x7f428aeb6000)
	libpthread.so.0 => /lib/ld-musl-x86_64.so.1 (0x7f428aeb6000)
	libdl.so.2 => /lib/ld-musl-x86_64.so.1 (0x7f428aeb6000)
	libc.so.6 => /lib/ld-musl-x86_64.so.1 (0x7f428aeb6000)
	libucontext.so.1 => /lib/libucontext.so.1 (0x7f428ae9f000)
	libobstack.so.1 => /usr/lib/libobstack.so.1 (0x7f428ae9a000)
Error relocating META-INF/native/libnetty_tcnative_linux_x86_64.so: sys_siglist: symbol not found

@Hemadri513
Copy link
Author

Hemadri513 commented Feb 25, 2024

@ejona86, Thanks for the quick response.

  1. Container + Version:- vm_info: OpenJDK 64-Bit Server VM (25.275-b01) for linux-amd64 JRE (1.8.0_275-b01), built on "buildozer" with gcc 9.3.0

  2. I tried to exclude grpc-netty-shaded dependency, In my case grpc-netty-shaded dependency is required. if i exclude this dependency i am getting NoClassDefFoundError.

Caused by: java.lang.NoClassDefFoundError: io/grpc/netty/shaded/io/grpc/netty/NettyChannelBuilder
	at com.cts.d2cmodules.grpc.client.GrpcClientChannelFactory.managedChannelBuilderFor(GrpcClientChannelFactory.kt:77)
	at com.cts.d2cmodules.grpc.client.GrpcClientChannelFactory.managedChannelFor(GrpcClientChannelFactory.kt:54)
	at com.cts.d2cmodules.grpc.client.AbstractGrpcClient.<init>(AbstractGrpcClient.kt:47)

@ejona86
Copy link
Member

ejona86 commented Mar 20, 2024

Seems like this is resolved with the LD_PRELOAD=/lib/libgcompat.so.0 attempt. If not, comment, and it can be reopened.

@ejona86 ejona86 closed this as completed Mar 20, 2024
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Jun 19, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

2 participants