Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Rocketmq request callback timeout #3667

Closed
2 tasks done
mxsm opened this issue Apr 9, 2023 · 1 comment · Fixed by #3668
Closed
2 tasks done

[Bug] Rocketmq request callback timeout #3667

mxsm opened this issue Apr 9, 2023 · 1 comment · Fixed by #3668
Labels
bug Something isn't working
Milestone

Comments

@mxsm
Copy link
Member

mxsm commented Apr 9, 2023

Search before asking

  • I had searched in the issues and found no similar issues.

Environment

Windows

EventMesh version

master

What happened

image

How to reproduce

Send requestReply message

Debug logs

2023-04-09 18:39:56,858 INFO  [eventMesh-metrics-1] HTTPMetricsServer(HTTPMetricsServer.java:178) - batchAvgSend2MQCost: 0.0, avgSend2MQCost: 0.0, avgReply2MQCost: 0.0
2023-04-09 18:39:56,858 ERROR [RequestHouseKeepingService1] RequestCloudEventProcessor(RequestCloudEventProcessor.java:94) - message|eventMesh2mq|REPLY|RequestReply|send2MQCost=54285ms|topic=TEST-TOPIC-GRPC-ASYNC|bizSeqNo=138160865019448849061434929752|uniqueId=785375670090894308202322497114
org.apache.rocketmq.client.exception.RequestTimeoutException: CODE: 10006  DESC: request timeout, no reply message.
	at org.apache.rocketmq.client.producer.RequestFutureHolder.scanExpiredRequest(RequestFutureHolder.java:65) [rocketmq-client-4.9.3.jar:4.9.3]
	at org.apache.rocketmq.client.producer.RequestFutureHolder.access$000(RequestFutureHolder.java:38) [rocketmq-client-4.9.3.jar:4.9.3]
	at org.apache.rocketmq.client.producer.RequestFutureHolder$1.run(RequestFutureHolder.java:83) [rocketmq-client-4.9.3.jar:4.9.3]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_202]
	at java.util.concurrent.FutureTask.runAndReset$$$capture(FutureTask.java:308) [?:1.8.0_202]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java) [?:1.8.0_202]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_202]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:1.8.0_202]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_202]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_202]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202]
2023-04-09 18:39:56,858 DEBUG [grpc-nio-worker-ELG-3-2] NettyServerHandler(AbstractInternalLogger.java:214) - [id: 0x7b3ebfaa, L:/127.0.0.1:10205 - R:/127.0.0.1:58656] OUTBOUND DATA: streamId=3 padding=0 endStream=false length=910 bytes=00000003890a2436636138663232342d656133622d343833642d383230332d36666263623537383966636512012f1a03312e30220b636c6f75646576656e7473...
2023-04-09 18:39:56,858 DEBUG [grpc-nio-worker-ELG-3-2] NettyServerHandler(AbstractInternalLogger.java:214) - [id: 0x7b3ebfaa, L:/127.0.0.1:10205 - R:/127.0.0.1:58656] OUTBOUND HEADERS: streamId=3 headers=GrpcHttp2OutboundHeaders[grpc-status: 0] padding=0 endStream=true
2023-04-09 18:39:56,866 DEBUG [grpc-nio-worker-ELG-3-2] NettyServerHandler(AbstractInternalLogger.java:214) - [id: 0x7b3ebfaa, L:/127.0.0.1:10205 - R:/127.0.0.1:58656] INBOUND PING: ack=false bytes=1234

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@mxsm mxsm added the bug Something isn't working label Apr 9, 2023
@mxsm mxsm changed the title [Bug] Bug title [Bug] Rocketmq request callback timeout Apr 9, 2023
@mxsm
Copy link
Member Author

mxsm commented Apr 9, 2023

this is a rocketmq bug, we need to upgrade rocketmq version to 4.9.5 or newer

mxsm added a commit to mxsm/incubator-eventmesh that referenced this issue Apr 9, 2023
xwm1992 added a commit that referenced this issue Apr 12, 2023
[ISSUE #3667] upgrade rocketmq version to 4.9.5 andRocketmq request callback timeout
@xwm1992 xwm1992 added this to the 1.9.0 milestone Jun 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
2 participants