from apache #6

francisoliverlee · 2023-09-26T02:18:53Z

Make sure set the target branch to develop

What is the purpose of the change

fix #

Brief changelog

XX

Verifying this change

XXXX

Follow this checklist to help us incorporate your contribution quickly and easily. Notice, it would be helpful if you could finish the following 5 checklist(the last one is not necessary)before request the community to review your PR.

Make sure there is a Github issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a Github issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
Format the pull request title like [ISSUE #123] Fix UnknownException when host config not exist. Each commit in the pull request should have a meaningful subject line and body.
Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
Write necessary unit-test(over 80% coverage) to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
Run mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle to make sure basic checks pass. Run mvn clean install -DskipITs to make sure unit-test pass. Run mvn clean test-compile failsafe:integration-test to make sure integration-test pass.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

…in README.md (#6582) * Add a description of the Apache RocketMQ E2E repository in README.md * Update README.md Co-authored-by: Aaron Ai <[email protected]> --------- Co-authored-by: Aaron Ai <[email protected]>

…the maximum value of short (#6580) * Prevent the properties of trace message from exceeding the maximum value of short * Use reduce instead of foreach

* feat(proxy): improve proxy context Signed-off-by: lyx <[email protected]> * fix(proxy): rollback to fullname for compatibility Signed-off-by: lyx2000 <[email protected]> * fix(proxy): use simple_rpc_name add to ProxyContext action Signed-off-by: lyx <[email protected]> * fix(proxy): improve naming Signed-off-by: lyx <[email protected]> --------- Signed-off-by: lyx <[email protected]> Signed-off-by: lyx2000 <[email protected]>

Co-authored-by: guyinyou <[email protected]>

…le (#6534) * [#6525] Make ConsumeQueueInterface extends from FileQueueLifeCycle * [#6525] forced typecast is removed * [#6525] remove all the forced convert

…#6531) * change map -> lambda * f * fix unit test * remove getTopicConfig function * Update MultiDispatchTest.java * Update CompactionStore.java * update * update test * update test * Update BatchConsumeMessageTest.java * Update BrokerController.java * Update BrokerController.java * check * Update BrokerController.java * Update BatchConsumeMessageTest.java

…efault java command in Darwin contained Spaces (#6592)

#6590) * (fix): logback config path seperator and brokerLogDir default value missing * (fix): replace / with file.seperator in proxy test logback config --------- Co-authored-by: Robin Han <[email protected]>

* change map -> lambda * f * fix unit test * remove getTopicConfig function * Update MultiDispatchTest.java * Update CompactionStore.java * update * update test * update test * Update BatchConsumeMessageTest.java * Update BrokerController.java * Update BrokerController.java * check * Update BrokerController.java * Update BatchConsumeMessageTest.java * prevent redundant validator * fix * ci * ci * Update AuthenticationPipeline.java * Update RemotingProtocolServer.java * Update AuthenticationPipeline.java * Update RemotingProtocolServer.java

Bumps [spring-core](https://github.com/spring-projects/spring-framework) from 5.3.26 to 5.3.27. - [Release notes](https://github.com/spring-projects/spring-framework/releases) - [Commits](spring-projects/spring-framework@v5.3.26...v5.3.27) --- updated-dependencies: - dependency-name: org.springframework:spring-core dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…o latest develop because compactionThreadNum is 0 (#6611)

…PE (#6628)

…#6632) Co-authored-by: 斜阳 <[email protected]>

#6538) * [ISSUE #6537] Fix bug MessageStoreConfig.haListenPort item config not effective * rerun * [ISSUE #6537] fix bug, if user not config haListenPort, then safe set haListenPort value as listenPort +1 * rerun

…rrentLogicOffset in consumeQueue build when the message is illegal (#6641) * Fix the issue that expectLogicOffset is greater than currentLogicOffset in consumeQueue build when the message is illegal * Add new UT * Fix bug that UT can not pass * Polish the variable name * Polish the comment * Add more comments

…ocessed via TieredStorage when level is FORCE (#6649) * fix(tieredstorage): fix the bug that not all message fetch request is processed via tieredStorage when enable FORCE 1. fix the bug that not all message fetch request is processed via tieredStorage when enable FORCE * style(tieredstorage): use rmq code style 1. use rmq code style * feat(tieredstorage): add more comments for `TieredStorageLevel` 1. add more comments for `TieredStorageLevel`

…iskByConsumeOffset` (#6651) * fix(tieredstorage): fix using deprecated method `MessageStore#checkInDiskByConsumeOffset` 1. fix using deprecated method `MessageStore#checkInDiskByConsumeOffset` * test(tieredstorage): replace `checkInDiskeByConsumeOffset` with `checkInStoreByConsumeOffset` 1. replace `checkInDiskeByConsumeOffset` with `checkInStoreByConsumeOffset`

* [ISSUE #6644] Add admin client future interface * add unit test * Change exception to throwable * Add interface for MqClientAdmin

…6663) * When compute confirmOffset, judge whether the slaves in syncStateSet all connect to the master. * fix the brokerId to brokerControllerId. * optimize the code: 1. Set brokerId when the replicasManager inited. 2. Rename the confusing name. * set haService's brokerControllerId after registered. * set the haService's brokerControllerId when the ReplicasManager start without brokerIdentity file.

…6687)

…rmOffset when node restarts to recover (#6618) * Fix the issue that consume queue building exceeds confirmOffset when node restarts to recover

* 1. Fix the bug that confirmOffset may be larger than ReputOffset in some cases. 2. Optimize the logic when truncate dirty files. * Add more logs while expanding SyncStateSet. * reset the confirmOffset to the truncated offset. * optimize the log. * move setConfirmOffset() process into commitLog. * add the judge.

* [ISSUE #6673]Issue template enhancements * optimize issue template

Optimize the proxy's and client's selection strategy for brokers when sending messages, and use multiple selection strategies as a pipeline to filter suitable queues.

…tion occurs (#7112) * remove responseFuture when exception * Empty-Commit --------- Co-authored-by: chenyong152 <[email protected]>

…ge (#7281) * refactor handle commit exception * refactor handle commit exception * fix handle commit exception

… re delete failed (#7284)

#7209)

Co-authored-by: guyinyou <[email protected]>

… broker offline cause coredump(#7307)

…ule (#7310)

…and hot update switch (#7320)

* Convergence thread pool creation to facilitate subsequent iteration management * Convergence thread pool creation in ThreadPoolMonitor.java * fix unit test * Convergence ThreadPool constructor * Convergence ScheduledThreadPool constructor * remove unused import * Convergence ScheduledThreadPool constructor * remove unused import ---------

…7335) Signed-off-by: Ziy1-Tan <[email protected]>

Signed-off-by: Ziy1-Tan <[email protected]>

…erent scenarios (#7317)

Co-authored-by: guyinyou <[email protected]>

…nager` (#7341)

* Set experimental_ui_max_stdouterr_bytes to 10MB and Fix IT

…7342)

Co-authored-by: guyinyou <[email protected]>

…xt pull offset (#7365)

) * Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. * Fix bazel workspace * Move OtlpJsonLoggingMetricExporter to proxy and controller. * Fix Bazel imports.

* correct the timerMetrics' result. * for further extension. * checkstyle. * use toLong.

… performance Co-authored-by: guyinyou <[email protected]>

cryptoya and others added 30 commits April 12, 2023 18:14

[ISSUE #6581]Add a description of the Apache RocketMQ E2E repository …

938b5bb

…in README.md (#6582) * Add a description of the Apache RocketMQ E2E repository in README.md * Update README.md Co-authored-by: Aaron Ai <[email protected]> --------- Co-authored-by: Aaron Ai <[email protected]>

[ISSUE #6579] Prevent the properties of trace message from exceeding …

baad0a4

…the maximum value of short (#6580) * Prevent the properties of trace message from exceeding the maximum value of short * Use reduce instead of foreach

[ISSUE #6584] Fix AppendMessageCallback comments typo (#6585)

d9a7315

[ISSUE #6587] fix getMax() in SparseConsumeQueue

d3a8fe0

Co-authored-by: guyinyou <[email protected]>

[ISSUE #6525]Make ConsumeQueueInterface extends from FileQueueLifeCyc…

d1b14b0

…le (#6534) * [#6525] Make ConsumeQueueInterface extends from FileQueueLifeCycle * [#6525] forced typecast is removed * [#6525] remove all the forced convert

[ISSUE #6591] Fix Starting nameserver and broker failed because the d…

ca006ca

…efault java command in Darwin contained Spaces (#6592)

(fix): logback config path seperator and brokerLogDir default value m… (

b3868ab

#6590) * (fix): logback config path seperator and brokerLogDir default value missing * (fix): replace / with file.seperator in proxy test logback config --------- Co-authored-by: Robin Han <[email protected]>

Fix the issue broker startup failed when version upgrade from 5.1.0 t…

073da6b

…o latest develop because compactionThreadNum is 0 (#6611)

[ISSUE #6594] skip verification for admin user (#6613)

ea8b9d9

[ISSUE #6627] Fix ConsumerLagCalculator#processAllGroup retry topic N…

af6a95f

…PE (#6628)

[ISSUE #6634] Polish the HA logs to better troubleshoot issues (#6635)

14ad16b

[ISSUE #6627] Fix ConsumerLagCalculator NPE if group or topic is null (…

652f5bb

…#6632) Co-authored-by: 斜阳 <[email protected]>

Rewrite the issue/pull request template of RocketMQ (#6645)

b00c82c

[ISSUE #6644] Add admin client future interface (#6646)

23a8ed4

* [ISSUE #6644] Add admin client future interface * add unit test * Change exception to throwable * Add interface for MqClientAdmin

[ISSUE #6660] Fix semaphoreAsyncSendSize init error (#6661)

bcbb25f

[ISSUE #6686] Remove ClientManageProcessor#heartBeat repeat judgment (#…

b4e6acc

…6687)

[ISSUE #6609] Fix the issue that consume queue building exceeds confi…

b410557

…rmOffset when node restarts to recover (#6618) * Fix the issue that consume queue building exceeds confirmOffset when node restarts to recover

[ISSUE #6673]Issue template enhancements (#6674)

6f6032e

* [ISSUE #6673]Issue template enhancements * optimize issue template

[ISSUE #6691] Support reentrant pop orderly for broker (#6692)

57642bc

Update AclUtils.java (#6689)

d9223ff

GenerousMan and others added 29 commits August 29, 2023 16:13

[ISSUE #6567] [RIP-63] Queue Selection Strategy Optimization (#6568)

b028277

Optimize the proxy's and client's selection strategy for brokers when sending messages, and use multiple selection strategies as a pipeline to filter suitable queues.

[ISSUE #7111] Remove responseFuture from the responseTable when excep…

bd0e9c0

…tion occurs (#7112) * remove responseFuture when exception * Empty-Commit --------- Co-authored-by: chenyong152 <[email protected]>

[ISSUE#7280] Fix and refactor handle commit exception in tiered stora…

c78061b

…ge (#7281) * refactor handle commit exception * refactor handle commit exception * fix handle commit exception

[ISSUE #7283] Incorrect dledger commitlog min offset after mappedFile…

d000ef9

… re delete failed (#7284)

[ISSUE #7208] fix: when deleting topic also delete its pop retry topic (

f82718a

#7209)

[ISSUE #7289] Fixed asynchronous send backpressure capability

31d1038

Co-authored-by: guyinyou <[email protected]>

[ISSUE #7302] Fix singleTopicRegister code deleted in merge

d67b9d6

[ISSUE #7305] Fix metrics and transactional module not shutdown while…

37017db

… broker offline cause coredump(#7307)

[ISSUE #7308] Adding topic blacklist and filter in tiered storage mod…

e11e294

…ule (#7310)

[ISSUE #7293] Fix NPE when alter sync state set

6280205

[ISSUE #7319] Optimize fault-tolerant mechanism for sending messages …

6fd0073

…and hot update switch (#7320)

[ISSUE #7334] registerIncrementBrokerData for single topic update (#…

dad6b4d

…7335) Signed-off-by: Ziy1-Tan <[email protected]>

[ISSUE #7326] Split the request to register to the nameserver (#7325)

0dbd077

Signed-off-by: Ziy1-Tan <[email protected]>

Add the configuration of topicQueueLock number to better support diff…

a9e3532

…erent scenarios (#7317)

[ISSUE #7343] Rollback modifications to registerProcessor

57f04c9

Co-authored-by: guyinyou <[email protected]>

[ISSUE #7340] Abstract Duplicate code into a method in `TopicConfigMa…

dad6ad0

…nager` (#7341)

Set experimental_ui_max_stdouterr_bytes to 10MB in bazel (#7348)

dddd58d

* Set experimental_ui_max_stdouterr_bytes to 10MB and Fix IT

[ISSUE #7345] Fix wrong result of searchOffset in tiered storage

1a8e7cb

[ISSUE #6633] Not clear uninitialized files and fix metadata recover (#…

fd32dae

…7342)

[ISSUE #7351] Allow mqadmin to operate slave nodes

4a8e0d5

Co-authored-by: guyinyou <[email protected]>

[ISSUE #7363] Fix get message from tiered storage return incorrect ne…

831fcc7

…xt pull offset (#7365)

Print admin queue watermark in log (#7372)

f05a8da

[ISSUE #7374] Prepare to release Apache RocketMQ 5.1.4 (#7375)

42fcd27

Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. (#7373

b8610d8

) * Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. * Fix bazel workspace * Move OtlpJsonLoggingMetricExporter to proxy and controller. * Fix Bazel imports.

[maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377)

1a681bd

[maven-release-plugin] prepare for next development iteration (#7379)

73b3fde

[ISSUE #7381] Fix the problem of inaccurate timer message metric (#7382)

88a9d93

* correct the timerMetrics' result. * for further extension. * checkstyle. * use toLong.

[ISSUE #7389] Fix the problem that getLastMappedFile function affects…

d7e5c4d

… performance Co-authored-by: guyinyou <[email protected]>

francisoliverlee merged commit 49fd9a9 into francisoliverlee:develop Sep 26, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

from apache #6

from apache #6

francisoliverlee commented Sep 26, 2023

from apache #6

from apache #6

Conversation

francisoliverlee commented Sep 26, 2023

What is the purpose of the change

Brief changelog

Verifying this change