Skip to content

KAFKA-12495: Exponential backoff retry to prevent rebalance storms when worker joins after revoking rebalance #12561

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
C0urante merged 27 commits into from
Nov 15, 2022
Merged

KAFKA-12495: Exponential backoff retry to prevent rebalance storms when worker joins after revoking rebalance #12561

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
f595171
KAFKA-12495: Initial commit to get a balanced assignment and allow co…
Aug 9, 2022
f42c80b
Some local changes
Aug 20, 2022
73eec50
KAFKA-12495: Adding exponential backoff delay when worker joins after…
Aug 26, 2022
02787b3
Adding revokedInPrevious state to exponential backoff delay only when…
Aug 28, 2022
a72a83e
Removing time.sleep during successive rebalances and instead using th…
Aug 31, 2022
a8a0c0c
Update connect/runtime/src/main/java/org/apache/kafka/connect/runtime…
vamossagar12 Sep 1, 2022
39ab004
Review changes
Sep 2, 2022
a1da57d
Setting initial interval to 1 and lowering multiplier. Also always se…
Sep 4, 2022
3d61550
Removing needless check while computing exponential backoff delay
Sep 5, 2022
e42092b
Reenabling flaky test testMultipleWorkersRejoining and addressing rev…
Sep 6, 2022
804374e
Removing unwanted rebalance check in testSuccessiveRevocationsWhenMax…
Sep 7, 2022
6ef4683
Changing arguements of performTaskRevocation back to the old ones
Sep 9, 2022
ebce075
Fixing failing testcase
Sep 14, 2022
f4bfc0c
Removing unwanted file
Sep 15, 2022
bce6334
Increasing exp backoff multiplier to 40
Sep 15, 2022
fb879f1
Removing resetting numSuccessiveRevokingRebalances to 0
Sep 17, 2022
0e8f84e
Resetting revokedInPrevious to false when there's no rebalance + few …
Oct 13, 2022
8d63bf5
Removing unwanted sysout
Oct 13, 2022
f209a1a
Reverting test
Oct 14, 2022
71297c3
Reenabling RebalanceSourceConnectorsIntegrationTest#testDeleteConnect…
Nov 15, 2022
0261a23
KAFKA-12495: Improve rebalance allocation algorithm
C0urante Oct 23, 2022
fb34e5c
Address review comments, remove unused code
C0urante Oct 26, 2022
3eb5e13
Address review comments
C0urante Nov 14, 2022
422c81f
Merge pull request #1 from C0urante/kafka-12495-followup
vamossagar12 Nov 15, 2022
79ff0ea
Fixing checkstyle
Nov 15, 2022
f17bd14
Revert "Fixing checkstyle"
Nov 15, 2022
52d2381
fixing checkstyle again
Nov 15, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading