-
Notifications
You must be signed in to change notification settings - Fork 593
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Oversized allocation: 278528 bytes in cluster::leader_balancer_types::random_reassignments::random_reassignments
#12005
Labels
Comments
This issue hasn't seen activity in 3 months. If you want to keep it open, post a comment or remove the |
This issue was closed due to lack of activity. Feel free to reopen if it's still relevant. |
This is still an issue - > 1MB alloc with more than 100k partitions |
6 tasks
vbotbuildovich
pushed a commit
to vbotbuildovich/redpanda
that referenced
this issue
Mar 7, 2024
The muted group index was using a `absl::flat_has_set` the use of flat data structure lead to oversized allocation when the number of muted/skipped raft group was large. Replaced a hash set with roaring bitmap. The roaring bitmap is efficient and compressed leading to better performance and smaller allocation. Fixes: redpanda-data#12005 Signed-off-by: Michal Maslanka <[email protected]> (cherry picked from commit 745c324)
vbotbuildovich
pushed a commit
to vbotbuildovich/redpanda
that referenced
this issue
Mar 7, 2024
The muted group index was using a `absl::flat_has_set` the use of flat data structure lead to oversized allocation when the number of muted/skipped raft group was large. Replaced a hash set with roaring bitmap. The roaring bitmap is efficient and compressed leading to better performance and smaller allocation. Fixes: redpanda-data#12005 Signed-off-by: Michal Maslanka <[email protected]> (cherry picked from commit 745c324)
rockwotj
pushed a commit
to rockwotj/redpanda
that referenced
this issue
Mar 8, 2024
The muted group index was using a `absl::flat_has_set` the use of flat data structure lead to oversized allocation when the number of muted/skipped raft group was large. Replaced a hash set with roaring bitmap. The roaring bitmap is efficient and compressed leading to better performance and smaller allocation. Fixes: redpanda-data#12005 Signed-off-by: Michal Maslanka <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Artifact url: https://username:[email protected]:443/vtools/8428/01893ed6-339d-4db8-834e-0cbb8440cc07/vbuild/output/ducktape-release-clang-amd64.tgz
Test details:
tmp/ducktape/results/2023-07-10--001/ManyPartitionsTest/test_omb/3/RedpandaService-0-139782430955824/ip-172-31-57-136/redpanda.log
The text was updated successfully, but these errors were encountered: