Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Oversized allocation: 278528 bytes in cluster::leader_balancer_types::random_reassignments::random_reassignments #12005

Closed
vshtokman opened this issue Jul 10, 2023 · 3 comments
Assignees

Comments

@vshtokman
Copy link
Contributor

Artifact url: https://username:[email protected]:443/vtools/8428/01893ed6-339d-4db8-834e-0cbb8440cc07/vbuild/output/ducktape-release-clang-amd64.tgz

Test details: tmp/ducktape/results/2023-07-10--001/ManyPartitionsTest/test_omb/3/RedpandaService-0-139782430955824/ip-172-31-57-136/redpanda.log

[shard 0] seastar_memory - oversized allocation: 278528 bytes. This is non-fatal, but could lead to latency and/or fragmentation issues. Please report: at
[Backtrace #3]
{tmp/libexec/redpanda} 0x6eae903: void seastar::backtrace<seastar::current_backtrace_tasklocal()::$_0>(seastar::current_backtrace_tasklocal()::$_0&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/util/backtrace.hh:60
 (inlined by) seastar::current_backtrace_tasklocal() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:86
 (inlined by) seastar::current_tasktrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:137
 (inlined by) seastar::current_backtrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:170
{tmp/libexec/redpanda} 0x6b29d0b: seastar::memory::cpu_pages::warn_large_allocation(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:809
 (inlined by) seastar::memory::cpu_pages::check_large_allocation(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:859
 (inlined by) seastar::memory::cpu_pages::allocate_large(unsigned int, bool) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:866
 (inlined by) seastar::memory::allocate_large(unsigned long, bool) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1429
 (inlined by) seastar::memory::allocate_slowpath(unsigned long, bool) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1547
{tmp/libexec/redpanda} 0x6b3b8fd: seastar::memory::allocate(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1565
 (inlined by) operator new(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:2265
{tmp/libexec/redpanda} 0x508670d: void* std::__1::__libcpp_operator_new[abi:v160004]<unsigned long>(unsigned long) at /vectorized/llvm/bin/../include/c++/v1/new:266
 (inlined by) std::__1::__libcpp_allocate[abi:v160004](unsigned long, unsigned long) at /vectorized/llvm/bin/../include/c++/v1/new:292
 (inlined by) std::__1::allocator<absl::lts_20220623::container_internal::AlignedType<8ul> >::allocate[abi:v160004](unsigned long) at /vectorized/llvm/bin/../include/c++/v1/__memory/allocator.h:115
 (inlined by) std::__1::allocator_traits<std::__1::allocator<absl::lts_20220623::container_internal::AlignedType<8ul> > >::allocate[abi:v160004](std::__1::allocator<absl::lts_20220623::container_internal::AlignedType<8ul> >&, unsigned long) at /vectorized/llvm/bin/../include/c++/v1/__memory/allocator_traits.h:268
 (inlined by) void* absl::lts_20220623::container_internal::Allocate<8ul, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >(std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> >*, unsigned long) at /vectorized/include/absl/container/internal/container_memory.h:64
 (inlined by) absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::initialize_slots() at /vectorized/include/absl/container/internal/raw_hash_set.h:1937
 (inlined by) absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::resize(unsigned long) at /vectorized/include/absl/container/internal/raw_hash_set.h:1978
 (inlined by) absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::rehash_and_grow_if_necessary() at /vectorized/include/absl/container/internal/raw_hash_set.h:2126
{tmp/libexec/redpanda} 0x5086664: absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::prepare_insert(unsigned long) at /vectorized/include/absl/container/internal/raw_hash_set.h:2191
{tmp/libexec/redpanda} 0x50834fc: std::__1::pair<unsigned long, bool> absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::find_or_prepare_insert<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >(detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const&) at /vectorized/include/absl/container/internal/raw_hash_set.h:2180
 (inlined by) std::__1::pair<absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::iterator, bool> absl::lts_20220623::container_internal::raw_hash_map<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::try_emplace_impl<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const&>(detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const&) at /vectorized/include/absl/container/internal/raw_hash_map.h:185
 (inlined by) std::__1::pair<absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::iterator, bool> absl::lts_20220623::container_internal::raw_hash_map<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::try_emplace<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, 0>(detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const&) at /vectorized/include/absl/container/internal/raw_hash_map.h:129
 (inlined by) decltype(absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>::value(std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard>* std::__1::addressof[abi:v160004]<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> >(std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard>&)(decltype(std::__declval<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> >(0)) std::__1::declval<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard>&>()()))) absl::lts_20220623::container_internal::raw_hash_map<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, model::broker_shard> > >::operator[]<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, model::broker_shard> >(detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const&) at /vectorized/include/absl/container/internal/raw_hash_map.h:169
 (inlined by) cluster::leader_balancer_types::random_reassignments::random_reassignments(absl::lts_20220623::node_hash_map<model::broker_shard, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > >, absl::lts_20220623::hash_internal::Hash<model::broker_shard>, std::__1::equal_to<model::broker_shard>, std::__1::allocator<std::__1::pair<model::broker_shard const, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > > > > > const&) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/cluster/scheduling/leader_balancer_random.h:42
 (inlined by) cluster::leader_balancer_types::random_hill_climbing_strategy::random_hill_climbing_strategy(absl::lts_20220623::node_hash_map<model::broker_shard, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > >, absl::lts_20220623::hash_internal::Hash<model::broker_shard>, std::__1::equal_to<model::broker_shard>, std::__1::allocator<std::__1::pair<model::broker_shard const, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > > > > >, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true> > > > >, cluster::leader_balancer_types::muted_index) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/cluster/scheduling/leader_balancer_random.h:110
{tmp/libexec/redpanda} 0x507dada: std::__1::__unique_if<cluster::leader_balancer_types::random_hill_climbing_strategy>::__unique_single std::__1::make_unique[abi:v160004]<cluster::leader_balancer_types::random_hill_climbing_strategy, absl::lts_20220623::node_hash_map<model::broker_shard, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > >, absl::lts_20220623::hash_internal::Hash<model::broker_shard>, std::__1::equal_to<model::broker_shard>, std::__1::allocator<std::__1::pair<model::broker_shard const, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > > > > >, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true> > > > >, cluster::leader_balancer_types::muted_index>(absl::lts_20220623::node_hash_map<model::broker_shard, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > >, absl::lts_20220623::hash_internal::Hash<model::broker_shard>, std::__1::equal_to<model::broker_shard>, std::__1::allocator<std::__1::pair<model::broker_shard const, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, std::__1::vector<model::broker_shard, std::__1::allocator<model::broker_shard> > > > > > > >&&, absl::lts_20220623::btree_map<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> >, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true> >, std::__1::less<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > >, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true> > const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true> > > > >&&, cluster::leader_balancer_types::muted_index&&) at /vectorized/llvm/bin/../include/c++/v1/__memory/unique_ptr.h:686
{tmp/libexec/redpanda} 0x5069f37: cluster::leader_balancer::balance() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/cluster/scheduling/leader_balancer.cc:403
{tmp/libexec/redpanda} 0x506707f: cluster::leader_balancer::trigger_balance()::$_0::operator()() const::'lambda'()::operator()() const at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/cluster/scheduling/leader_balancer.cc:265
 (inlined by) seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > seastar::futurize<seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > >::invoke<cluster::leader_balancer::trigger_balance()::$_0::operator()() const::'lambda'()&>(cluster::leader_balancer::trigger_balance()::$_0::operator()() const::'lambda'()&) at /vectorized/include/seastar/core/future.hh:1999
 (inlined by) seastar::future<void> seastar::repeat<cluster::leader_balancer::trigger_balance()::$_0::operator()() const::'lambda'()>(cluster::leader_balancer::trigger_balance()::$_0::operator()() const::'lambda'()&&) at /vectorized/include/seastar/core/loop.hh:122
 (inlined by) cluster::leader_balancer::trigger_balance()::$_0::operator()() const at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/cluster/scheduling/leader_balancer.cc:260
 (inlined by) seastar::future<void> seastar::futurize<seastar::future<void> >::invoke<cluster::leader_balancer::trigger_balance()::$_0>(cluster::leader_balancer::trigger_balance()::$_0&&) at /vectorized/include/seastar/core/future.hh:1999
 (inlined by) auto seastar::futurize_invoke<cluster::leader_balancer::trigger_balance()::$_0>(cluster::leader_balancer::trigger_balance()::$_0&&) at /vectorized/include/seastar/core/future.hh:2030
 (inlined by) auto seastar::internal::invoke_func_with_gate<cluster::leader_balancer::trigger_balance()::$_0>(seastar::gate&, cluster::leader_balancer::trigger_balance()::$_0&&) at /vectorized/include/seastar/core/gate.hh:273
 (inlined by) auto seastar::try_with_gate<cluster::leader_balancer::trigger_balance()::$_0>(seastar::gate&, cluster::leader_balancer::trigger_balance()::$_0&&) at /vectorized/include/seastar/core/gate.hh:313
 (inlined by) auto ssx::spawn_with_gate_then<cluster::leader_balancer::trigger_balance()::$_0>(seastar::gate&, cluster::leader_balancer::trigger_balance()::$_0&&) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/ssx/future-util.h:294
 (inlined by) void ssx::spawn_with_gate<cluster::leader_balancer::trigger_balance()::$_0>(seastar::gate&, cluster::leader_balancer::trigger_balance()::$_0&&) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/ssx/future-util.h:308
 (inlined by) cluster::leader_balancer::trigger_balance() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/cluster/scheduling/leader_balancer.cc:259
{tmp/libexec/redpanda} 0x6c87adf: seastar::noncopyable_function<void ()>::operator()() const at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/util/noncopyable_function.hh:210
 (inlined by) void seastar::reactor::complete_timers<seastar::timer_set<seastar::timer<seastar::lowres_clock>, &(seastar::timer<seastar::lowres_clock>::_link)>, boost::intrusive::list<seastar::timer<seastar::lowres_clock>, boost::intrusive::member_hook<seastar::timer<seastar::lowres_clock>, boost::intrusive::list_member_hook<>, &(seastar::timer<seastar::lowres_clock>::_link)> >, seastar::reactor::do_expire_lowres_timers()::$_0>(seastar::timer_set<seastar::timer<seastar::lowres_clock>, &(seastar::timer<seastar::lowres_clock>::_link)>&, boost::intrusive::list<seastar::timer<seastar::lowres_clock>, boost::intrusive::member_hook<seastar::timer<seastar::lowres_clock>, boost::intrusive::list_member_hook<>, &(seastar::timer<seastar::lowres_clock>::_link)> >&, seastar::reactor::do_expire_lowres_timers()::$_0&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:1541
 (inlined by) seastar::reactor::do_expire_lowres_timers() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:2713
 (inlined by) seastar::reactor::lowres_timer_pollfn::poll() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:2875
{tmp/libexec/redpanda} 0x6c4e328: seastar::reactor::poll_once() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3406
 (inlined by) seastar::reactor::do_run()::$_6::operator()() const at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3299
 (inlined by) decltype(std::declval<seastar::reactor::do_run()::$_6&>()()) std::__1::__invoke[abi:v160004]<seastar::reactor::do_run()::$_6&>(seastar::reactor::do_run()::$_6&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:394
 (inlined by) bool std::__1::__invoke_void_return_wrapper<bool, false>::__call<seastar::reactor::do_run()::$_6&>(seastar::reactor::do_run()::$_6&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:478
 (inlined by) std::__1::__function::__alloc_func<seastar::reactor::do_run()::$_6, std::__1::allocator<seastar::reactor::do_run()::$_6>, bool ()>::operator()[abi:v160004]() at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:185
 (inlined by) std::__1::__function::__func<seastar::reactor::do_run()::$_6, std::__1::allocator<seastar::reactor::do_run()::$_6>, bool ()>::operator()() at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:356
{tmp/libexec/redpanda} 0x6bf8aa3: std::__1::__function::__value_func<bool ()>::operator()[abi:v160004]() const at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:510
 (inlined by) std::__1::function<bool ()>::operator()() const at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:1156
 (inlined by) seastar::reactor::do_run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3327
{tmp/libexec/redpanda} 0x6bf5c16: seastar::reactor::run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3174
{tmp/libexec/redpanda} 0x6af8c80: seastar::app_template::run_deprecated(int, char**, std::__1::function<void ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:265
{tmp/libexec/redpanda} 0x6af7078: seastar::app_template::run(int, char**, std::__1::function<seastar::future<int> ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:156
{tmp/libexec/redpanda} 0x2109b65: application::run(int, char**) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/redpanda/application.cc:346
{tmp/libexec/redpanda} 0x6eef75b: main at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-08916263b57a22ab4-1/redpanda/redpanda/src/v/redpanda/main.cc:22
{/opt/redpanda/lib/libc.so.6} 0x2d58f: ?? at ??:0
{/opt/redpanda/lib/libc.so.6} 0x2d648: ?? at ??:0

1. {tmp/libexec/redpanda} 0x21038a4: _start at ??:0

Copy link

github-actions bot commented Feb 6, 2024

This issue hasn't seen activity in 3 months. If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in two weeks.

@github-actions github-actions bot added the stale label Feb 6, 2024
Copy link

This issue was closed due to lack of activity. Feel free to reopen if it's still relevant.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Feb 20, 2024
@StephanDollberg
Copy link
Member

This is still an issue - > 1MB alloc with more than 100k partitions

@mmaslankaprv mmaslankaprv self-assigned this Mar 6, 2024
vbotbuildovich pushed a commit to vbotbuildovich/redpanda that referenced this issue Mar 7, 2024
The muted group index was using a `absl::flat_has_set` the use of flat
data structure lead to oversized allocation when the number of
muted/skipped raft group was large. Replaced a hash set with roaring
bitmap. The roaring bitmap is efficient and compressed leading to better
performance and smaller allocation.

Fixes: redpanda-data#12005

Signed-off-by: Michal Maslanka <[email protected]>
(cherry picked from commit 745c324)
vbotbuildovich pushed a commit to vbotbuildovich/redpanda that referenced this issue Mar 7, 2024
The muted group index was using a `absl::flat_has_set` the use of flat
data structure lead to oversized allocation when the number of
muted/skipped raft group was large. Replaced a hash set with roaring
bitmap. The roaring bitmap is efficient and compressed leading to better
performance and smaller allocation.

Fixes: redpanda-data#12005

Signed-off-by: Michal Maslanka <[email protected]>
(cherry picked from commit 745c324)
rockwotj pushed a commit to rockwotj/redpanda that referenced this issue Mar 8, 2024
The muted group index was using a `absl::flat_has_set` the use of flat
data structure lead to oversized allocation when the number of
muted/skipped raft group was large. Replaced a hash set with roaring
bitmap. The roaring bitmap is efficient and compressed leading to better
performance and smaller allocation.

Fixes: redpanda-data#12005

Signed-off-by: Michal Maslanka <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants