Skip to content

[native] Add system memory check configs#21463

Merged
xiaoxmeng merged 1 commit intoprestodb:masterfrom
bikramSingh91:add_configs_mem_check
Dec 7, 2023
Merged

[native] Add system memory check configs#21463
xiaoxmeng merged 1 commit intoprestodb:masterfrom
bikramSingh91:add_configs_mem_check

Conversation

@bikramSingh91
Copy link
Contributor

@bikramSingh91 bikramSingh91 commented Nov 30, 2023

Configs added:
"malloc-mem-heap-dump-enabled" is set to enable or disable periodic
malloc memory usage checks and dump heap profile if usage exceeds a
certain threshold.

"malloc-heap-dump-threshold-gb" the threshold in GigaBytes of memory
allocated via malloc, above which a heap dump will be triggered.

"malloc-mem-min-heap-dump-interval" specifies the time interval in
seconds between consecutive memory heap dumps if usage stays above
threshold

"malloc-mem-max-heap-dump-files" specifies the max number of latest
heap profiles to keep.

These can be used to implement a malloc memory checking mechanism that
periodically checks memory allocated via malloc and triggers actions
like dumping heap profiles if the usage exceeds a certain limit.
This can be used as an effective debugging tool for understanding
where the excessive usage is allocated.

@bikramSingh91 bikramSingh91 requested a review from a team as a code owner November 30, 2023 20:19
Copy link
Contributor

@xiaoxmeng xiaoxmeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bikramSingh91 LGTM % minors. Thanks!

Copy link
Contributor

@xiaoxmeng xiaoxmeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bikramSingh91 LGTM. Thanks!

@bikramSingh91 bikramSingh91 force-pushed the add_configs_mem_check branch 3 times, most recently from 6907c78 to a0e18c2 Compare December 5, 2023 22:59
Copy link
Contributor

@xiaoxmeng xiaoxmeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bikramSingh91 thanks for the update!

Configs added:
"malloc-mem-heap-dump-enabled" is set to enable or disable periodic
malloc memory usage checks and dump heap profile if usage exceeds a
certain threshold.

"malloc-heap-dump-threshold-gb" the threshold in GigaBytes of memory
allocated via malloc, above which a heap dump will be triggered.

"malloc-mem-min-heap-dump-interval" specifies the time interval in
seconds between consecutive memory heap dumps if usage stays above
threshold

"malloc-mem-max-heap-dump-files" specifies the max number of latest
heap profiles to keep.

These can be used to implement a malloc memory checking mechanism that
periodically checks memory allocated via malloc and triggers actions
like dumping heap profiles if the usage exceeds a certain limit.
This can be used as an effective debugging tool for understanding
where the excessive usage is allocated.
@xiaoxmeng xiaoxmeng merged commit 072216f into prestodb:master Dec 7, 2023
@wanglinsong wanglinsong mentioned this pull request Feb 12, 2024
64 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants