Skip to content
This repository was archived by the owner on Jan 22, 2025. It is now read-only.

Prevent unbound memory growth by blockstore_processor#12110

Merged
ryoqun merged 5 commits intosolana-labs:masterfrom
ryoqun:exhaustive-free-blockstore-processor
Sep 9, 2020
Merged

Prevent unbound memory growth by blockstore_processor#12110
ryoqun merged 5 commits intosolana-labs:masterfrom
ryoqun:exhaustive-free-blockstore-processor

Conversation

@ryoqun
Copy link
Copy Markdown
Contributor

@ryoqun ryoqun commented Sep 8, 2020

Problem

#11727 wasn't enough. When replaying large number of slots, the memory growth is unbound at relatively quick rate.

Summary of Changes

Free any garbage resource laying around AccountsDB and really Drop::drop() banks by cleaning them from all_banks too.

Context

found via capitalization work.

@ryoqun ryoqun requested a review from carllin September 8, 2020 13:21
@codecov
Copy link
Copy Markdown

codecov Bot commented Sep 8, 2020

Codecov Report

Merging #12110 into master will decrease coverage by 0.0%.
The diff coverage is 40.0%.

@@            Coverage Diff            @@
##           master   #12110     +/-   ##
=========================================
- Coverage    82.0%    82.0%   -0.1%     
=========================================
  Files         337      337             
  Lines       79182    79205     +23     
=========================================
+ Hits        64994    65001      +7     
- Misses      14188    14204     +16     

carllin
carllin previously approved these changes Sep 8, 2020
@carllin
Copy link
Copy Markdown
Contributor

carllin commented Sep 8, 2020

ah doh! good catch on the all_banks

@mergify mergify Bot dismissed carllin’s stale review September 8, 2020 20:03

Pull request has been modified.

@ryoqun ryoqun merged commit c274e26 into solana-labs:master Sep 9, 2020
@ryoqun ryoqun added the v1.3 label Sep 9, 2020
mergify Bot pushed a commit that referenced this pull request Sep 9, 2020
* Prevent unbound memory growth by blockstore_processor

* Promote log to info! considering infrequency

* Exclude the time of freeing from interval...

* Skip not-shrinkable slots even if forced

* Add comment

(cherry picked from commit c274e26)
mergify Bot added a commit that referenced this pull request Sep 9, 2020
* Prevent unbound memory growth by blockstore_processor

* Promote log to info! considering infrequency

* Exclude the time of freeing from interval...

* Skip not-shrinkable slots even if forced

* Add comment

(cherry picked from commit c274e26)

Co-authored-by: Ryo Onodera <ryoqun@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants