-
Notifications
You must be signed in to change notification settings - Fork 641
feat: implement ProgressLogger for Full Pruning, Trie Verification and Analytics operations #9146
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
PROGRESS_LOGGER_LOG_SAMPLES.md
Outdated
| @@ -0,0 +1,109 @@ | |||
| # ProgressLogger Log Samples | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I mean, put it in the pr descrpition, not committing it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I've committed it for the sake of you to review it and tell what you think, and after I was gonna delete it
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
But now gonna do as you wish
|
|
||
| public void VisitTree(in OldStyleTrieVisitContext _, in ValueHash256 rootHash) | ||
| { | ||
| if (_progressLogger is not null) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Dont make it optional then. In test, there is LimboLog.
|
|
||
| // For now, we'll use a conservative estimate based on typical state sizes | ||
| // This can be improved with more sophisticated estimation logic | ||
| return 10_000_000; // Conservative estimate for mainnet state |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do it properly, or don't at all.
Closes #8504
Changes
Key Features
Files Modified
ProgressLogger Log Samples
Here are examples of the improved logging output for various operations after implementing ProgressLogger improvements:
Full Pruning Log Samples
Starting Full Pruning:
During Full Pruning (Progress Updates):
Completed Full Pruning:
Trie Verification Log Samples
Starting Trie Verification:
2024-01-15 11:00:00.000 | INFO | Trie Verification Progress: 0 | Speed: 0 nodes/sec | [████████████████████] 0%During Trie Verification:
Completed Trie Verification:
Supply Verification Log Samples
Starting Supply Verification:
2024-01-15 12:00:00.000 | INFO | Supply Verification Progress: 0 | Speed: 0 accounts/sec | [████████████████████] 0%During Supply Verification:
Completed Supply Verification:
Total Difficulty Fix Migration Log Samples
Starting Migration:
2024-01-15 13:00:00.000 | INFO | TotalDifficulty Fix Progress: 0 / 1,000,000 (0.0%) | Speed: 0 blocks/sec | [████████████████████] 0%During Migration:
Completed Migration: