Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create simple test to determine impact buffer size on releasing chunks #2219

Conversation

gpalmer-latai
Copy link
Contributor

Demonstrates the drastic effect that buffering large amounts of chunks has on the performance of releasing chunks. Instructions are in the readme.

On my machine, a buffer depth of 10,000 results in these stats:

Total time elapsed (ns): 4300686066
Max release time (ns): 1490726
Min release time (ns): 0
Avg release time (ns): 430542

If I increase it only to 100,000, the subscriber hangs for at least minutes and needs to be killed.

@gpalmer-latai gpalmer-latai force-pushed the profile_chunk_release_performance branch from 1f57d85 to b806a2e Compare March 11, 2024 21:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant