Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a constant amount of memory for error slices and add error abstraction #57

Merged
merged 1 commit into from
Jul 3, 2024

Conversation

vegarsti
Copy link
Member

@vegarsti vegarsti commented Jul 2, 2024

This PR changes the Info struct in the Ingester a bit so that we have an inner Errors struct for keeping track of errors. We add a method for resetting at, for observing errors, and for transforming to progress reports. We make sure that the error slices do not grow unbounded, but we keep track of the total error counts as well.

Copy link
Member Author

vegarsti commented Jul 2, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @vegarsti and the rest of your teammates on Graphite Graphite

@vegarsti vegarsti changed the title Limit the number of errors stored and reported Use a constant amount of memory for error slices Jul 2, 2024
ingester/send.go Outdated Show resolved Hide resolved
@vegarsti vegarsti force-pushed the cap-errors branch 2 times, most recently from 6bb20b9 to 94af396 Compare July 2, 2024 13:31
@vegarsti vegarsti changed the title Use a constant amount of memory for error slices Use a constant amount of memory for error slices and add error abstraction Jul 2, 2024
@vegarsti vegarsti force-pushed the cap-errors branch 2 times, most recently from 49ef4d8 to 21299a0 Compare July 2, 2024 13:35
@vegarsti
Copy link
Member Author

vegarsti commented Jul 2, 2024

@adammilnesmith Is this something like what you were envisioning? Maybe this became a bit of scope creep 🤔

ingester/models.go Outdated Show resolved Hide resolved
@vegarsti vegarsti merged commit 6d60696 into main Jul 3, 2024
1 check passed
@vegarsti vegarsti deleted the cap-errors branch July 3, 2024 06:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants