chore: add debug histograms for s3 object size and events per processed s3 object #40775
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
botelastic
bot
added
the
needs_team
mergify
bot
added
the
backport-8.x
Kavindu-Dodan
added
backport-skip
mergify
bot
added
the
backport-8.x
Kavindu-Dodan
added
Team:obs-ds-hosted-services
botelastic
bot
removed
the
needs_team
|
Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services) |
mergify
bot
added
the
backport-8.x
Kavindu-Dodan
removed
the
backport-8.x
mergify
bot
added
the
backport-8.x
Kavindu-Dodan
removed
the
backport-8.x
Signed-off-by: Kavindu Dodanduwa <[email protected]>
Signed-off-by: Kavindu Dodanduwa <[email protected]>
Kavindu-Dodan
force-pushed
the
feat/add-size-metrics
branch
from
22d170a
to
786a2b7
Compare
Kavindu-Dodan
added
backport-8.x
Signed-off-by: Kavindu Dodanduwa <[email protected]>
mergify bot
pushed a commit
that referenced
this pull request
Sep 13, 2024
…ed s3 object (#40775) * add debug histograms for s3 object size and events per object Signed-off-by: Kavindu Dodanduwa <[email protected]> * changelog entry Signed-off-by: Kavindu Dodanduwa <[email protected]> * move changelog to developer next Signed-off-by: Kavindu Dodanduwa <[email protected]> --------- Signed-off-by: Kavindu Dodanduwa <[email protected]> (cherry picked from commit 8f2c3f9)
3 tasks
Kavindu-Dodan
added a commit
that referenced
this pull request
Sep 13, 2024
…ed s3 object (#40775) (#40819) * add debug histograms for s3 object size and events per object Signed-off-by: Kavindu Dodanduwa <[email protected]> * changelog entry Signed-off-by: Kavindu Dodanduwa <[email protected]> * move changelog to developer next Signed-off-by: Kavindu Dodanduwa <[email protected]> --------- Signed-off-by: Kavindu Dodanduwa <[email protected]> (cherry picked from commit 8f2c3f9) Co-authored-by: Kavindu Dodanduwa <[email protected]>
6 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Proposed commit message
Fixes #40306 by adding
s3_events_per_object&s3_object_size_in_byteshistograms. These histograms provide valuable insights on the size of S3 objects filebeat processed and the number of events produced by each S3 object.Consider below screenshot,
s3_events_per_objecttracks events (logs) per object with max, min and counts3_object_size_in_bytestracks object size with max and min and countChecklist
CHANGELOG.next.asciidocorCHANGELOG-developer.next.asciidoc.How to test this PR locally
s3_object_size_in_bytes&s3_events_per_objecthistogramsRelated issues