-
Notifications
You must be signed in to change notification settings - Fork 463
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[AWS] Add metric type to SNS, SQS and Billing data streams #6319
[AWS] Add metric type to SNS, SQS and Billing data streams #6319
Conversation
Signed-off-by: constanca-m <[email protected]>
Signed-off-by: constanca-m <[email protected]>
Signed-off-by: constanca-m <[email protected]>
Signed-off-by: constanca-m <[email protected]>
🌐 Coverage report
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
Can this PR be merged after code-owner review? |
packages/aws/changelog.yml
Outdated
@@ -1,4 +1,9 @@ | |||
# newer versions go on top | |||
- version: "1.36.9" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: in #6365 we bumped minor version, here only patch one
why the difference? :)
Package aws - 1.40.0 containing this change is available at https://epr.elastic.co/search?package=aws |
* Add metric type to SNS. Signed-off-by: constanca-m <[email protected]> * Add metric type to SQS. Signed-off-by: constanca-m <[email protected]> * Add metric type to Billing. Signed-off-by: constanca-m <[email protected]> * Update changelog. Signed-off-by: constanca-m <[email protected]> * Update files. Signed-off-by: constanca-m <[email protected]> --------- Signed-off-by: constanca-m <[email protected]>
What does this PR do?
Adds metric type to SNS, SQS and Billing data streams.
Billing:
From my understanding, most metrics are estimates, so they can go up and down. The ones that are not (
UnblendedCost
andUsageQuantity
) consider a specific time window.SNS:
![Screenshot from 2023-05-25 09-34-52](https://private-user-images.githubusercontent.com/113898685/240862927-944e1729-fc99-4569-be74-94f34a57b963.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxMjk1MTUsIm5iZiI6MTczOTEyOTIxNSwicGF0aCI6Ii8xMTM4OTg2ODUvMjQwODYyOTI3LTk0NGUxNzI5LWZjOTktNDU2OS1iZTc0LTk0ZjM0YTU3Yjk2My5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjA5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIwOVQxOTI2NTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT04MTc0NWQ1N2RhNWQ2ZWM1MmM4MDhlNmY2YzQwMGQ1NjI0NjY4ZDUwY2YzNGJkOGEyZmY5YzU4OTMyNzY3MjBjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.WSX6FbsArHPpew4aBiCqFvPnArpydxUmYjQ7ch3ewpM)
Values are only considered for a specific time window, after that they reset for the next time window. This causes lots of ups and downs over time, and since the next value received for a specific field does not take into account the previous, all of them were considered gauge. Take this field (
NumberOfMessagesPublished.sum
) as an example:SQS:
![Screenshot from 2023-05-25 10-22-39](https://private-user-images.githubusercontent.com/113898685/240863062-2c67976f-74ce-4913-8a5a-483f2b1a5db3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxMjk1MTUsIm5iZiI6MTczOTEyOTIxNSwicGF0aCI6Ii8xMTM4OTg2ODUvMjQwODYzMDYyLTJjNjc5NzZmLTc0Y2UtNDkxMy04YTVhLTQ4M2YyYjFhNWRiMy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjA5JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIwOVQxOTI2NTVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hMTY5MmNkMDZiZTZmOTQ5YTk4ZGExYzY3ZTI0M2M2M2NiOTcyOWE5ZmJiMzZiOGU2MzkzZDMwNmY3OGJhYjNlJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.y1HQHWFj1KXkQIFl3gemQ0Do_B8u5EZwFBsCz9EnhqI)
Same logic was applied. Example of a gauge field that might look like a counter from the description is
messages.received
. When we visualize that metric, we can see that is in fact a gauge:Checklist
changelog.yml
file.Author's Checklist
How to test this PR locally
Refer to #6293.
Related issues
Relates to #6293.