Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(generic-metrics): Add gauges to docker compose, re-try #3177

Merged
merged 2 commits into from
Jul 16, 2024

Conversation

ayirr7
Copy link
Member

@ayirr7 ayirr7 commented Jul 2, 2024

Adding this missing consumer, this is a repeat of #2757

Copy link

codecov bot commented Jul 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 99.01%. Comparing base (da06c0f) to head (1c0faa7).

✅ All tests successful. No failed tests found.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #3177   +/-   ##
=======================================
  Coverage   99.01%   99.01%           
=======================================
  Files           3        3           
  Lines         203      203           
=======================================
  Hits          201      201           
  Misses          2        2           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@@ -293,6 +293,9 @@ services:
snuba-generic-metrics-counters-consumer:
<<: *snuba_defaults
command: rust-consumer --storage generic_metrics_counters_raw --consumer-group snuba-gen-metrics-counters-consumers --auto-offset-reset=latest --max-batch-time-ms 750 --no-strict-offset-reset
snuba-generic-metrics-gauges-consumer:
<<: *snuba_defaults
command: consumer --storage generic_metrics_gauges_raw --consumer-group snuba-gen-metrics-gauges-consumers --auto-offset-reset=latest --max-batch-time-ms 750 --no-strict-offset-reset
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you sure that you don't want to use rust-consumer?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, let me fix that.

@hubertdeng123
Copy link
Member

Wouldn't this also require us to flip the feature flags for custom metrics? Otherwise, what is this consumer used for?

@ayirr7
Copy link
Member Author

ayirr7 commented Jul 3, 2024

Wouldn't this also require us to flip the feature flags for custom metrics?

Could you point me to the feature flags you're referring to? But yes, you are correct that today the gauges consumer is only used by the custom metrics functionality. I reopened this PR as I heard there was interest/questions around using this.

@aldy505
Copy link
Collaborator

aldy505 commented Jul 3, 2024

Wouldn't this also require us to flip the feature flags for custom metrics? Otherwise, what is this consumer used for?

I think it's fine since AFAIK Metrics isn't GA yet. We can add the flags in a separate PR.

@hubertdeng123
Copy link
Member

@aldy505 I'd like to avoid adding bloat to the docker compose file if it pertains to a feature that is not yet used.

I believe adding the gauge consumer now is a good idea, since it will ingest some data beforehand, that can be viewed later on the UI when GA's arrived -- so the Metrics UI won't be empty when it's enabled.

@ayirr7 Is this the case here?

@aldy505
Copy link
Collaborator

aldy505 commented Jul 10, 2024

Ping @ayirr7. We are 5 more days until the next release.

@patrickklaeren
Copy link

Is there any news on when this might be merged?

I understand this has now missed the window for .7

@ayirr7
Copy link
Member Author

ayirr7 commented Jul 16, 2024

I believe adding the gauge consumer now is a good idea, since it will ingest some data beforehand, that can be viewed later on the UI when GA's arrived -- so the Metrics UI won't be empty when it's enabled.

I believe this should be the case here. The consumer will ingest any relevant data. Once any feature(s) are enabled, they can be used to query the data.

I'm not sure what the timelines are for these features being available/being used. I have asked in relevant spots but have not heard back.

cc @hubertdeng123 , should I go ahead with merging this?

@ayirr7 ayirr7 merged commit ca5f35c into master Jul 16, 2024
14 checks passed
@ayirr7 ayirr7 deleted the docker-add-gauges branch July 16, 2024 16:59
@aldy505
Copy link
Collaborator

aldy505 commented Jul 16, 2024

Thanks Riya! @ayirr7

@github-actions github-actions bot locked and limited conversation to collaborators Aug 1, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants