Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Throttling support for all redshift databases #247

Merged
merged 2 commits into from
Jul 29, 2021
Merged

Conversation

alok87
Copy link
Contributor

@alok87 alok87 commented Jul 29, 2021

Currently redshift metrics are exported only for one database. Redshift system tables return response for only the database the connection is for. Since Redshift does not support cross db queries for System tables.

We are doing below:

  1. The scan_query_total view would need to be created for all dbs.
  2. The --databases needs to be passed to the operator.
  3. The operator would run the fetch for query_total for all dbs then. Default is still to use the one database based on config.

alok87 added 2 commits July 29, 2021 14:19
Currently redshift metrics are exported only for one database. Redshift system tables return response for only the database the connection is for. Since Redshift does not support cross db queries for System tables.

We are doing below:
1. The scan_query_total view would need to be created for all dbs.
2. The --databases needs to be passed to the operator.
3. The operator would run the fetch for query_total for all dbs then. Default is still to use the one database based on config.
@alok87 alok87 added the bug Something isn't working label Jul 29, 2021
@alok87 alok87 merged commit aeae0df into master Jul 29, 2021
@alok87
Copy link
Contributor Author

alok87 commented Sep 3, 2021

Image is available as: v1.0.0-beta.1-9-gaeae0df

practodev/redshiftbatcher:v1.0.0-beta.1-9-gaeae0df
practodev/redshiftloader:v1.0.0-beta.1-9-gaeae0df
practodev/redshiftsink:v1.0.0-beta.1-9-gaeae0df

@alok87 alok87 deleted the multiple-svv-views branch September 14, 2021 05:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant