BQ-Monitor

If you connect Tableau to a large data set in Google Bigquery, this tool will help you get more insights.

Features

• Get a real-time overview of the current query costs as provides by BigQuery API
• Examine all SQL queries to BigQuery that are generated in the background (scans tablau Logs to make this even more realtime)
• Real-time update to a local JSON-file that can be loaded back to tableau, to visualize it even more

Notice: The tool is in beta stage currently (v.1).

Starting the app (Version 1 beta)

To start the App load the jarfile from dist folder in this repository into a local folder on your computer, open a terminalsession and type "java -jar bq-monitor.jar". In current version DEBUG Logs are printed to the terminal. Please see requirments below.

Requirements

In short you need: Java 1.8, Tableau and a Google Cloud BigQuery Service account. Details see below:

Local requirements to run the tool

• at least Java 1.8 (OpenJDK)

• Tableau Version since 2019.4 released 10/2019 (older Versions are untested, by may work as well). Note that newer versions might have changed the Log Format.

• Knowledge where the Tableau Respository is located (can be checked within Tableau: Menue File > Open Repository Location)

BigQuery requirements

• Google Cloud project
• BigQuery API must be set to "enabled"
• Service Account with the rights to access all users log (Role BigQuery-Admin). Please note, that the Role BigQuery Logs-User is not sufficient in current implementation, because it would only show the Queries taken with the service account itself (what would normally be emtpy).
• export a keyfile als json for that user and place it as "key.json" next to the applications jar file.

Architecture