README.md

tap-grafana

This is a Singer tap that produces JSON-formatted data following the Singer spec.

This tap:

• Pulls raw data from Sumologic
• Extracts the aggregated data based on a search query for a date range
• Outputs the schema for each resource
• Incrementally pulls data based on the input state

Config

config.json

{
    "grafana_access_id": "ACCESS_ID",
    "grafana_access_key": "ACCESS_KEY",
    "grafana_root_url": "https://logs-prod-006.grafana.net/",
    "start_date": "2020-01-01T00:00:00",
    "end_date": "2020-01-05T00:00:00",
    "tables": [{
        "query": "count_over_time({service_name=\"fastly\"}",
        "table_name": "my_table",
        "max_lookback_days": 10, 
        "interval": "1d"
    }]
}

max_lookback_days: by default is 7 days. Number of days it queries Grafana Loki back from today. interval: this is the granularity you want the data to be structured by. It currently supports "1d" (1 day) or "1h" (1 hour)