feat(alloy-mixin): Add filters, groupBy, and multi-select dashboard variables

[thampiotr]

Brief description of Pull Request

Alloy mixin dashboard improvements.

Pull Request Details

• Add ad-hoc filters and groupBy template variable to all dashboards
• Enable multi-select for cluster, namespace, and job variables
• Cluster and namespace default to first value instead of "All" (with custom value support); job and instance keep "All" as default. This is to avoid huge queries by default when you open the dash.
• Change default dashboard refresh rate from 10s to 30s. Most users are on 1DPM.
• Fix scrape panel titles and descriptions to not reference $cluster and to match actual query selectors
• Filter WAL delay outliers caused by zero-value timestamps (< 31536000 > 0)
• Fix OTel Engine pods count sparkline (was instant query + graphMode none)
• Make OTel Engine "recently started" panel a stacked bar chart to be easier to read.

Issue(s) fixed by this Pull Request

Notes to the Reviewer

PR Checklist

• Documentation added
• Tests updated
• Config converters updated

[cursor]

Cursor Agent can help with this pull request. Just @cursor in comments and I'll start working on changes in this branch.
_{Learn more about Cursor Agents}

[Copilot]

Pull request overview

This PR updates the Alloy mixin Grafana dashboards to improve usability and reduce expensive default queries by adding ad-hoc filters, a configurable “group by” variable, and enabling multi-select for key template variables.

Changes:

• Add Prometheus ad-hoc filters (filters) and a “Group by” template variable (groupby) across dashboards, and update queries to aggregate by the selected dimension.
• Enable multi-select for template variables (notably cluster/namespace/job/instance) and adjust defaults to reduce “query everything” behavior.
• Update dashboard behavior and panels (refresh 10s → 30s, scrape panel copy updates, WAL delay outlier filtering, OTel Engine panel fixes/visualization tweaks).

Reviewed changes

Copilot reviewed 21 out of 21 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
operations/alloy-mixin/rendered/dashboards/alloy-resources.json	Rendered Resources dashboard: groupBy aggregation, multi-select vars, refresh update, adhoc filters added.
operations/alloy-mixin/rendered/dashboards/alloy-prometheus-remote-write.json	Rendered Prometheus remote write dashboard: groupBy aggregation, refresh update, adhoc filters and multi-select vars, WAL delay filter tweak.
operations/alloy-mixin/rendered/dashboards/alloy-otel-engine-overview.json	Rendered OTel engine overview: stat/sparkline fixes, “recently started” visualization update, refresh update.
operations/alloy-mixin/rendered/dashboards/alloy-opentelemetry.json	Rendered OpenTelemetry dashboard: groupBy aggregation, multi-select vars, refresh update, adhoc filters added.
operations/alloy-mixin/rendered/dashboards/alloy-loki.json	Rendered Loki components dashboard: groupBy aggregation, multi-select vars, refresh update, adhoc filters added.
operations/alloy-mixin/rendered/dashboards/alloy-logs.json	Rendered logs dashboard: logs volume grouped by groupby, template variable changes, refresh update, adhoc filters added.
operations/alloy-mixin/rendered/dashboards/alloy-controller.json	Rendered controller dashboard: groupBy aggregation, multi-select vars, refresh update, adhoc filters added.
operations/alloy-mixin/rendered/dashboards/alloy-cluster-overview.json	Rendered cluster overview: groupBy aggregation, multi-select vars, refresh update, adhoc filters added.
operations/alloy-mixin/rendered/dashboards/alloy-cluster-node.json	Rendered cluster node: groupBy aggregation, multi-select vars, refresh update, adhoc filters added.
operations/alloy-mixin/dashboards/utils/templates.libsonnet	Template variable factory: adds Prometheus adhoc filters, switches key vars to multi-select, updates default-to-all behavior.
operations/alloy-mixin/dashboards/utils/panel.jsonnet	Panel helpers: adds withDrawStyle utility for timeseries styling.
operations/alloy-mixin/dashboards/utils/dashboard.jsonnet	Dashboard helpers: refresh default to 30s, adds newGroupByTemplateVariable, enhances multi var defaults.
operations/alloy-mixin/dashboards/resources.libsonnet	Resources dashboard source: adds groupby variable, updates queries/legends, annotation selector update.
operations/alloy-mixin/dashboards/prometheus.libsonnet	Prometheus remote write source: groupby support, WAL delay filter guard, URL query updated for multi-select job, template var additions.
operations/alloy-mixin/dashboards/otel-engine-overview.libsonnet	OTel engine source: groupby variable helper usage, pods count stat fix, adds “recently started” stacked bars panel.
operations/alloy-mixin/dashboards/opentelemetry.libsonnet	OpenTelemetry dashboard source: groupby variable and query aggregation updates.
operations/alloy-mixin/dashboards/loki.libsonnet	Loki components dashboard source: groupby variable and query aggregation updates; endpoint query updated for multi-select job.
operations/alloy-mixin/dashboards/controller.libsonnet	Controller dashboard source: groupby variable and query aggregation updates; annotation selector update.
operations/alloy-mixin/dashboards/cluster-overview.libsonnet	Cluster overview source: groupby variable and query aggregation updates; annotation selector update.
operations/alloy-mixin/dashboards/cluster-node.libsonnet	Cluster node source: groupby variable and query aggregation updates; annotation selector update.
operations/alloy-mixin/dashboards/alloy-logs.libsonnet	Logs dashboard source: introduces adhoc filters + groupby var and updates logs volume aggregation + variable defaults.

[Copilot]

Pull request overview

Copilot reviewed 21 out of 21 changed files in this pull request and generated 2 comments.

[Copilot]

Pull request overview

Copilot reviewed 21 out of 21 changed files in this pull request and generated 2 comments.

[kalleep]

Great work, there are come comments from copilot that could be legit

[thampiotr]

Ah, I forgot to resolve them - I did look into them and they were addressed or not legit.