[Meta] Istio Metricbeat Module

[ChrsMark]

Istio Metricbeat Module

This is issue aims to track any implementation, concern, discussion, proposal around Istio integration with Metricbeat.

Istio: https://istio.io/
Istio Metrics:

• https://istio.io/docs/tasks/observability/metrics/collecting-metrics/
• https://istio.io/docs/tasks/observability/metrics/querying-metrics/#about-the-prometheus-add-on
• https://istio.io/docs/reference/config/policy-and-telemetry/metrics/

Metricbeat Module / Dataset release checklist

This checklist is intended for Devs which create or update a module to make sure modules are consistent.

Modules

For a metricset to go GA, the following criterias should be met:

• Supported versions are documented
• Supported operating systems are documented (if applicable)
• Integration tests exist
• System tests exist
• Automated checks that all fields are documented
• Documentation
• Fields follow ECS and naming conventions
• Dashboards exists (if applicable)
• Kibana Home Tutorial (if applicable)
  • Open PR against Kibana repo with tutorial. Examples can be found here.

Metricbeat module

• Example data.json exists and an automated way to generate it exists (go test -data)
• Test environment in Docker exist for integration tests

cc: @exekias

[ChrsMark]

We should scrape metrics from each exporter and not from the Prometheus federate API to avoid problems with types as mentioned at #15535 (comment).

Proposed Metricsets

• istio-mesh metrics: Add Istio mesh metricset #15535
• istio-telemetry metrics [Metricbeat][Istio] Add mixer metricset #15696
• Pilot metrics [Metricbeat][Istio] Add pilot metricset #15761
• Galley metrics Add galley metricset for Istio Metricbeat module #15857
• Citadel metrics Add citadel metricset for Istio Metricbeat module #15990
• Proxy metrics
• Policy metrics

istio-telemetry.istio-system:42422: The istio-mesh job returns all Mixer-generated metrics.
istio-telemetry.istio-system:15014: The istio-telemetry job returns all Mixer-specific metrics. Use this endpoint to monitor Mixer itself.
istio-proxy:15090: The envoy-stats job returns raw stats generated by Envoy. Prometheus is configured to look for pods with the envoy-prom endpoint exposed. The add-on configuration filters out a large number of envoy metrics during collection in an attempt to limit the scale of data by the add-on processes.
istio-pilot.istio-system:15014: The pilot job returns the Pilot-generated metrics.
istio-galley.istio-system:15014: The galley job returns the Galley-generated metrics.
istio-policy.istio-system:15014: The istio-policy job returns all policy-related metrics.
istio-citadel.istio-system:15014: The istio-citadel job returns all Citadel-generated metrics.

Tasks

• Implement metricsets
• Refactor histogram type metrics on top of new ES Histograms, issue
• Create Dashboards
• Explore possible integration with ES graphs

[ioandr]

Hi folks,

this issue seems very interesting and I would like to contribute some dev cycles on this. For a start, I could take on some of the proposed metricsets, e.g., the Pilot metrics.

@ChrsMark WDYT?

[ChrsMark]

This is great @ioandr, feel free to work on this!