[Metrics] Add audio SLOs + cross-stage transfer families + per-(stage, replica) wrap for upstream vllm:*#3576

Merged

Gaohan123 merged 45 commits into

vllm-project:mainfrom

LHXuuu:support_prometheus

Jun 1, 2026

Commits on May 13, 2026

[Feature] Add Prometheus metrics for multi-stage pipelines

vraiti
authored and
LHXuuu
committed
[Metrics] Add shared definitions module for Prometheus and bench CLI
LHXuuu
committed
[Metrics] Add relabel mixin for upstream PrometheusStatLogger wrap
LHXuuu
committed
[Metrics] Handle positional .labels() and str engine values in relabel mixin
LHXuuu
committed
[Metrics] Add OmniPrometheusStatLogger subclass with per-replica labels
LHXuuu
committed
[Metrics] Wire OmniPrometheusStatLogger into orchestrator
LHXuuu
committed
[Metrics] Add OmniModalityMetrics with 8 audio/image/video families
LHXuuu
committed
[Metrics] Wire OmniModalityMetrics finalize hook for audio/image/video
LHXuuu
committed
[Metrics] Wire audio_ttfp_seconds streaming hook for first-packet observation
LHXuuu
committed
[Metrics] Add OmniTransferMetrics for cross-stage transfer observability
LHXuuu
committed
[Metrics] Replace num_requests_success/fail with requests_success_total{finished_reason}
LHXuuu
committed
[Docs] Update metrics docs to cover G1/G2/G3/G6/G7 work
LHXuuu
committed

Commits on May 15, 2026

[Metrics] Fix OmniPrometheusStatLogger crash from helper-class label mismatch
LHXuuu
committed

Commits on May 21, 2026

Merge remote-tracking branch 'upstream/main' into support_prometheus
LHXuuu
committed

Commits on May 22, 2026

[Metrics] Align vllm_omni:* surface
LHXuuu
committed

Commits on May 27, 2026

Commits on May 30, 2026

Commits on May 31, 2026

Commits on Jun 1, 2026