Add TGI dashboard and integration (#883)

Adds a TGI sample dashboard, associated with integration metadata (currently HIDDEN; will launch after validation and docs updates). go/tgi-dashboard-dev-notes (internal link)
GoogleCloudPlatform · Dec 16, 2024 · 5437a1b · 5437a1b
1 parent 5ffe87e
commit 5437a1b
Show file tree

Hide file tree

Showing 7 changed files with 2,015 additions and 0 deletions.
diff --git a/dashboards/tgi/README.md b/dashboards/tgi/README.md
@@ -0,0 +1,6 @@
+### Dashboards for TGI
+
+|TGI Prometheus Overview|
+|:------------------|
+|Filename: [tgi-prometheus.json](tgi-prometheus.json)|
+|This dashboard has charts for an overview of TGI performance, including graphs of inference request throughput, tokens throughput, latency and batching behavior. |
diff --git a/dashboards/tgi/metadata.yaml b/dashboards/tgi/metadata.yaml
@@ -0,0 +1,7 @@
+sample_dashboards:
+  -
+    category: TGI
+    id: tgi-prometheus
+    display_name: TGI Prometheus Overview
+    description: |-
+      This dashboard has charts for an overview of TGI performance, including graphs of inference request throughput, tokens throughput, latency and batching behavior. 
diff --git a/dashboards/tgi/tgi-prometheus.01.png b/dashboards/tgi/tgi-prometheus.01.png
diff --git a/dashboards/tgi/tgi-prometheus.02.png b/dashboards/tgi/tgi-prometheus.02.png