Skip to content

Commit

Permalink
Merge pull request #2282 from pkudikyala/NR-172653
Browse files Browse the repository at this point in the history
Updated the truera quickstart.
  • Loading branch information
sarahkitten authored Feb 15, 2024
2 parents a62f400 + f96377a commit bff902f
Show file tree
Hide file tree
Showing 3 changed files with 51 additions and 49 deletions.
Binary file added dashboards/truera/truera-01.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
95 changes: 48 additions & 47 deletions dashboards/truera/truera.json
Original file line number Diff line number Diff line change
Expand Up @@ -7,80 +7,65 @@
"description": null,
"widgets": [
{
"visualization": {
"id": "viz.markdown"
},
"title": "",
"layout": {
"column": 1,
"row": 1,
"height": 3,
"width": 5
"width": 6,
"height": 3
},
"linkedEntityGuids": null,
"visualization": {
"id": "viz.markdown"
},
"title": "",
"rawConfiguration": {
"text": "![Add Images](https://truera.com/wp-content/uploads/2021/04/Group-70.svg)\n\nTruEra provides best in class AI Quality diagnostics and monitoring solution. With this integration, TruEra and NewRelic users can go beyond standard accuracy, input and output drift monitoring by identifying consequential data drift, and other AI Quality diagnostics such as fairness, conceptual soundness and segment behavior. When combined with NewRelic’s comprehensive observability capabilities, MLOps teams can correlate signals throughout the ML lifecycle.\n\nIf you are new to Truera and want to learn more, [contact us](https://truera.com/#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI2MDAiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D)"
},
"linkedEntityGuids": null
}
},
{
"visualization": {
"id": "viz.markdown"
},
"title": "",
"layout": {
"column": 6,
"column": 7,
"row": 1,
"height": 3,
"width": 6
"width": 6,
"height": 3
},
"linkedEntityGuids": null,
"visualization": {
"id": "viz.markdown"
},
"title": "",
"rawConfiguration": {
"text": "\n# Startup Guide\n\n## Initial bootstrap\n\n* Create and store Truera API key and New Relic API keys.\n* Install truera2newrelic tool.\n\n## Once per model:\n\n* For models to be monitored using new relic, stream metrics from truera to new relic using \"truera2newrelic metrics\" command. The data will show up in model score instability graph below.\n* Setup one dashboard in New Relic per ML model using \"truera2newrelic dashboard\" command. This dashboard will allow you to monitor data and analyze/diagnose issues.\n\nStep by step guide is part of [Trurea - New Relic integration doc](https://docs.newrelic.com/docs/alerts-applied-intelligence/applied-intelligence/mlops-integrations/truera-integration/)\n"
},
"linkedEntityGuids": null
}
},
{
"visualization": {
"id": "viz.markdown"
},
"title": "",
"layout": {
"column": 1,
"row": 4,
"height": 1,
"width": 3
"width": 3,
"height": 2
},
"linkedEntityGuids": null,
"visualization": {
"id": "viz.markdown"
},
"title": "",
"rawConfiguration": {
"text": "# [Monitor models in New Relic Dashboard](launcher/dashboards.launcher?platform[filters]=IihuYW1lIExJS0UgJ1RydWVyYSBVbmlmaWVkJyBPUiBpZCA9ICdUcnVlcmEgVW5pZmllZCcgT1IgZG9tYWluSWQgPSAnVHJ1ZXJhIFVuaWZpZWQnKSI=&platform[accountId]=3206889&pane=eyJuZXJkbGV0SWQiOiJkYXNoYm9hcmRzLmhvbWUifQ==)\n"
},
"linkedEntityGuids": null
}
},
{
"visualization": {
"id": "viz.markdown"
},
"title": "Model Instability(NUMERICAL_WASSERSTEIN)",
"layout": {
"column": 4,
"row": 4,
"height": 1,
"width": 3
"width": 9,
"height": 3
},
"title": "",
"rawConfiguration": {
"text": "## [Contact Truera team](https://truera.com/#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI2MDAiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D)"
},
"linkedEntityGuids": null
},
{
"linkedEntityGuids": null,
"visualization": {
"id": "viz.line"
},
"layout": {
"column": 1,
"row": 5,
"height": 3,
"width": 10
},
"title": "Model Instability(NUMERICAL_WASSERSTEIN)",
"rawConfiguration": {
"legend": {
"enabled": true
Expand All @@ -94,10 +79,26 @@
"yAxisLeft": {
"zero": true
}
}
},
{
"title": "",
"layout": {
"column": 1,
"row": 6,
"width": 3,
"height": 1
},
"linkedEntityGuids": null,
"visualization": {
"id": "viz.markdown"
},
"linkedEntityGuids": null
"rawConfiguration": {
"text": "## [Contact Truera team](https://truera.com/#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI2MDAiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D)"
}
}
]
}
]
}
],
"variables": []
}
5 changes: 3 additions & 2 deletions quickstarts/mlops/truera/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,10 @@ id: 81402789-9ae9-4cbd-8686-4d2d4de8951f
slug: truera
title: Truera
description: |
TruEra provides best in class AI Quality diagnostics and monitoring solution. TruEra and NewRelic users can go beyond standard accuracy, input and output drift monitoring by identifying consequential data drift, and other AI Quality diagnostics such as fairness, conceptual soundness and segment behavior. When combined with NewRelic’s comprehensive observability capabilities, MLOps teams can correlate signals throughout the ML lifecycle.
## Why monitor TrueEra?
Monitoring TruEra with New Relic ensures real-time visibility into AI model performance, facilitating proactive optimization and enhancing reliability. By tracking key metrics and identifying anomalies, organizations can ensure the accuracy and efficiency of their AI models, leading to improved business outcomes and customer satisfaction. New Relic’s comprehensive monitoring capabilities empower teams to detect issues early, streamline troubleshooting, and optimize AI model operations, ultimately driving innovation and competitive advantage in today’s data-driven landscape.
summary: |
With TruEra you can go beyond standard accuracy, input and output drift monitoring and identify consequential data drift and other AI quality diagnostics as well as correlate signals throughout the machine learning lifecycle.
Monitoring TruEra with New Relic provides real-time insights into model performance, enabling proactive optimization and ensuring the reliability and accuracy of AI models, ultimately enhancing business outcomes and customer satisfaction.
level: New Relic
authors:
- Truera
Expand Down

0 comments on commit bff902f

Please sign in to comment.