diff --git a/dashboards/truera/truera-01.png b/dashboards/truera/truera-01.png new file mode 100644 index 0000000000..3aaa1aaef5 Binary files /dev/null and b/dashboards/truera/truera-01.png differ diff --git a/dashboards/truera/truera.json b/dashboards/truera/truera.json index bf5c506033..337a1a74c1 100644 --- a/dashboards/truera/truera.json +++ b/dashboards/truera/truera.json @@ -7,80 +7,65 @@ "description": null, "widgets": [ { - "visualization": { - "id": "viz.markdown" - }, + "title": "", "layout": { "column": 1, "row": 1, - "height": 3, - "width": 5 + "width": 6, + "height": 3 + }, + "linkedEntityGuids": null, + "visualization": { + "id": "viz.markdown" }, - "title": "", "rawConfiguration": { "text": "![Add Images](https://truera.com/wp-content/uploads/2021/04/Group-70.svg)\n\nTruEra provides best in class AI Quality diagnostics and monitoring solution. With this integration, TruEra and NewRelic users can go beyond standard accuracy, input and output drift monitoring by identifying consequential data drift, and other AI Quality diagnostics such as fairness, conceptual soundness and segment behavior. When combined with NewRelic’s comprehensive observability capabilities, MLOps teams can correlate signals throughout the ML lifecycle.\n\nIf you are new to Truera and want to learn more, [contact us](https://truera.com/#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI2MDAiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D)" - }, - "linkedEntityGuids": null + } }, { - "visualization": { - "id": "viz.markdown" - }, + "title": "", "layout": { - "column": 6, + "column": 7, "row": 1, - "height": 3, - "width": 6 + "width": 6, + "height": 3 + }, + "linkedEntityGuids": null, + "visualization": { + "id": "viz.markdown" }, - "title": "", "rawConfiguration": { "text": "\n# Startup Guide\n\n## Initial bootstrap\n\n* Create and store Truera API key and New Relic API keys.\n* Install truera2newrelic tool.\n\n## Once per model:\n\n* For models to be monitored using new relic, stream metrics from truera to new relic using \"truera2newrelic metrics\" command. The data will show up in model score instability graph below.\n* Setup one dashboard in New Relic per ML model using \"truera2newrelic dashboard\" command. This dashboard will allow you to monitor data and analyze/diagnose issues.\n\nStep by step guide is part of [Trurea - New Relic integration doc](https://docs.newrelic.com/docs/alerts-applied-intelligence/applied-intelligence/mlops-integrations/truera-integration/)\n" - }, - "linkedEntityGuids": null + } }, { - "visualization": { - "id": "viz.markdown" - }, + "title": "", "layout": { "column": 1, "row": 4, - "height": 1, - "width": 3 + "width": 3, + "height": 2 + }, + "linkedEntityGuids": null, + "visualization": { + "id": "viz.markdown" }, - "title": "", "rawConfiguration": { "text": "# [Monitor models in New Relic Dashboard](launcher/dashboards.launcher?platform[filters]=IihuYW1lIExJS0UgJ1RydWVyYSBVbmlmaWVkJyBPUiBpZCA9ICdUcnVlcmEgVW5pZmllZCcgT1IgZG9tYWluSWQgPSAnVHJ1ZXJhIFVuaWZpZWQnKSI=&platform[accountId]=3206889&pane=eyJuZXJkbGV0SWQiOiJkYXNoYm9hcmRzLmhvbWUifQ==)\n" - }, - "linkedEntityGuids": null + } }, { - "visualization": { - "id": "viz.markdown" - }, + "title": "Model Instability(NUMERICAL_WASSERSTEIN)", "layout": { "column": 4, "row": 4, - "height": 1, - "width": 3 + "width": 9, + "height": 3 }, - "title": "", - "rawConfiguration": { - "text": "## [Contact Truera team](https://truera.com/#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI2MDAiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D)" - }, - "linkedEntityGuids": null - }, - { + "linkedEntityGuids": null, "visualization": { "id": "viz.line" }, - "layout": { - "column": 1, - "row": 5, - "height": 3, - "width": 10 - }, - "title": "Model Instability(NUMERICAL_WASSERSTEIN)", "rawConfiguration": { "legend": { "enabled": true @@ -94,10 +79,26 @@ "yAxisLeft": { "zero": true } + } + }, + { + "title": "", + "layout": { + "column": 1, + "row": 6, + "width": 3, + "height": 1 + }, + "linkedEntityGuids": null, + "visualization": { + "id": "viz.markdown" }, - "linkedEntityGuids": null + "rawConfiguration": { + "text": "## [Contact Truera team](https://truera.com/#elementor-action%3Aaction%3Dpopup%3Aopen%26settings%3DeyJpZCI6IjI2MDAiLCJ0b2dnbGUiOmZhbHNlfQ%3D%3D)" + } } ] } - ] -} + ], + "variables": [] +} \ No newline at end of file diff --git a/quickstarts/mlops/truera/config.yml b/quickstarts/mlops/truera/config.yml index 40b952cc65..a5cf3bb057 100644 --- a/quickstarts/mlops/truera/config.yml +++ b/quickstarts/mlops/truera/config.yml @@ -2,9 +2,10 @@ id: 81402789-9ae9-4cbd-8686-4d2d4de8951f slug: truera title: Truera description: | - TruEra provides best in class AI Quality diagnostics and monitoring solution. TruEra and NewRelic users can go beyond standard accuracy, input and output drift monitoring by identifying consequential data drift, and other AI Quality diagnostics such as fairness, conceptual soundness and segment behavior. When combined with NewRelic’s comprehensive observability capabilities, MLOps teams can correlate signals throughout the ML lifecycle. + ## Why monitor TrueEra? + Monitoring TruEra with New Relic ensures real-time visibility into AI model performance, facilitating proactive optimization and enhancing reliability. By tracking key metrics and identifying anomalies, organizations can ensure the accuracy and efficiency of their AI models, leading to improved business outcomes and customer satisfaction. New Relic’s comprehensive monitoring capabilities empower teams to detect issues early, streamline troubleshooting, and optimize AI model operations, ultimately driving innovation and competitive advantage in today’s data-driven landscape. summary: | - With TruEra you can go beyond standard accuracy, input and output drift monitoring and identify consequential data drift and other AI quality diagnostics as well as correlate signals throughout the machine learning lifecycle. + Monitoring TruEra with New Relic provides real-time insights into model performance, enabling proactive optimization and ensuring the reliability and accuracy of AI models, ultimately enhancing business outcomes and customer satisfaction. level: New Relic authors: - Truera