-
Notifications
You must be signed in to change notification settings - Fork 301
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #2070 from pkosanam/nr-158263-mosaic
NR-158263 MosaicML
- Loading branch information
Showing
2 changed files
with
87 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,49 @@ | ||
slug: mosaicml | ||
description: | | ||
## Why should you monitor your usage of MosaicML? | ||
Monitor your application powered by MosaicML language models to ensure, get visibility to what you send to MosaicML, responses received from MosaicML, latency, usage and errors. By monitoring the usage, you can infer the cost. | ||
### Track the LLM's performance: | ||
Monitor the input & output, latency and errors of your LLM provider. Track performance changes with the providers and versions of your LLM. Monitor usage to understand the cost, rate limits, and general performance. | ||
### Track your app: | ||
By tracking key metrics like latency, throughput, error rates, and input & output, you can gain insights into your MosaicML app's performance and identify areas of improvement. | ||
### Early issue detection: | ||
Detect and address issues early to prevent them from affecting model performance. | ||
## Comprehensive MosaicML monitoring quickstart | ||
Our MosaicML quickstart provides metrics including error rate, input & output, latency, queries, and lets you integrate with different language models. | ||
## What’s included in the MosaicML quickstart? | ||
New Relic MosaicML monitoring quickstart provides a variety of pre-built dashboards, which will help you gain insights into the health and performance of your MosaicML usage. These reports include: | ||
- Dashboards (average tokens, LLM completion’s details, chain’s details, tool details, top tool names and many more) | ||
- Alerts (errors, request per model and response time) | ||
summary: | | ||
Improve the visibility of your MosaicML usage with New Relic MosaicML quickstart. | ||
icon: logo.svg | ||
level: | ||
- New Relic | ||
authors: | ||
- New Relic | ||
title: MosaicML | ||
documentation: | ||
- name: MosaicML integration documentation | ||
description: | | ||
Implement monitoring and instrumentation for your MosaicML app to ensure that your observability data is integrated into New Relic for effective performance analysis and insights. | ||
url: https://github.com/newrelic/nr-openai-observability | ||
dataSourceIds: | ||
- langchain | ||
keywords: | ||
- mosaicml | ||
- mosaicml ai | ||
- langchain | ||
- mlops | ||
- large language model | ||
- natural language processing | ||
- machine learning | ||
- artificial intelligence | ||
- ai | ||
- generative ai | ||
- NR1_addData | ||
alertPolicies: | ||
- langchain | ||
dashboards: | ||
- langchain |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.