Skip to content

Commit

Permalink
Merge pull request #2187 from pkudikyala/NR-157482-AI21-Labs
Browse files Browse the repository at this point in the history
AI21 Labs Quickstart.
  • Loading branch information
mdumpati authored Jan 18, 2024
2 parents 77976aa + 2010c8f commit 69ed8e4
Show file tree
Hide file tree
Showing 2 changed files with 46 additions and 0 deletions.
46 changes: 46 additions & 0 deletions quickstarts/ai21-labs/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
slug: ai21-labs
description: |
## Why should you monitor your usage of AI21 Labs?
Monitor your application powered by AI21 Labs language models to ensure, get visibility to what you send to AI21 Labs, responses received from AI21 Labs, latency, usage and errors. By monitoring the usage, you can infer the cost.
### Track the LLM's performance:
Monitor the input & output, latency and errors of your LLM provider. Track performance changes with the providers and versions of your LLM. Monitor usage to understand the cost, rate limits, and general performance.
### Track your app:
By tracking key metrics like latency, throughput, error rates, and input & output, you can gain insights into your LangChain app's performance and identify areas of improvement.
### Early issue detection:
Detect and address issues early to prevent them from affecting model performance.
## Comprehensive AI21 Labs monitoring quickstart
Our AI21 Labs quickstart provides metrics including error rate, input & output, latency, queries, and lets you integrate with different language models.
## What’s included in the AI21 Labs quickstart?
New Relic AI21 Labs monitoring quickstart provides a variety of pre-built dashboards, which will help you gain insights into the health and performance of your AI21 Labs usage. These reports include:
- Dashboards (average tokens, LLM completion’s details, chain’s details, tool details, top tool names and many more)
- Alerts (errors, request per model and response time)
summary: |
Improve the visibility of your AI21 Labs usage with New Relic AI21 Labs quickstart.
icon: logo.png
level:
- New Relic
authors:
- New Relic
title: AI21 Labs
documentation:
- name: AI21 Labs integration documentation
description: |
Implement monitoring and instrumentation for your AI21 Labs app to ensure that your observability data is integrated into New Relic for effective performance analysis and insights.
url: https://github.com/newrelic/nr-openai-observability
dataSourceIds:
- langchain
keywords:
- ai21-labs
- ai21-labs ai
- mlops
- large language model
- natural language processing
- machine learning
- artificial intelligence
- ai
- generative ai
- NR1_addData
alertPolicies:
- langchain
dashboards:
- langchain
Binary file added quickstarts/ai21-labs/logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 69ed8e4

Please sign in to comment.