Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NR-158263 Palm2 #2069

Merged
merged 2 commits into from
Oct 10, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
50 changes: 50 additions & 0 deletions quickstarts/palm-2/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
slug: palm-2
description: |
## Why should you monitor your usage of PaLM 2?
Monitor your application powered by PaLM 2 language models to ensure, get visibility to what you send to PaLM 2, responses received from PaLM 2, latency, usage and errors. By monitoring the usage, you can infer the cost.
### Track the LLM's performance:
Monitor the input & output, latency and errors of your LLM provider. Track performance changes with the providers and versions of your LLM. Monitor usage to understand the cost, rate limits, and general performance.
### Track your app:
By tracking key metrics like latency, throughput, error rates, and input & output, you can gain insights into your PaLM 2 app's performance and identify areas of improvement.
### Early issue detection:
Detect and address issues early to prevent them from affecting model performance.

## Comprehensive PaLM 2 monitoring quickstart
Our PaLM 2 quickstart provides metrics including error rate, input & output, latency, queries, and lets you integrate with different language models.

## What’s included in the PaLM 2 quickstart?
New Relic PaLM 2 monitoring quickstart provides a variety of pre-built dashboards, which will help you gain insights into the health and performance of your PaLM 2 usage. These reports include:
- Dashboards (average tokens, LLM completion’s details, chain’s details, tool details, top tool names and many more)
- Alerts (errors, request per model and response time)
summary: |
Improve the visibility of your PaLM 2 usage with New Relic PaLM 2 quickstart.
icon: logo.svg
level:
- New Relic
authors:
- New Relic
title: PaLM 2
documentation:
- name: PaLM 2 integration documentation
description: |
Implement monitoring and instrumentation for your PaLM 2 app to ensure that your observability data is integrated into New Relic for effective performance analysis and insights.
url: https://github.com/newrelic/nr-openai-observability
dataSourceIds:
- langchain
keywords:
- palm2
- palm 2
- langchain
- mlops
- large language model
- natural language processing
- nlp
- machine learning
- artificial intelligence
- ai
- generative ai
- NR1_addData
alertPolicies:
- langchain
dashboards:
- langchain
67 changes: 67 additions & 0 deletions quickstarts/palm-2/logo.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.