Skip to content

(Feat) New Logging integration - add Datadog LLM Observability support - #6449

Merged
ishaan-jaff merged 12 commits into
mainfrom
litellm_dd_llm_obs
Oct 28, 2024
Merged

(Feat) New Logging integration - add Datadog LLM Observability support #6449
ishaan-jaff merged 12 commits into
mainfrom
litellm_dd_llm_obs

Conversation

@ishaan-jaff

@ishaan-jaff ishaan-jaff commented Oct 26, 2024

Copy link
Copy Markdown
Contributor

Title

Add support for DD LLM Logging product: https://docs.datadoghq.com/llm_observability/setup/api/?tab=example#api-standards

Xnapper-2024-10-26-18 27 21

Usage

model_list:
 - model_name: gpt-3.5-turbo
    litellm_params:
      model: gpt-3.5-turbo
litellm_settings:
   callbacks: ["datadog_llm_observability"] # logs llm success logs on datadog

Relevant issues

Type

🆕 New Feature
🐛 Bug Fix
🧹 Refactoring
📖 Documentation
🚄 Infrastructure
✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

@vercel

vercel Bot commented Oct 26, 2024

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 28, 2024 1:46pm

@codecov

codecov Bot commented Oct 28, 2024

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 83.33333% with 19 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
litellm/integrations/datadog/datadog_llm_obs.py 79.72% 15 Missing ⚠️
litellm/litellm_core_utils/litellm_logging.py 55.55% 4 Missing ⚠️

📢 Thoughts on this report? Let us know!

@ishaan-jaff
ishaan-jaff merged commit 030ece8 into main Oct 28, 2024
@ishaan-berri
ishaan-berri deleted the litellm_dd_llm_obs branch March 26, 2026 21:52
fzowl pushed a commit to fzowl/litellm that referenced this pull request Jun 24, 2026
BerriAI#6449)

* add type for dd llm obs request ob

* working dd llm obs

* datadog use well defined type

* clean up

* unit test test_create_llm_obs_payload

* fix linting

* add datadog_llm_observability

* add datadog_llm_observability

* docs DD LLM obs

* run testing again

* document DD_ENV

* test_create_llm_obs_payload
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant