feat(providers): add Prism provider by rajitkhanna · Pull Request #40914 · BerriAI/litellm

rajitkhanna · 2026-09-12T23:02:26Z

TLDR

Problem this solves:

Prism requires manual provider configuration
Prism model pricing and endpoints are not advertised

How it solves it:

Registers Prism as a native provider
Adds DeepSeek V4 and V4.1 Flash metadata
Enables Chat Completions, Responses, and Messages routing

User Flow

Before: a developer cannot route Prism requests through LiteLLM

They set PRISM_API_KEY and configure prism/deepseek-v4.1-flash
They call Chat Completions, Responses, or Messages through LiteLLM
LiteLLM rejects the provider or cannot resolve the endpoint

After: the same requests route to Prism with correct model pricing

They set PRISM_API_KEY and configure prism/deepseek-v4.1-flash
They call Chat Completions, Responses, or Messages through LiteLLM
LiteLLM calls the matching endpoint at https://api.prisminference.com/v1

Relevant issues

Linear ticket

Pre-Submission checklist

I have added meaningful tests
The focused provider, endpoint, and schema tests pass locally
My PR passes all required CI/CD checks
My PR's scope is as isolated as possible
I have received a Greptile Confidence Score of at least 4/5

Screenshots / Proof of Fix

Live proof is pending deployment verification

Type

New Feature

Caveats (if any)

Low

Full local checks require Node 24.14.1 or newer

Final Attestation

Tests cover provider routing, credentials, pricing, and functional Responses and Messages requests

…nd Model Hub UI Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

…mutation Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

…eat-prism-provider

codspeed · 2026-09-12T23:05:27Z

Merging this PR will not alter performance

✅ 31 untouched benchmarks

_{Comparing prismhq:feat-prism-provider (7f93254) with litellm_internal_staging (af6dc1d)}

codecov · 2026-09-12T23:14:27Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

…ow read fails Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

…iption feat(model_hub): surface model_info.description in Model Hub

…ip_save_on_failed_read fix(health): skip background health check DB writes when the latest-row read fails

greptile-apps · 2026-09-15T18:52:33Z

Greptile Summary

This PR registers Prism as a declarative OpenAI-compatible provider, adds two model catalog entries, and exposes Prism through provider and endpoint metadata

Adds default Prism endpoint and credential resolution
Enables Chat Completions, Responses, and Anthropic Messages adapter selection
Adds pricing, limits, caching, reasoning, tools, and structured-output capabilities for two DeepSeek models
Adds configuration-level tests, but does not functionally exercise the new Responses or Messages request paths

Confidence Score: 4/5

The provider registration appears correct, but the repository’s required functional-test standard must be satisfied before merging

No concrete runtime defect was established, but the tests only resolve the new Responses and Messages configurations instead of exercising their request behavior

Files Needing Attention: tests/test_litellm/llms/openai_like/test_prism_provider.py

Important Files Changed

Filename	Overview
litellm/llms/openai_like/providers.json	Adds a consistent declarative Prism configuration for credentials, base URL, and three supported endpoint families
litellm/constants.py	Registers Prism’s provider slug and API base with the OpenAI-compatible routing lists
litellm/types/utils.py	Adds the Prism provider enum needed by typed provider configuration lookup
model_prices_and_context_window.json	Adds schema-compatible pricing, limits, endpoints, and capability metadata for two Prism models
provider_endpoints_support.json	Advertises Prism support for Chat Completions, Responses, and Messages consistently with the declarative provider definition
litellm/proxy/public_endpoints/provider_create_fields.json	Adds Prism API key and optional API base fields to the provider creation metadata
tests/test_litellm/llms/openai_like/test_prism_provider.py	Covers registration, credentials, costs, metadata, and configuration lookup, but lacks functional Responses and Messages request coverage

_{Reviews (1): Last reviewed commit: "feat(providers): add DeepSeek V4.1 Flash..." | Re-trigger Greptile}

greptile-apps · 2026-09-15T18:52:36Z

+    assert JSONProviderRegistry.supports_responses_api("prism") is True
+    responses_config = ProviderConfigManager.get_provider_responses_api_config(
+        provider="prism",
+        model="deepseek-v4-flash",
+    )
+    messages_config = ProviderConfigManager.get_provider_anthropic_messages_config(
+        provider=litellm.LlmProviders.PRISM,
+        model="deepseek-v4-flash",
+    )
+
+    assert responses_config is not None
+    assert responses_config.custom_llm_provider == "prism"
+    assert isinstance(messages_config, JSONProviderAnthropicMessagesConfig)


Endpoint Tests Only Resolve Configs

These tests never execute Responses or Messages requests, violating the repository requirement for meaningful functional endpoint tests before merging

Context Used: CLAUDE.md (source)

Knowledge Base Used: Provider adapters and capabilities

Replaced config-resolution assertions with functional Responses and async Messages requests that verify endpoint routing, authentication, payloads, and parsed responses.

…eat-prism-provider

CLAassistant · 2026-09-15T19:19:42Z

All committers have signed the CLA.

* feat(providers): add Prism provider * fix(providers): complete Prism registration * feat(providers): expose Prism responses and messages * feat(providers): add DeepSeek V4.1 Flash to Prism * test(providers): exercise Prism endpoint requests * fix(providers): align Prism pricing and limits with the live catalog deepseek-v4.1-flash bills 0.17/0.63 USD per 1M input/output tokens and takes image input; deepseek-v4-flash bills 0.17/0.21 and caps output at 384000 tokens, per GET /v1/models * test(prism): assert cost-map invariants instead of pinning catalog facts * test(prism): derive the asserted model list from the cost map instead of pinning it * test(prism): capture requests through respx instead of appending to a list and swapping the client transport --------- Co-authored-by: rajitkhanna <rajitskhanna@gmail.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com> Co-authored-by: ryan <ryan@berri.ai>

milan-berri and others added 11 commits August 21, 2026 02:41

feat(model_hub): surface model_info.description in model group info a…

b224b15

…nd Model Hub UI Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

refactor(router): aggregate model group description without in-place …

342b93f

…mutation Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

feat(providers): add Prism provider

bf1b1c9

fix(providers): complete Prism registration

724004b

Merge remote-tracking branch 'origin/litellm_internal_staging' into f…

3a76937

…eat-prism-provider

feat(providers): expose Prism responses and messages

a85c535

Merge remote-tracking branch 'origin/litellm_internal_staging' into f…

549ef1e

…eat-prism-provider

Merge remote-tracking branch 'origin/litellm_internal_staging' into f…

855533b

…eat-prism-provider

Merge remote-tracking branch 'origin/litellm_internal_staging' into f…

65b4b96

…eat-prism-provider

Merge remote-tracking branch 'origin/litellm_internal_staging' into f…

1ea0861

…eat-prism-provider

feat(providers): add DeepSeek V4.1 Flash to Prism

849a652

yuneng-berri deleted the branch BerriAI:main September 13, 2026 04:53

yuneng-berri closed this Sep 13, 2026

yuneng-berri reopened this Sep 13, 2026

fix(health): skip background health check DB writes when the latest-r…

6d2c489

…ow read fails Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

devin-ai-integration Bot mentioned this pull request Sep 14, 2026

feat(pricing): add azure gpt-chat-latest rates and drop retired friendliai llama-3.1 entries #40976

Merged

4 of 6 tasks

ryan-crabbe-berri and others added 2 commits September 14, 2026 15:03

Merge pull request BerriAI#37762 from BerriAI/litellm_model_hub_descr…

3f32a19

…iption feat(model_hub): surface model_info.description in Model Hub

Merge pull request BerriAI#40993 from BerriAI/litellm_health_check_sk…

af6dc1d

…ip_save_on_failed_read fix(health): skip background health check DB writes when the latest-row read fails

rajitkhanna marked this pull request as ready for review September 15, 2026 18:49

rajitkhanna requested a review from mateo-berri as a code owner September 15, 2026 18:49

greptile-apps Bot reviewed Sep 15, 2026

View reviewed changes

rajitkhanna added 2 commits September 15, 2026 11:59

test(providers): exercise Prism endpoint requests

a365f3c

Merge remote-tracking branch 'origin/litellm_internal_staging' into f…

619a0bc

…eat-prism-provider

test(vertex_ai): pin embedding spend assertions to bundled costs

7f93254

rajitkhanna force-pushed the feat-prism-provider branch from 5c64475 to 7f93254 Compare September 15, 2026 19:30

mateo-berri mentioned this pull request Sep 19, 2026

docs(providers): add Prism provider page BerriAI/litellm-docs#1570

Merged

mateo-berri mentioned this pull request Sep 19, 2026

feat(providers): add Prism provider (internal copy of #40914) #41961

Merged

5 of 6 tasks

devin-ai-integration Bot changed the base branch from litellm_internal_staging to main September 23, 2026 14:35

devin-ai-integration Bot requested review from kerry-berri, ryan-crabbe-berri and yuneng-berri as code owners September 23, 2026 14:35

devin-ai-integration Bot requested a review from a team September 23, 2026 14:35

Navigation Menu

Repository navigation

feat(providers): add Prism provider - #40914

feat(providers): add Prism provider#40914
rajitkhanna wants to merge 17 commits into
BerriAI:mainfrom
prismhq:feat-prism-provider

rajitkhanna commented Sep 12, 2026 •

edited

Loading

Uh oh!

codspeed Bot commented Sep 12, 2026 •

edited

Loading

Uh oh!

codecov Bot commented Sep 12, 2026

Uh oh!

greptile-apps Bot commented Sep 15, 2026

Important Files Changed

Uh oh!

greptile-apps Bot Sep 15, 2026

Uh oh!

rajitkhanna Sep 15, 2026

Uh oh!

CLAassistant commented Sep 15, 2026 •

edited

Loading

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

rajitkhanna commented Sep 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

TLDR

User Flow

Relevant issues

Linear ticket

Pre-Submission checklist

Screenshots / Proof of Fix

Type

Caveats (if any)

Low

Final Attestation

Uh oh!

codspeed Bot commented Sep 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will not alter performance

Uh oh!

codecov Bot commented Sep 12, 2026

Codecov Report

Uh oh!

greptile-apps Bot commented Sep 15, 2026

Greptile Summary

Confidence Score: 4/5

Important Files Changed

Uh oh!

greptile-apps Bot Sep 15, 2026

Choose a reason for hiding this comment

Uh oh!

rajitkhanna Sep 15, 2026

Choose a reason for hiding this comment

Uh oh!

CLAassistant commented Sep 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

rajitkhanna commented Sep 12, 2026 •

edited

Loading

codspeed Bot commented Sep 12, 2026 •

edited

Loading

CLAassistant commented Sep 15, 2026 •

edited

Loading