Skip to content

docs: add TypeSafe AI Jev pass-through page - #1524

Merged
mateo-berri merged 1 commit into
mainfrom
litellm_typesafe_passthrough_docs
Sep 17, 2026
Merged

mateo-berri merged 1 commit into
mainfrom
litellm_typesafe_passthrough_docs

Conversation

@devin-ai-integration

@devin-ai-integration devin-ai-integration Bot commented Sep 17, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Adds docs/pass_through/typesafe.md and its sidebar entry for the /typesafe/{endpoint} pass-through introduced in BerriAI/litellm#41607. The page documents TYPESAFE_API_KEY and TYPESAFE_API_BASE, the POST /typesafe/v1/systemone call shape, and how spend is derived from the response usage and the typesafe/<model> registry entries. The litellm PR's documentation check fails until TYPESAFE_API_BASE is mentioned in these docs, so this lands first

Resolves LIT-7975

User Flow

Before: the TypeSafe pass-through has no page, so a reader cannot find the route or the variable names to set

  1. They open https://docs.litellm.ai/docs/pass_through/typesafe and get a 404 "Page Not Found"
  2. They open Docs, Supported Endpoints, Pass-through Endpoints in the sidebar: the list goes from OpenAI Passthrough straight to Passthrough Managed IDs, with no TypeSafe entry
  3. They search the docs for TYPESAFE_API_KEY or TYPESAFE_API_BASE and get no result

After: the page exists, is listed, and walks them through the setup

  1. They open https://docs.litellm.ai/docs/pass_through/typesafe and get the "TypeSafe AI (Jev)" page with the supported-features table
  2. The sidebar lists "TypeSafe AI (Jev)" between OpenAI Passthrough and Passthrough Managed IDs
  3. Quick Start shows export TYPESAFE_API_KEY, the optional TYPESAFE_API_BASE, the POST http://0.0.0.0:4000/typesafe/v1/systemone request, TypeSafe's response, and the Cost Tracking section

Screenshots / Proof of Fix

Before (docs main 4988b19, the live site)

curl -s -o /dev/null -w '%{http_code}\n' https://docs.litellm.ai/docs/pass_through/typesafe
404

After (tip 673f472, Vercel preview built from this branch)

https://litellm-git-litellmtypesafepassthroughdocs-clerkieai.vercel.app/docs/pass_through/typesafe answers 200 with the title "TypeSafe AI (Jev) | liteLLM", the sidebar entry under Pass-through Endpoints, both environment variables, the curl, the response, and the Cost Tracking section

pr1524-673f4726f0-preview1524.png

pr1524-673f4726f0-preview1524_cost.png

The litellm check this page unblocks

tests/documentation_tests/test_env_keys.py run from a litellm checkout at each PR head, with docs/my-website checked out at docs main and then at this tip (the same layout the code-quality and documentation workflows use):

for wt in wt41607 wt41615; do
  cd "$S/$wt"
  git -C docs/my-website checkout -q --detach origin/main && python3 tests/documentation_tests/test_env_keys.py
  git -C docs/my-website checkout -q --detach 673f4726f00ac369e3c6b13b606c79541c6916c3 && python3 tests/documentation_tests/test_env_keys.py
done
wt41607 (litellm dcbb77326d), docs at 4988b19f: Exception: Environment variables read under ./litellm but mentioned nowhere in the docs: ['TYPESAFE_API_BASE']
wt41607 (litellm dcbb77326d), docs at 673f4726: Every environment variable read under ./litellm is documented
wt41615 (litellm 0a66328663), docs at 4988b19f: Exception: Environment variables read under ./litellm but mentioned nowhere in the docs: ['TYPESAFE_API_BASE', 'TYPESAFE_API_KEY']
wt41615 (litellm 0a66328663), docs at 673f4726: Every environment variable read under ./litellm is documented

The page's request was also sent to the live API on 2026-09-17: POST https://api.typesafe.ai/v1/systemone with the Quick Start body returned 200 with model: jev-1.13.0, answers.department carrying type, choice, confidence, and probabilities, and usage.input_tokens plus usage.output_tokens, the shape the page shows. GET /v1/models lists jev-latest and jev-preview

Dependents checked: the sidebars.js entry (the structure check and the Vercel build are green at the tip), the litellm env-var docs check above, and the cross-link from #1525, which resolves once this page is on main

Caveats

Low

Link to Devin session: https://app.devin.ai/sessions/b8ce9e101c644969abb9bcc9dfa2c333
Open in Devin Desktop: https://app.devin.ai/desktop/session/b8ce9e101c644969abb9bcc9dfa2c333?variant=devin
Requested by: @mateo-berri


Note

Low Risk
Documentation and sidebar navigation only; no runtime or API behavior changes in this repo.

Overview
Adds documentation for the TypeSafe AI (Jev) proxy pass-through at /typesafe/{endpoint}, intended to ship with the implementation in litellm PR #41607.

The new docs/pass_through/typesafe.md page explains how to point clients at the proxy instead of api.typesafe.ai, configure TYPESAFE_API_KEY and optional TYPESAFE_API_BASE, call POST /typesafe/v1/systemone (not chat completions), and how cost/logging work from response usage and typesafe/<model> registry entries. sidebars.js is updated so the page appears under Pass-through Endpoints.

Reviewed by Cursor Bugbot for commit 673f472. Bugbot is set up for automated code reviews on this repo. Configure here.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment, CI, and merge conflict monitoring

@vercel

vercel Bot commented Sep 17, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
litellm Ready Ready Preview Sep 17, 2026 4:54pm UTC

Request Review

@mateo-berri

Copy link
Copy Markdown
Contributor

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 673f472. Configure here.

@mateo-berri mateo-berri left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mateo-berri
mateo-berri merged commit 2158897 into main Sep 17, 2026
5 checks passed
@mateo-berri
mateo-berri deleted the litellm_typesafe_passthrough_docs branch September 17, 2026 21:15

This branch was successfully deployed

1 active deployment
Preview — 673f4726 Deployed Sep 17, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant