docs: update AssemblyAI docs with Universal-3 Pro, Speech Understanding, and LLM Gateway

[dylan-duan-aai]

Summary

• Adds new /assemblyai-llm-gateway/* pass-through route targeting https://llm-gateway.assemblyai.com
• Adds route to authorization allowlist in _types.py
• Updates AssemblyAI docs with LLM Gateway section, Universal-3 Pro examples, and Speech Understanding features
• Adds integration tests for the LLM Gateway pass-through

Test plan

• Integration tests in tests/pass_through_tests/test_assemblyai_llm_gateway.py (chat completion, multi-turn, multiple models, usage tracking)
• Verified against live AssemblyAI LLM Gateway with Claude Sonnet and Haiku models
• Existing AssemblyAI STT pass-through routes unaffected

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
litellm	Ready	Preview, Comment	Feb 27, 2026 4:17am

[CLAassistant]

All committers have signed the CLA.

[greptile-apps]

Greptile Summary

This PR modernizes the AssemblyAI pass-through documentation with consistent branding ("AssemblyAI" instead of "Assembly AI"), updated Quick Start examples showcasing Universal-3 Pro speech models and Speech Understanding features, and a new LLM Gateway section documenting how to use AssemblyAI's OpenAI-compatible LLM Gateway as a provider through LiteLLM's standard model_list config.

• Docs improvements: Replaces embedded Loom video with a structured Supported Routes table, modernizes code examples with error handling and TranscriptionConfig, and adds a prompting example for Universal-3 Pro
• LLM Gateway section: Documents using AssemblyAI's LLM Gateway via openai/* model prefix with api_base pointing to https://llm-gateway.assemblyai.com/v1 — this is a standard OpenAI-compatible provider config, not a new pass-through route
• Stale _types.py changes: The diff includes unrelated changes to litellm/proxy/_types.py (new routes, access_group_ids fields, LiteLLM_ManagedVectorStoreTable) that already exist on the target branch — these are artifacts of a stale branch fork and will be no-ops at merge time
• PR description mismatch: The description claims new pass-through routes and integration tests that are not present in the changeset

Confidence Score: 4/5

• This PR is safe to merge — the documentation changes are well-written and the _types.py changes are already on main.
• The actual net change is documentation-only. The _types.py diff is a no-op since all those changes already exist on the target branch. The docs improvements are substantive and correct. Minor style inconsistency in the EU endpoints section. The PR description overstates the scope (mentions routes and tests not in the changeset).
• litellm/proxy/_types.py — contains unrelated changes from a stale branch fork; recommend rebasing onto latest main for a clean diff.

Important Files Changed

Filename	Overview
docs/my-website/docs/pass_through/assembly_ai.md	Documentation updated with consistent AssemblyAI branding, modernized Quick Start examples with Universal-3 Pro and Speech Understanding features, and new LLM Gateway section using OpenAI-compatible provider config. EU endpoint section still uses the older code style unlike the updated US section.
litellm/proxy/_types.py	Adds access_group_ids to KeyRequestBase, TeamBase, UpdateTeamRequest, LiteLLM_VerificationToken; adds daily activity routes to management_routes; adds LiteLLM_ManagedVectorStoreTable class. None of these changes are related to AssemblyAI documentation — they appear to be from the author's branch being based on a stale fork of main. All changes already exist on the base branch, so the merge should be a no-op for this file.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    subgraph STT["Speech-to-Text (Pass-through)"]
        A[Client App] -->|"/assemblyai/*"| B[LiteLLM Proxy]
        A -->|"/eu.assemblyai/*"| B
        B -->|US| C["api.assemblyai.com"]
        B -->|EU| D["eu.api.assemblyai.com"]
    end

    subgraph LLM["LLM Gateway (OpenAI-compatible)"]
        E[Client App] -->|"/v1/chat/completions\nmodel: assemblyai/*"| F[LiteLLM Proxy]
        F -->|"openai/* via api_base"| G["llm-gateway.assemblyai.com/v1"]
        G --> H["Claude / GPT / Gemini"]
    end

Loading

_{Last reviewed commit: b60bef9}

[greptile-apps]

_{4 files reviewed, 4 comments}

_{Edit Code Review Agent Settings | Greptile}

[dylan-duan-aai]

CI failures are pre-existing on main and unrelated to this PR

[dylan-duan-aai]

No code changes needed. This PR is now docs-only.

Removed the pass-through route and instead documented the LLM Gateway as an OpenAI-compatible provider via api_base. Updated the STT docs with Universal-3 Pro, prompting, and Speech Understanding examples.