docs(proxy): add [Beta] Rust AI Gateway page

[devin-ai-integration]

Summary

New docs page proxy/rust_gateway documenting how to adopt the Rust core, split into the two modes requested

Mode 1 (low risk, on the existing Python server): enable the Rust path per model by setting rust: true in a deployment's litellm_params, or per process via LITELLM_RUST=true (Anthropic /v1/messages) and LITELLM_USE_RUST_OCR=true (/ocr). The page shows validating the path from the x-litellm-rust: true response header, and a table of what runs on Rust today (Anthropic /v1/messages for anthropic/azure_ai, /ocr for mistral/azure_ai/vertex_ai, Bedrock audio transcription, OpenAI Responses API WebSockets). The details are pulled from the litellm handlers (_maybe_rust_anthropic_messages gating on litellm_params.get("rust") is True, _rust_env_enabled, _RUST_OCR_PROVIDERS)

Mode 2 (standalone Axum server): documented as pending since the Docker image is not published yet; the section is stubbed with a note to fill in the image reference and deployment example once it ships

Version note: the per-model rust: true flag for /v1/messages first shipped in v1.94.0-rc.1 (PR BerriAI/litellm#33616, merged 2026-07-18), so it goes live in v1.94.0-stable; called out in the page's info admonition

Added to the sidebar under Proxy -> Setup & Deployment. npm run build passes (only preexisting unrelated warnings)

Link to Devin session: https://app.devin.ai/sessions/d16e781009c04998a6e6e7009fbfb483
Requested by: @ishaan-berri

[devin-ai-integration]

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

• Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
• Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

• Disable automatic comment, CI, and merge conflict monitoring

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
litellm	Ready	Preview, Comment	Jul 22, 2026 2:17am