Add LiteLLM Rust workspace with Mistral OCR bridge

[ishaan-berri]

What

• Add minimal top-level litellm-rust/ workspace with only the crates needed for the first bridge: core, providers, and python-bridge.
• Shape Rust around LiteLLM route/provider responsibilities:
  • core/src/ocr/ owns OCR shared types and the OcrProviderConfig template trait.
  • providers/src/mistral/ocr/transformation.rs mirrors litellm/llms/mistral/ocr/transformation.py.
  • providers/src/ocr.rs owns Rust-side OCR provider/operation dispatch.
• Keep the PyO3 bridge intentionally thin: it exports one OCR function, ocr(payload), and delegates OCR routing to Rust.
• Add litellm/rust_bridge/ as the Python-side bridge package with an explicit OCR provider rollout enum and Python fallback behavior.
• Keep litellm/ocr/main.py small: after normal provider resolution, it asks litellm.rust_bridge.ocr for a Rust-backed config; disabled, unavailable, or unsupported Rust paths return the existing Python config unchanged.
• Add Rust CLAUDE.md/README rules for pure transforms, provider tree mapping, bridge shape, parity tests, and future host I/O boundaries.
• Add a path-scoped Rust GitHub Actions job that runs cargo fmt --check, cargo clippy --workspace --all-targets -- -D warnings, and cargo test --workspace on Rust changes.
• Add Python bridge tests for disabled, enabled, unavailable module, and unknown-provider fallback behavior.

Verification

• uv run black litellm/rust_bridge litellm/ocr/main.py tests/test_litellm/llms/mistral/ocr/test_mistral_ocr_rust_bridge.py
• uv run ruff check litellm/rust_bridge litellm/ocr/main.py tests/test_litellm/llms/mistral/ocr/test_mistral_ocr_rust_bridge.py
• uv run pytest tests/test_litellm/llms/mistral/ocr/test_mistral_ocr_transformation.py tests/test_litellm/llms/mistral/ocr/test_mistral_ocr_rust_bridge.py -q
• cd litellm-rust && cargo fmt --check
• cd litellm-rust && cargo clippy --workspace --all-targets -- -D warnings
• cd litellm-rust && cargo test --workspace

Scope

This PR keeps the rollout narrow: Mistral OCR only, route-level Python hook, Python fallback for every disabled/unavailable Rust path. Future OCR providers should add providers/src/<provider>/ocr/transformation.rs and register the provider in the Rust OCR dispatcher plus the Python rollout enum.

[greptile-apps]

Too many files changed for review. (132 files found, 100 file limit)

[CLAassistant]

All committers have signed the CLA.

[codspeed-hq]

Merging this PR will not alter performance

✅ 16 untouched benchmarks

---

_{Comparing ishaan-berri:codex/litellm-rust-mistral-ocr (ce27d80) with main (dcf1b44)}

[codecov]

Codecov Report

❌ Patch coverage is 74.28571% with 27 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
litellm/rust_bridge/loader.py	57.14%	15 Missing ⚠️
litellm/rust_bridge/ocr/config.py	76.19%	10 Missing ⚠️
litellm/rust_bridge/ocr/providers.py	90.00%	2 Missing ⚠️

📢 Thoughts on this report? Let us know!

[ishaan-berri]

Refiled from an in-repo BerriAI/litellm branch as #31032: #31032

[ishaan-berri]

Closing this fork-sourced PR in favor of #31032, which comes from BerriAI/litellm.