Skip to content

docs(auto_routing): session_affinity is on by default - #583

Merged
krrish-berri-2 merged 1 commit into
mainfrom
docs_session_affinity_default_on
Jul 16, 2026
Merged

docs(auto_routing): session_affinity is on by default#583
krrish-berri-2 merged 1 commit into
mainfrom
docs_session_affinity_default_on

Conversation

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Summary

complexity_router now defaults session_affinity to on (BerriAI/litellm#33500), so the auto_routing docs are updated to match. The "Session affinity" section now reads "On by default", documents session_affinity: false as the opt-out, and notes that pinning a session to one model also avoids provider errors when conversation history from one model (for example an Anthropic thinking block) is replayed to a different model on a later turn. The config snippet comment now reads session_affinity: true # default; set false to reclassify every turn.

Link to Devin session: https://app.devin.ai/sessions/fcac1b22aa084efa9f36dc8f99976601
Requested by: @krrish-berri-2

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@krrish-berri-2 krrish-berri-2 self-assigned this Jul 16, 2026
@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment, CI, and merge conflict monitoring

@vercel

vercel Bot commented Jul 16, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
litellm Ready Ready Preview, Comment Jul 16, 2026 5:05am

Request Review

@krrish-berri-2
krrish-berri-2 enabled auto-merge (squash) July 16, 2026 04:56
@krrish-berri-2
krrish-berri-2 merged commit 7a2fb4c into main Jul 16, 2026
3 checks passed
@krrish-berri-2
krrish-berri-2 deleted the docs_session_affinity_default_on branch July 16, 2026 05:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants