docs(auto_routing): update the setup skill and page for tier labels, classifier prompt, and fallback - #787
Merged
Merged
Conversation
…classifier prompt, and fallback Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Contributor
Author
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
…as opt-in Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Four complexity-router changes landed in litellm after the skill was written (PR #772 merged 2026-08-05), so the skill was telling agents about a config surface that no longer matches the code:
tier_labelsrenames the four tiers for the dashboard, spend logs, and the LLM classifier rubric while config keys stay canonical (#35893)classifier_llm_config.system_promptreplaces the built-in rubric outright, withGET /auto_router/classifier/default_promptto fetch the real default text (#35855)classifier_fallback: heuristic | default_modeldecides what runs when the classifier call fails (#35855)reminder_markersoverrides the marker pair whose blocks get stripped before classification (#35874)static/skills/auto-routerkeeps its shape: still an interview that asks for the router name and each tier model, still presents the proxy's own models as a numbered menu, still closes by laying out the defaults in force. New tier-names and reminder-block rows join that defaults table, the LLM-classifier follow-up now asks about the failure path and offers (never assumes) a replacement rubric, and step 6 gained a pre-flight againstPOST /auto_router/test_routing, which classifies a prompt for a config that only exists in a file without creating the router or calling the routed model.docs/proxy/auto_routing.mdchanged only where the code contradicted it. "Falls back to the heuristic scorer if the LLM classifier errors" is now conditional onclassifier_fallback; the section claiming to show "every knob v2 exposes" gained the four new keys, withtier_labelscommented out so the canonical tier names stay the visible baseline and renaming reads as opt-in; the reminder-stripping sentence notes the pair is overridable; and the UI section described a form that no longer exists, since Add Auto Router now opens on name plus Template with everything else under a collapsed Detailed Configuration, and carries Test Routing next to Test Connection (#35746, #35859).Deliberately left alone: the short "To get started, tell your agent" block stays the only place the setup flow appears on the page;
litellm_settings.autorouter_savings_baseline_modeland the cost-optimization savings work (#35521, #35907) are spend reporting rather than router setup; and the CJK keyword-match fix (#35984) plus the embedding context-window fix (#35956) change behavior without changing any documented key.npm run buildpasses; no new warnings.Link to Devin session: https://app.devin.ai/sessions/081e8ba97c494972aebf20b0d63eda61