feat(decisions): backport the decisions and Jev follow-ups to stable/1.104.x and bump to 1.104.3

[devin-ai-integration]

TLDR

Backports the decisions and Jev work merged on main since #45190 onto stable/1.104.x, without the decisions playground, so the 1.104.3 patch serves every decisions provider and SDK shape the launch ships with

Problem this solves:

• stable/1.104.x only has the openai, perplexity, typesafe, openrouter, cloudflare and strands_decider decisions providers
• It has no hosted_vllm or azure_ai Microsoft-Decision-1 provider, no AgentCore runtime ARN support, no litellm.systemone
• OpenRouter decisions calls are billed from the cost map instead of the provider-reported usage.cost
• TypeSafe and Strands Decider are missing from the Add Model provider list, and Swagger UI does not describe the two decisions routes

How it solves it:

• Bumps the line to 1.104.3 in its own commit
• Cherry-picks the 16 main commits listed under Picks with git cherry-pick -x, adapted where stable/1.104.x lacks what they build on
• Regenerates schema.d.ts on the line instead of merging the generated file by hand
• Leaves the decisions playground (feat(ui): let admins find, call, and test decision models from the Admin UI #45654, feat(ui): link the decision models banner to the supported providers docs and rename the System One playground to Decisions #45732, fix(ui): drop the decision models sublabel from the Add Model provider dropdown #45755) out, as asked

User Flow

Before: a proxy admin on 1.104.2 cannot route a decisions request to a hosted vLLM or Azure decider

1. They add hosted_vllm/my-decider or azure_ai/Microsoft-Decision-1 to the config and start the proxy
2. They send POST http://localhost:4000/v1/decisions with that model, an input and yes/no questions
3. They get HTTP 400 "Unknown Decisions provider", and the Add Model page has no TypeSafe or Strands Decider provider

After: the same request is answered, and the new providers show up everywhere the old ones did

1. They add the same models to the config and start the proxy
2. The same POST http://localhost:4000/v1/decisions returns HTTP 200 with one answer per question and a usage block, billed at the line's price for that model
3. http://localhost:4000/ui/?page=models lists TypeSafe and Strands Decider under Add Model, and http://localhost:4000/#/v1/decisions in Swagger UI documents both routes
4. litellm.systemone(...) and litellm.decisions(...) work from the SDK with the same shapes as main

Picks

• 79f62db feat(decisions): add the OpenAI Decisions spec types and the System One translation (feat(decisions): add the OpenAI Decisions spec types and the System One translation #45129)
• 0e09e99 refactor(decisions): dispatch /v1/decisions through provider configs and the shared HTTP handler (refactor(decisions): dispatch /v1/decisions through provider configs and the shared HTTP handler #45130)
• a7b04a8 test(decisions): post System One bodies to /v1/systemone in the translation bases (test(decisions): post System One bodies to /v1/systemone in the translation bases #45327)
• 6e54dce test: realign stale decisions and lens tests with merged behaviour (test: realign stale decisions and lens tests with merged behaviour #45346)
• 3a3b8ca feat(ui): add TypeSafe and Strands Decider to the Add Model provider list (feat(ui): add TypeSafe and Strands Decider to the Add Model provider list #45335)
• 0e48048 chore(decisions): remove the System One converters and OpenAI spec types left dead by feat(decisions): add OpenAI as a Decisions provider behind a shared decisions format #45214 (chore(decisions): remove the System One converters and OpenAI spec types left dead by #45214 #45442)
• 61e5f2d feat(decisions): add hosted_vllm provider (feat(decisions): add hosted_vllm provider #45501)
• de6a071 feat(azure): add azure_ai/Microsoft-Decision-1 (feat(azure): add azure_ai/Microsoft-Decision-1 #45639)
• 465f20f fix(openrouter): bill responses, decisions and pass-through from usage.cost and always allow reasoning params (fix(openrouter): bill Responses, Decisions and pass-through from OpenRouter usage.cost, always allow reasoning params #45640), decisions and pass-through billing only
• 2fcc780 feat(azure_ai): support Microsoft-Decision-1 on the decisions API (feat(azure_ai): support Microsoft-Decision-1 on the decisions API #45673)
• 546402c fix(decisions)!: refuse safety_identifier on providers that cannot take it unless drop_params drops it (fix(decisions)!: refuse safety_identifier on providers that cannot take it unless drop_params drops it #44955)
• 674208b fix(model_prices): drop unverified output price for azure_ai/Microsoft-Decision-1 (fix(model_prices): drop unverified output price on Microsoft-Decision-1 and guard evaluation rows #45717)
• ed9c31c feat(strands_decider): call a Strands Decider on an AgentCore runtime ARN (feat(strands_decider): call a Strands Decider on an AgentCore runtime ARN #45678)
• bc2cc42 docs(proxy): describe /v1/decisions and /v1/systemone in Swagger UI (docs(proxy): describe /v1/decisions and /v1/systemone in Swagger UI #45838)
• 5894968 test(decisions): bill the OpenAI-format openrouter case from provider-reported cost (test(decisions): bill the OpenAI-format openrouter case from provider-reported cost #45853)
• 25d9b05 feat(sdk): add litellm.systemone and trim litellm.decisions to the OpenAI shape (feat(sdk): add litellm.systemone and trim litellm.decisions to the OpenAI shape #45846)

Skipped on purpose

• feat(ui): let admins find, call, and test decision models from the Admin UI #45654, feat(ui): link the decision models banner to the supported providers docs and rename the System One playground to Decisions #45732, fix(ui): drop the decision models sublabel from the Add Model provider dropdown #45755: the decisions playground and its Add Model sublabel, excluded on this line
• feat(decisions): add Databricks ai_decide as a /v1/decisions provider and auto-router decider #45200: Databricks ai_decide and the auto-router decider need the Laya and Bespoke classifier work (feat: add Laya gateway and OSS classifier providers #43626, feat: add Bespoke Nimble gateway and OSS classifier support #44246, fix(auto-router): separate tuning and select chained heuristic #44928) that is not on the line
• test(decisions): add hosted_vllm /v1/decisions and provider-400 translation cases #45661: hosted_vllm translation cases need the newer tests/integration/translation runner

Adaptations on this line

• The shared HTTP handler keeps the line's _get_httpx_client name and its DecisionsIRRequest flow, with the AgentCore signing from feat(strands_decider): call a Strands Decider on an AgentCore runtime ARN #45678 on top
• The OpenRouter Responses API half of fix(openrouter): bill Responses, Decisions and pass-through from OpenRouter usage.cost, always allow reasoning params #45640 is left out because it imports litellm_core_utils.hidden_params, which the line does not have; the decisions and pass-through billing from usage.cost is in
• The Databricks tests that feat(sdk): add litellm.systemone and trim litellm.decisions to the OpenAI shape #45846 added to tests/unit/decisions/test_main.py are dropped with feat(decisions): add Databricks ai_decide as a /v1/decisions provider and auto-router decider #45200
• tests/unit/conftest.py gets the per-test logging worker flush from main (perf(ci): isolate and shard integration suites #44146), without which the new systemone callback test sees callbacks queued by earlier tests
• ui/litellm-dashboard/src/lib/http/schema.d.ts is regenerated with npm run gen:api, and the Strands logo is copied from main
• The lazy-route and Sail tests that only exist on rc/1.105.0 and main are left out of the picked test files, and tests/integration/management/test_model_health_check.py is not on this line so its hunk is dropped
• The picks come from the rc/1.105.0 backport branch, so every commit body still names its main commit, and the line gets its own bump: version 1.104.3 commit

Testing

• tests/unit/decisions, tests/unit/systemone, tests/unit/proxy/decisions_endpoints, tests/unit/proxy/public_endpoints, the strands_decider, openrouter, azure_ai and hosted_vllm provider tests, tests/test_litellm/proxy/auth/test_auth_utils.py, tests/test_litellm/proxy/common_utils/test_custom_openapi_spec.py and tests/unit/test_cost_map_guard.py: 1131 passed on this branch
• provider_info_helpers.test.tsx: 75 passed, no type errors
• ruff reports no new findings on the touched Python files against stable/1.104.x
• The live before and after on a proxy built from this branch is the /ready follow-along video, linked from the Slack READY ping

Screenshots / Proof of Fix

Live /qa leg at this tip (fd7aec3) against the merge base (19180f3, 1.104.2): two proxies booted from clean worktrees with --num_workers 2, their own Postgres and Redis, real TypeSafe, OpenRouter and Azure AI Foundry keys from the shared vault, real spend. Full command and output log in the QA record kept with the run; the flips a user sees:

# [C1] POST /v1/decisions model=typesafe/jev-1.13.0 with safety_identifier
BEFORE: HTTP 200 (param silently dropped)   x-litellm-response-cost: 1.1886e-05
AFTER:  HTTP 400 litellm.UnsupportedParamsError: typesafe does not support parameters: ['safety_identifier'] ...
# [C2] same body on a deployment with drop_params: true
BEFORE: HTTP 200   AFTER: HTTP 200

# [D] POST /v1/decisions model=openrouter/typesafe/jev-1.13 (billing from usage.cost)
BEFORE: HTTP 200 (no x-litellm-response-cost header, spend log 0)
AFTER:  HTTP 200 x-litellm-response-cost: 1.239e-05

# [G1] POST /v1/systemone model=azure_ai/decision-1 (real Microsoft-Decision-1 deployment)
BEFORE: HTTP 400 Unknown Decisions provider 'azure_ai'. Supported providers: perplexity, typesafe, openrouter, cloudflare, strands_decider, openai
AFTER:  HTTP 200 {"model":"microsoft-decision-1","answers":{...}}
# [G2] same on POST /v1/decisions: BEFORE 400, AFTER 200

# [F] GET /v1/model/info azure_ai/Microsoft-Decision-1
BEFORE: input_cost_per_token null, mode null
AFTER:  input_cost_per_token 4.2e-08, output_cost_per_token 0.0, mode evaluation

# [L] GET /openapi.json, POST /v1/decisions
BEFORE: summary "Decisions", no description, no request example
AFTER:  summary "Ask questions about an input (OpenAI Decisions format)", description, example, schema props input/model/questions/safety_identifier

# Admin UI Add Model provider dropdown (Playwright, before :49819 / after :48789 via GET /public/providers/fields)
BEFORE: no TypeSafe or Strands Decider entries (GET /public/providers/fields: 0 matches)
AFTER:  "TypeSafe" and "Strands Decider" entries present with their default model placeholders

Two picks could not be exercised live and are blocked, not mocked: hosted_vllm (no vLLM server; the route now resolves the provider and fails on connect instead of 400 unknown provider) and the Strands Decider AgentCore call (no AgentCore runtime ARN credential in the shared vault)

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have added meaningful tests
• The handful of test files covering my change pass locally, e.g. uv run pytest tests/unit/<your_test_file>.py -v. Leave the suites (make test-unit-*, make test-unit) to CI: it finishes in ~15 minutes where a laptop takes an hour or more
• My PR passes all required CI/CD checks (e.g., lint, schema.d.ts sync check, etc.)
• My PR's scope is as isolated as possible; it only solves 1 specific problem
• I have received a Greptile Confidence Score of at least 4/5 before requesting a maintainer review (Greptile reviews automatically once the PR is opened; only comment @greptileai to re-request a review after pushing changes)

Type

🆕 New Feature

Caveats (if any)

Medium

• No Databricks decisions provider on this line, so databricks/... decisions requests still return the unknown provider 400
• The OpenRouter Responses API still bills from the cost map on this line, only decisions and pass-through use usage.cost

Low

• fix(decisions)!: refuse safety_identifier on providers that cannot take it unless drop_params drops it #44955 is a behavior change: a non-string safety_identifier on a provider that cannot take it is now a 400 unless drop_params drops it

Final Attestation

• The tests check the right things, including the edge cases, and regressions in the respective real-world customer use-cases are not possible after this PR

[devin-ai-integration]

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

• Disable automatic comment, CI, and merge conflict monitoring

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
2 out of 4 committers have signed the CLA.

✅ yuneng-berri
✅ mateo-berri
❌ berriai-litellm-provider-info-sync[bot]
❌ devin-ai-integration[bot]
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[mateo-berri]

@greptileai

[mateo-berri]

bugbot run

[cursor]

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit fd7aec3. Configure here.}

[mateo-berri]

@greptileai