Repository navigation
refactor(cost-map): remove openrouter rows, part 3 of 5 - #45667
Conversation
… google block) Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".
|
|
kerry seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account. You have signed the CLA already but the status is still pending? Let us recheck it. |
|
| "together_ai/arcee-ai/trinity-mini": { | ||
| "input_cost_per_token": 4.5e-08, | ||
| "litellm_provider": "together_ai", |
There was a problem hiding this comment.
Cheapest routing picks wrong models
For a mixed-provider model group without custom prices, lowest-cost routing reads these records before sending a request. Deleting them makes both token rates default to 5.0, so the router ranks each deleted OpenRouter deployment at 10.0 and can choose a more expensive provider. usage.cost arrives after that choice and cannot fix it. Keep prices available for pre-response routing
Knowledge Base Used: Provider adapters and capabilities
Comments Outside DiffThese findings could not be posted inline.
|
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Merging this PR will not alter performance
|
…-reported cost (#45853) PR #45667 removed openrouter/typesafe/jev-1.13 from the cost map after #45640 moved OpenRouter decisions billing to usage.cost. The OpenAI-format wire test still read the removed row and raised KeyError on CircleCI integration-providers Co-authored-by: mateo <mateo@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…-reported cost (BerriAI#45853) PR BerriAI#45667 removed openrouter/typesafe/jev-1.13 from the cost map after BerriAI#45640 moved OpenRouter decisions billing to usage.cost. The OpenAI-format wire test still read the removed row and raised KeyError on CircleCI integration-providers Co-authored-by: mateo <mateo@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> (cherry picked from commit 5894968)
Summary
Part 3 of 5 of removing the redundant
litellm_provider: openrouterrows from the cost map (OpenRouter bills fromusage.costsince #45640; see #45665 for why this is split into 5 stacked deletion-only PRs). Stacked on part 2Deletes the third and fourth contiguous blocks, 139 rows starting at
openrouter/minimax/minimax-m3and includingopenrouter/typesafe/jev-1.13, frommodel_prices_and_context_window.jsonandlitellm/model_prices_and_context_window_backup.json. The*_above_32k_tokens,*_above_128k_tokensand*_above_256k_tokensfields were only used by OpenRouter rows, soci_cd/generate_model_prices_schema.pydrops them frommodel_prices_and_context_window.schema.jsonhere. No source or test changesCheck against the base branch:
Link to Devin session: https://app.devin.ai/sessions/24b478924abd4f92b269b1556a5fcca6
Open in Devin Desktop: https://app.devin.ai/desktop/session/24b478924abd4f92b269b1556a5fcca6?variant=devin
Requested by: @kerry-berri
Note
Devin errored when opening this Pull Request as kerry-berri.
As a fallback, Devin opened this PR as itself.