Skip to content

feat(models): sync together_ai model registry - #45307

Closed
mateo-berri wants to merge 1 commit into
mainfrom
litellm_together_registry_sync_2026-10-08
Closed

mateo-berri wants to merge 1 commit into
mainfrom
litellm_together_registry_sync_2026-10-08

Conversation

@mateo-berri

Copy link
Copy Markdown
Contributor

Automated daily sync of the together_ai entries in model_prices_and_context_window.json against GET https://api.together.ai/v1/models?serverless and https://docs.together.ai/docs/deprecations.md by scripts/sync_together_ai_models.py.

Added (0)

  • none

Updated (2)

  • together_ai/Qwen/Qwen3.7-Max: input_cost_per_token: 1.5e-06 -> 2.5e-06; output_cost_per_token: 4.5e-06 -> 7.5e-06; cache_read_input_token_cost: 3e-07 -> 5e-07
  • together_ai/together/Tev1-4B-experimental: cache_read_input_token_cost: 4.2e-08 removed (no longer in the catalog pricing)

Marked deprecated (0)

  • none

Returned to the catalog (2)

  • together_ai/deepseek-ai/DeepSeek-V4-Flash-0731
  • together_ai/deepseek-ai/DeepSeek-V4-Pro-0813

Warnings needing a human call (19)

  • together_ai/BAAI/bge-base-en-v1.5 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/MiniMaxAI/MiniMax-M2.7 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2-1.5B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-14B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-72B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/arcee-ai/trinity-mini is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-R1-0528 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-V3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Llama-3.1-405B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Llama-3.2-1B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Llama-3.2-3B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Meta-Llama-3.1-8B is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/mistralai/Ministral-3-14B-Instruct-2512 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/mistralai/Mistral-7B-Instruct-v0.3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2.5-fp4 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/togethercomputer/CodeLlama-34b-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/zai-org/GLM-4.6 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call

Catalog model types outside the sync's token-pricing scope, skipped: audio (5), image (26), transcribe (4), video (26)

@greptile-apps

greptile-apps Bot commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerConfidence Score: 5/5

[Medium risk] Reformats model pricing and context data files.

The PR appears safe to merge, with no actionable issues found

What we checked:

  • Cached tokens keep their price: The cost calculator uses the input price when the cache-read price is missing. For this model, that is the same price the PR removes

Summary

Updates Together AI metadata in both model registries

  • Raises input, output, and cached-input prices for together_ai/Qwen/Qwen3.7-Max
  • Removes the separate cache-read price for together_ai/together/Tev1-4B-experimental
  • Removes deprecation dates from two DeepSeek models returned to the catalog
  • Keeps both registry copies identical. Other changes only adjust formatting

No actionable issues found

Reviews (1) · Last reviewed commit: "feat(models): sync together_ai model reg..." · Reviewed by Greptile

@codspeed

codspeed Bot commented Oct 8, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will not alter performance

✅ 31 untouched benchmarks


Comparing litellm_together_registry_sync_2026-10-08 (c19143d) with main (8683f14)

Open in CodSpeed

@codecov

codecov Bot commented Oct 8, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

devin-ai-integration Bot added a commit that referenced this pull request Oct 8, 2026
…ther DeepSeek V4 dates

Absorbs #45320 (Bedrock flex prices, verified against the AWS Price List API)
and the DeepSeek V4 date removals from #45307 (verified against Together docs and API)

Co-authored-by: Roi <roi@roitev.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor

The DeepSeek V4 date removals were absorbed into #44910. Qwen3.7-Max pricing was dropped because the Together API and pricing page disagree

kerrylu-berri pushed a commit that referenced this pull request Oct 8, 2026
…s, Gemini shutdown dates, OpenRouter alias drift, Mistral Large 4 context (#44910)

* feat(model_prices): add Mistral Large 4 and its OpenRouter route

Co-authored-by: moyai-devin-berriai[bot] <336287033+moyai-devin-berriai[bot]@users.noreply.github.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* fix(model_prices): sync Gemini API shutdown dates for TTS, Live, image and Omni previews

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* fix(model-prices): correct Claude Haiku 5.5 flags, add Anthropic web search flags and OpenRouter Claude Haiku 5.5

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* fix(model_prices): add Bedrock flex tier prices and clear lapsed Together DeepSeek V4 dates

Absorbs #45320 (Bedrock flex prices, verified against the AWS Price List API)
and the DeepSeek V4 date removals from #45307 (verified against Together docs and API)

Co-authored-by: Roi <roi@roitev.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* fix(model_prices): Mistral Large 4 context, OpenRouter Claude latest aliases and batch pricing

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(mistral): expect 1048576 context for Mistral Large 4

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: moyai-devin-berriai[bot] <336287033+moyai-devin-berriai[bot]@users.noreply.github.com>
Co-authored-by: Roi <roi@roitev.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant