Skip to content

feat(models): sync together_ai model registry - #45754

Closed
mateo-berri wants to merge 1 commit into
mainfrom
litellm_together_registry_sync_2026-10-10
Closed

mateo-berri wants to merge 1 commit into
mainfrom
litellm_together_registry_sync_2026-10-10

Conversation

@mateo-berri

Copy link
Copy Markdown
Contributor

Automated daily sync of the together_ai entries in model_prices_and_context_window.json against GET https://api.together.ai/v1/models?serverless and https://docs.together.ai/docs/deprecations.md by scripts/sync_together_ai_models.py.

Added (0)

  • none

Updated (1)

  • together_ai/together/Tev1-4B-experimental: cache_read_input_token_cost: 4.2e-08 removed (no longer in the catalog pricing)

Marked deprecated (0)

  • none

Returned to the catalog (2)

  • together_ai/deepseek-ai/DeepSeek-V4-Flash-0731
  • together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo

Warnings needing a human call (19)

  • together_ai/BAAI/bge-base-en-v1.5 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/MiniMaxAI/MiniMax-M2.7 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2-1.5B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-14B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-72B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/arcee-ai/trinity-mini is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-R1-0528 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-V3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Llama-3.1-405B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Llama-3.2-1B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Llama-3.2-3B-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/meta-llama/Meta-Llama-3.1-8B is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/mistralai/Ministral-3-14B-Instruct-2512 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/mistralai/Mistral-7B-Instruct-v0.3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2.5-fp4 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/togethercomputer/CodeLlama-34b-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/zai-org/GLM-4.6 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call

Catalog model types outside the sync's token-pricing scope, skipped: audio (6), image (26), transcribe (4), video (26)

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@greptile-apps

greptile-apps Bot commented Oct 10, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerConfidence Score: 4/5

[Low impact] Reformats JSON whitespace in model pricing data.

Restore the two future shutdown dates before merging.

Findings

  1. P1 Upcoming shutdown warnings disappear ▶

Summary

Updates the Together AI entries in both registry files.

  • The Together AI registry reflects returning models and current cache pricing.
  • Other model-price entries keep the same behavior.

Reviews (1) · Last reviewed commit: "feat(models): sync together_ai model reg..." · Reviewed by Greptile

},
"together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo": {
"deprecation_date": "2026-10-22",
"input_cost_per_token": 1.04e-06,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Upcoming shutdown warnings disappear

Removing deprecation_date hides the scheduled 2026-10-22 shutdown for together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo and together_ai/deepseek-ai/DeepSeek-V4-Flash-0731. These dates were added by a dedicated fix on October 9. Today's catalog still listing the models does not mean their future shutdown was cancelled.

Without these dates, collect_model_deprecations stops reporting the upcoming shutdowns unless users supply their own overrides. Keep both dates in both registry files until the shutdowns are confirmed cancelled.

@codspeed

codspeed Bot commented Oct 10, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will not alter performance

⚠️ 1 benchmark spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

✅ 31 untouched benchmarks


Comparing litellm_together_registry_sync_2026-10-10 (1054f49) with main (f57906c)

Open in CodSpeed

@codecov

codecov Bot commented Oct 10, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Superseded by #45793, which removes both rescinded Together dates. The Tev1-4B cache read removal was dropped as unverified, details in that PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants