Skip to content

feat(models): sync together_ai model registry - #41047

Closed
mateo-berri wants to merge 1 commit into
mainfrom
litellm_together_registry_sync_2026-09-14
Closed

mateo-berri wants to merge 1 commit into
mainfrom
litellm_together_registry_sync_2026-09-14

Conversation

@mateo-berri

Copy link
Copy Markdown
Contributor

Automated daily sync of the together_ai entries in model_prices_and_context_window.json against GET https://api.together.ai/v1/models?serverless and https://docs.together.ai/docs/deprecations.md by scripts/sync_together_ai_models.py.

Added (1)

  • together_ai/deepseek-ai/DeepSeek-V4.1-Flash

Updated (0)

  • none

Marked deprecated (0)

  • none

Returned to the catalog (4)

  • together_ai/google/gemma-4-31B-it
  • together_ai/intfloat/multilingual-e5-large-instruct
  • together_ai/openai/gpt-oss-20b
  • together_ai/thinkingmachines/Inkling-Small

Warnings needing a human call (14)

  • together_ai/deepseek-ai/DeepSeek-V4.1-Flash added without a capability rule; review its tools/vision/reasoning support and add one
  • together_ai/BAAI/bge-base-en-v1.5 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/MiniMaxAI/MiniMax-M2.7 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/baai/bge-base-en-v1.5 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-R1-0528 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-V3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/mistralai/Ministral-3-14B-Instruct-2512 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/mistralai/Mistral-7B-Instruct-v0.3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2.5-fp4 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/nvidia/NVIDIA-Nemotron-Nano-9B-v2 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/togethercomputer/CodeLlama-34b-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/zai-org/GLM-4.6 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call

Catalog model types outside the sync's token-pricing scope, skipped: audio (5), image (29), transcribe (4), video (34)

@mateo-berri
mateo-berri requested a review from a team September 14, 2026 07:05
@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@codspeed

codspeed Bot commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will not alter performance

✅ 31 untouched benchmarks


Comparing litellm_together_registry_sync_2026-09-14 (e3b0db4) with main (30f33a9)

Open in CodSpeed

@greptile-apps

greptile-apps Bot commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

Adds Together AI’s DeepSeek-V4.1-Flash pricing and context metadata and clears deprecation dates for four models reported as returned to the catalog

  • Applies identical changes to the primary registry and packaged backup
  • Includes an equivalent numeric-format change for Meta transcription pricing
  • The new model still needs a reviewed capability rule so discovery can distinguish supported features from unknown ones

Confidence Score: 4/5

The PR appears safe to merge, with a non-blocking recommendation to complete the new model’s capability review

No blocking defect was established; omitted capability flags leave discovery unable to accurately advertise any supported tools, reasoning, or vision features

Files Needing Attention: model_prices_and_context_window.json and litellm/model_prices_and_context_window_backup.json

Important Files Changed

Filename Overview
model_prices_and_context_window.json Adds DeepSeek-V4.1-Flash and restores four catalog entries; the new model lacks reviewed capability metadata
litellm/model_prices_and_context_window_backup.json Mirrors the primary registry changes, including the same capability-metadata gap

Reviews (1): Last reviewed commit: "feat(models): sync together_ai model reg..." | Re-trigger Greptile

"mode": "chat",
"output_cost_per_token": 1.2e-06,
"source": "https://docs.together.ai/docs/serverless-models",
"supports_prompt_caching": true

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Missing capability metadata

If this model supports tools/reasoning, omitted flags make discovery report them unsupported, potentially hiding features from callers. Add a reviewed capability rule

Knowledge Base Used: Provider adapters and capabilities

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!

@codecov

codecov Bot commented Sep 14, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Superseded by #41112, which carries the DeepSeek V4.1 Flash entry with values re-verified against the Together docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants