Skip to content

feat(models): sync together_ai model registry - #38946

Closed
mateo-berri wants to merge 1 commit into
litellm_internal_stagingfrom
litellm_together_registry_sync_2026-08-31
Closed

feat(models): sync together_ai model registry#38946
mateo-berri wants to merge 1 commit into
litellm_internal_stagingfrom
litellm_together_registry_sync_2026-08-31

Conversation

@mateo-berri

Copy link
Copy Markdown
Contributor

Automated daily sync of the together_ai entries in model_prices_and_context_window.json against GET https://api.together.ai/v1/models?serverless and https://docs.together.ai/docs/deprecations.md by scripts/sync_together_ai_models.py.

Added (1)

  • together_ai/Qwen/Qwen3.8-Flash

Updated (0)

  • none

Marked deprecated (0)

  • none

Returned to the catalog (0)

  • none

Warnings needing a human call (8)

  • together_ai/Qwen/Qwen3.8-Flash added without a capability rule; review its tools/vision/reasoning support and add one
  • together_ai/BAAI/bge-base-en-v1.5 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/baai/bge-base-en-v1.5 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/deepseek-ai/DeepSeek-V3 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/moonshotai/Kimi-K2-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/togethercomputer/CodeLlama-34b-Instruct is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call
  • together_ai/zai-org/GLM-4.6 is absent from the serverless catalog with no removal date in the docs; needs a human deprecation call

Catalog model types outside the sync's token-pricing scope, skipped: audio (5), image (29), transcribe (4), video (38)

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@codspeed-hq

codspeed-hq Bot commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will not alter performance

✅ 31 untouched benchmarks


Comparing litellm_together_registry_sync_2026-08-31 (f0804cc) with litellm_internal_staging (4ba8517)

Open in CodSpeed

@greptile-apps

greptile-apps Bot commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

Adds the Together AI Qwen/Qwen3.8-Flash model to both model-price registries with synchronized pricing and one-million-token context metadata.

  • Adds input pricing of $0.15 per million tokens and output pricing of $0.47 per million tokens.
  • Keeps the primary and backup registry files identical.

Confidence Score: 5/5

The registry-only change appears safe to merge, with the capability classification already called out for separate human review.

The primary and backup registries contain matching entries, and no reachable incorrect pricing, token-limit, or capability behavior was established from the available evidence.

Important Files Changed

Filename Overview
model_prices_and_context_window.json Adds the new Together AI model’s pricing and context metadata; no concrete defect was established.
litellm/model_prices_and_context_window_backup.json Mirrors the primary registry addition exactly, preserving backup consistency.

Reviews (1): Last reviewed commit: "feat(models): sync together_ai model reg..." | Re-trigger Greptile

@codecov

codecov Bot commented Aug 31, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@devin-ai-integration

Copy link
Copy Markdown
Contributor

Superseded by the rolling registry PR #38990, which absorbs this change (values re-verified against the official provider docs). Closing per the one-rolling-registry-PR policy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants