Skip to content

feat(together-ai): add GLM-5.1, Kimi K2.6, DeepSeek V4 Pro #2094

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
steebchen merged 3 commits into from
Apr 26, 2026
Merged

feat(together-ai): add GLM-5.1, Kimi K2.6, DeepSeek V4 Pro #2094

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
6bd46ac
feat(together-ai): add GLM-5.1, Kimi K2.6, DeepSeek V4 Pro
steebchen Apr 26, 2026
ec080cb
fix(models): deactivate retired Llama models, fix together-ai
steebchen Apr 26, 2026
52eed64
feat(together-ai): add gpt-oss-120b and gpt-oss-20b
steebchen Apr 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions packages/models/src/models/deepseek.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -275,6 +275,23 @@ export const deepseekModels = [
"tools",
],
},
{
providerId: "together-ai",
modelName: "deepseek-ai/DeepSeek-V4-Pro",
inputPrice: 2.1 / 1e6,
cachedInputPrice: 0.2 / 1e6,
outputPrice: 4.4 / 1e6,
requestPrice: 0,
contextSize: 163840,
maxOutput: 163840,
streaming: true,
reasoning: true,
reasoningOutput: "omit",
vision: false,
tools: true,
jsonOutput: true,
jsonOutputSchema: true,
},
],
},
{
Expand Down
6 changes: 6 additions & 0 deletions packages/models/src/models/meta.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ export const metaModels = [
vision: false,
tools: false,
jsonOutput: false,
deactivatedAt: new Date("2026-04-25"),
},
{
providerId: "nebius",
Expand All @@ -34,6 +35,7 @@ export const metaModels = [
vision: false,
tools: false,
jsonOutput: false,
deactivatedAt: new Date("2026-04-25"),
},
{
providerId: "inference.net",
Expand All @@ -48,6 +50,7 @@ export const metaModels = [
vision: false,
tools: false,
jsonOutput: false,
deactivatedAt: new Date("2026-04-25"),
},
{
providerId: "together-ai",
Expand Down Expand Up @@ -84,6 +87,7 @@ export const metaModels = [
"top_p",
"response_format",
],
deactivatedAt: new Date("2026-04-25"),
},
{
providerId: "novita",
Expand All @@ -97,6 +101,7 @@ export const metaModels = [
vision: false,
tools: false,
jsonOutput: true,
deactivatedAt: new Date("2026-04-25"),
},
],
},
Expand Down Expand Up @@ -327,6 +332,7 @@ export const metaModels = [
vision: false,
tools: true,
jsonOutput: false,
deactivatedAt: new Date("2026-04-25"),
Comment on lines 331 to +335

Copilot AI Apr 26, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For the llama-4-scout model’s Together AI mapping, the configured modelName in this provider entry appears to point to a Llama 3.1 405B Turbo model rather than a Llama 4 Scout variant. Even though this mapping is now deactivated, this mismatch is confusing and can lead to incorrect routing/analytics if the mapping is ever referenced; please verify the intended Together model slug and either correct modelName (and any related pricing/context fields) or rename/remove the model definition so the id/name and modelName align.

Copilot uses AI. Check for mistakes.

@chatgpt-codex-connector chatgpt-codex-connector Bot Apr 26, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Deactivate the correct Together Scout model mapping

This deactivatedAt change is applied to the llama-4-scout provider record whose modelName is meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo, so after 2026-04-25 requests targeting together-ai/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo will be rejected as deactivated. That disables the 3.1-405B mapping rather than the actual Scout model mapping (meta-llama/llama-4-scout-17b-16e-instruct), so the retirement is being enforced on the wrong entry.

Useful? React with 👍 / 👎.

},
],
},
Expand Down
16 changes: 16 additions & 0 deletions packages/models/src/models/moonshot.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -395,6 +395,22 @@ export const moonshotModels = [
tools: true,
jsonOutput: true,
},
{
providerId: "together-ai",
modelName: "moonshotai/Kimi-K2.6",
test: "skip",
inputPrice: 1.2 / 1e6,
cachedInputPrice: 0.2 / 1e6,
outputPrice: 4.5 / 1e6,
requestPrice: 0,
contextSize: 262144,
maxOutput: 32768,
streaming: true,

@chatgpt-codex-connector chatgpt-codex-connector Bot Apr 26, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Mark Kimi K2.6 Together mapping as non-streaming

This mapping advertises streaming: true, so apps/gateway/src/chat/chat.ts will allow streamed requests for it, but this same provider entry is already tagged test: "skip" due to known streaming failures (no streaming content returned in the commit context). As shipped, clients using stream: true can be routed to a configuration that returns empty streamed responses instead of being rejected early; setting streaming: false (or deactivating the mapping until fixed) would prevent broken runtime behavior.

Useful? React with 👍 / 👎.

reasoning: true,
vision: true,
tools: false,
jsonOutput: false,
},
],
},
] as const satisfies ModelDefinition[];
15 changes: 15 additions & 0 deletions packages/models/src/models/zai.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,21 @@ export const zaiModels = [
tools: true,
jsonOutput: true,
},
{
providerId: "together-ai",
modelName: "zai-org/GLM-5.1",
inputPrice: 1.4 / 1e6,
outputPrice: 4.4 / 1e6,
requestPrice: 0,
contextSize: 202752,
maxOutput: 202752,
streaming: true,
reasoning: true,
vision: false,
tools: true,
jsonOutput: true,
jsonOutputSchema: true,
},
],
},
{
Expand Down
Loading