Skip to content

feat(nebius): switch to tokenfactory and sync model list #2087

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
steebchen merged 4 commits into from
Apr 26, 2026
Merged

feat(nebius): switch to tokenfactory and sync model list #2087

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
8231869
feat(nebius): switch to tokenfactory and add kimi-k2.5
steebchen Apr 26, 2026
840210c
chore(models): sync nebius active model list
steebchen Apr 26, 2026
9e1c71e
fix(nebius): mark kimi-k2.5 unstable, reflect tool/json support
steebchen Apr 26, 2026
993098e
fix(nebius): enable tools/json on minimax-m2.5, mark unstable
steebchen Apr 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion packages/actions/src/get-provider-endpoint.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,7 @@ export function getProviderEndpoint(
break;
}
case "nebius":
url = "https://api.studio.nebius.com";
url = "https://api.tokenfactory.nebius.com";
break;
Comment on lines 226 to 228

Copilot AI Apr 26, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

getProviderEndpoint() now hardcodes a different Nebius base URL, but there is no unit test asserting the Nebius default endpoint. Please add/update a test in packages/actions/src/get-provider-endpoint.spec.ts to lock in the expected Nebius URL (e.g. https://api.tokenfactory.nebius.com/v1/chat/completions) so future changes don’t silently break Nebius routing.

Copilot uses AI. Check for mistakes.
case "zai":
url = "https://api.z.ai";
Expand Down
53 changes: 53 additions & 0 deletions packages/models/src/models/alibaba.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -665,6 +665,7 @@ export const alibabaModels = [
vision: false,
tools: false,
jsonOutput: true,
deactivatedAt: new Date("2026-04-25"),
},
],
},
Expand Down Expand Up @@ -865,6 +866,7 @@ export const alibabaModels = [
vision: false,
tools: true,
jsonOutput: true,
deactivatedAt: new Date("2026-04-25"),
},
{
providerId: "novita",
Expand Down Expand Up @@ -947,6 +949,7 @@ export const alibabaModels = [
"response_format",
"tools",
],
deactivatedAt: new Date("2026-04-25"),
},
],
},
Expand Down Expand Up @@ -1058,6 +1061,31 @@ export const alibabaModels = [
"tools",
],
},
{
providerId: "nebius",
modelName: "Qwen/Qwen3-Next-80B-A3B-Thinking",
inputPrice: 0.15 / 1e6,
outputPrice: 1.2 / 1e6,
requestPrice: 0,
contextSize: 131072,
maxOutput: 32768,
reasoning: true,
streaming: true,
vision: false,
tools: true,
jsonOutput: false,
supportedParameters: [
"temperature",
"max_tokens",
"top_p",
"frequency_penalty",
"presence_penalty",
"stop",
"stream",
"response_format",
"tools",
],
},
],
},
{
Expand Down Expand Up @@ -1408,6 +1436,31 @@ export const alibabaModels = [
"tools",
],
},
{
providerId: "nebius",
modelName: "Qwen/Qwen3.5-397B-A17B",
inputPrice: 0.6 / 1e6,
outputPrice: 3.6 / 1e6,
requestPrice: 0,
contextSize: 262144,
maxOutput: 32768,
reasoning: true,
streaming: true,
vision: true,
tools: true,
jsonOutput: true,
supportedParameters: [
"temperature",
"max_tokens",
"top_p",
"frequency_penalty",
"presence_penalty",
"stop",
"stream",
"response_format",
"tools",
],
},
],
},
{
Expand Down
14 changes: 14 additions & 0 deletions packages/models/src/models/deepseek.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,7 @@ export const deepseekModels = [
tools: false,
stability: "unstable" as const,
jsonOutput: false,
deactivatedAt: new Date("2026-04-25"),
},
],
},
Expand Down Expand Up @@ -225,6 +226,19 @@ export const deepseekModels = [
tools: true,
jsonOutput: false,
},
{
providerId: "nebius",
modelName: "deepseek-ai/DeepSeek-V3.2",
inputPrice: 0.3 / 1e6,
outputPrice: 0.45 / 1e6,
requestPrice: 0,
contextSize: 163840,
maxOutput: 32768,
streaming: true,
vision: false,
tools: true,
jsonOutput: true,
},
],
},
{
Expand Down
16 changes: 16 additions & 0 deletions packages/models/src/models/minimax.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -186,6 +186,22 @@ export const minimaxModels = [
"parallel_tool_calls",
],
},
{
providerId: "nebius",
// Streaming tool calls and response_format: json_object are unreliable on Nebius
stability: "unstable",
modelName: "MiniMaxAI/MiniMax-M2.5",
inputPrice: 0.3 / 1e6,
outputPrice: 1.2 / 1e6,
requestPrice: 0,
contextSize: 204800,
maxOutput: 131100,
streaming: true,
reasoning: true,
vision: false,
tools: true,
jsonOutput: true,
},
],
},
{
Expand Down
18 changes: 18 additions & 0 deletions packages/models/src/models/moonshot.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,7 @@ export const moonshotModels = [
vision: false,
tools: true,
jsonOutput: true,
deactivatedAt: new Date("2026-04-25"),
},
{
providerId: "bytedance",
Expand Down Expand Up @@ -274,6 +275,23 @@ export const moonshotModels = [
tools: false,
jsonOutput: false,
},
{
providerId: "nebius",
// Streaming tool calls and response_format: json_object are unreliable on Nebius
stability: "unstable",
modelName: "moonshotai/Kimi-K2.5",
inputPrice: 0.5 / 1e6,
cachedInputPrice: 0.02 / 1e6,
outputPrice: 2.5 / 1e6,
requestPrice: 0,
contextSize: 262144,
maxOutput: 32768,
streaming: true,
reasoning: true,
vision: true,
tools: true,
jsonOutput: true,
},
Comment thread
coderabbitai[bot] marked this conversation as resolved.
{
test: "skip",
providerId: "alibaba",
Expand Down
14 changes: 14 additions & 0 deletions packages/models/src/models/openai.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -693,6 +693,20 @@ export const openaiModels = [
reasoning: true,
jsonOutput: false, // BytePlus doesn't support response_format
},
{
providerId: "nebius",
modelName: "openai/gpt-oss-120b",
inputPrice: 0.15 / 1e6,
outputPrice: 0.6 / 1e6,
requestPrice: 0,
contextSize: 131072,
maxOutput: 32768,
streaming: true,
vision: false,
tools: true,
reasoning: true,
jsonOutput: true,
},
],
},
{
Expand Down
14 changes: 14 additions & 0 deletions packages/models/src/models/zai.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -181,6 +181,20 @@ export const zaiModels = [
"reasoning",
],
},
{
providerId: "nebius",
modelName: "zai-org/GLM-5",
inputPrice: 1.0 / 1e6,
outputPrice: 3.2 / 1e6,
requestPrice: 0,
contextSize: 202752,
maxOutput: 32768,
streaming: true,
reasoning: true,
vision: false,
tools: true,
jsonOutput: true,
},
],
},
{
Expand Down
Loading