Skip to content

Add AI provider configurations for local and cloud models #248

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
shunkakinoki merged 2 commits into from
Sep 30, 2025
Merged

Add AI provider configurations for local and cloud models #248

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d08fd81
Add AI provider configurations for local and cloud models
shunkakinoki Sep 30, 2025
f7700ce
fix: streamline provider order formatting in opencode.jsonc
shunkakinoki Sep 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 39 additions & 1 deletion home-manager/modules/opencode/opencode.jsonc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,43 @@
"$schema": "https://opencode.ai/config.json",
"theme": "opencode",
"model": "kimi-k2",
"autoupdate": true
"autoupdate": true,
"provider": {
"lmstudio": {
"npm": "@ai-sdk/openai-compatible",
"name": "LM Studio (local)",
"options": {
"baseURL": "http://127.0.0.1:1234/v1"

@gemini-code-assist gemini-code-assist Bot Sep 30, 2025

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

For consistency with the ollama provider configuration (line 23), which uses localhost, consider using localhost here as well instead of 127.0.0.1. While both are functionally similar on most systems, using a consistent hostname for local services improves the readability and maintainability of the configuration file.

				"baseURL": "http://localhost:1234/v1"

},
"models": {
"qwen/qwen3-coder-30b": {
"name": "Qwen: Qwen3 Coder 30B"
}
}
},
"ollama": {
"npm": "@ai-sdk/openai-compatible",
"name": "Ollama (local)",
"options": {
"baseURL": "http://localhost:11434/v1"
},
"models": {
"openai/gpt-oss-20b": {
"name": "OpenAI: gpt-oss-20b"
}
}
},
Comment on lines +19 to +30

@coderabbitai coderabbitai Bot Sep 30, 2025

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🔴 Critical

🧩 Analysis chain

Ollama provider configuration is correct, but verify model naming.

The Ollama configuration is properly structured. However, the model identifier "openai/gpt-oss-20b" with display name "OpenAI: gpt-oss-20b" may be confusing since "gpt-oss-20b" doesn't appear to be an official OpenAI model. Verify that:

  1. The model identifier matches what Ollama expects
  2. The "OpenAI:" prefix in the display name accurately represents the model's origin

🏁 Script executed:

#!/bin/bash
# Description: Search for documentation or references to gpt-oss-20b model in the codebase
# to verify if this is an established naming convention

rg -i "gpt-oss-20b" -C 3

Length of output: 924

🌐 Web query:

Does Ollama support a model named "gpt-oss-20b" and what is its correct model identifier?

💡 Result:

Yes. Ollama supports OpenAI's 20B gpt-oss model. The correct Ollama model identifier is gpt-oss:20b (often shown as "gpt-oss-20b" in prose, but use gpt-oss:20b in the Ollama CLI). [1][2]

Sources:
[1] Ollama model page for gpt-oss:20b.
[2] Ollama blog / docs showing usage (examples: ollama run gpt-oss:20b).

Use the proper Ollama model naming

  • In home-manager/modules/opencode/opencode.jsonc (lines 19–30), change the model key from
    "openai/gpt-oss-20b"
    to
    "gpt-oss:20b".
  • Update the display name from
    "OpenAI: gpt-oss-20b"
    to something like
    "Ollama: gpt-oss:20b".
🤖 Prompt for AI Agents 
In home-manager/modules/opencode/opencode.jsonc around lines 19 to 30 the Ollama
model is using the incorrect key and display name; change the model key from
"openai/gpt-oss-20b" to "gpt-oss:20b" and update the display name from "OpenAI:
gpt-oss-20b" to a vendor-appropriate label such as "Ollama: gpt-oss:20b" so the
configuration uses the proper Ollama model identifier and clear naming.

"openrouter": {
"models": {
"moonshotai/kimi-k2": {
"options": {
"provider": {
"order": ["baseten"],
"allow_fallbacks": false

@gemini-code-assist gemini-code-assist Bot Sep 30, 2025

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

The pull request description states that this change enhances the OpenRouter provider with a fallback configuration. However, allow_fallbacks is set to false, which explicitly disables this feature. If the intent is to allow OpenRouter to use other providers for the kimi-k2 model when baseten is unavailable, this value should be set to true.

							"allow_fallbacks": true

}
}
}
}
}
}
}
Loading