Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions packages/kilo-docs/lychee.toml
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,9 @@ accept = [
exclude = [
'\.png$',
'https://synthetic.new/user-settings/api',
# Synthetic's site intermittently returns 503 to automated link checks.
'^https?://synthetic\.new/?$',
'^https?://synthetic\.new/pricing/?$',
'https://platform.slack-edge.com/img/add_to_slack.png',
'https://console.groq.com/pages/models',
'^https?://([A-Za-z0-9-]+\.)?glama\.ai(/|$)',
Expand Down
28 changes: 28 additions & 0 deletions packages/kilo-docs/pages/code-with-ai/agents/model-selection.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,34 @@ Here's the honest truth about AI model recommendations: by the time I write them

Instead of maintaining a static list that's perpetually behind, we built something better — a real-time leaderboard showing which models Kilo Code users are actually having success with right now.

## Model Routing and Configuration

Kilo's IDE Extension and CLI configurations have four separate, independently configurable model slots:

- **Main model** — the primary model your agent uses for coding tasks, chat, and reasoning. This is what you pick with the model selector, `/models`, or the `model` key in `kilo.jsonc`. See [How to Select and Switch Models](#how-to-select-and-switch-models) for the full precedence order and per-agent config.
- The main model is also used for context compaction/summarization and todo-list generation.
- **Small model** — a lightweight model used for session title generation, commit message generation, and prompt enhancement. Configured with the `small_model` key in `kilo.jsonc`, or the **Small Model** field on the **Settings → Models** tab.
- If left unset, Kilo resolves it according to the following logic:
1. Find a small/cheap variant on your current provider (e.g. Haiku on Anthropic, Flash on Gemini).
2. Fall back to [`kilo-auto/small`](/docs/gateway/models-and-providers#kilo-autosmall) if the Kilo Gateway provider is authenticated in your session.
3. Reuse your main model if you're not authenticated to the Kilo Gateway.
- **Subagent model** — the default model for subagents launched by the `task` tool. Configured with the `subagent_model` key in `kilo.jsonc`, or the **Subagent Model** field on the **Settings → Models** tab.
- If left unset, inherits whichever model the parent agent session is currently using.
- **Autocomplete model** — the model used for inline code completions as you type. See [Autocomplete: Provider and Model](/docs/code-with-ai/features/autocomplete#provider-and-model) for how to configure it.

### Configuring Local Usage

If you want to use a private/local inference source, you can:

1. Set your **main model** to a non-`kilo-auto` provider — a local model (Ollama, LM Studio) or a direct BYOK provider key.
2. Explicitly set **`small_model`** to a model on that same provider. If you leave it unset while signed in to Kilo Gateway, it falls back to [`kilo-auto/small`](/docs/gateway/models-and-providers#kilo-autosmall) rather than reusing your main model.
3. Leave **`subagent_model`** unset — it always inherits your main model rather than defaulting to Kilo Gateway, whether or not you're signed in.
4. For **autocomplete**, switch the provider to a direct Mistral or Inception BYOK key or disable autocomplete.

{% callout type="note" %}
You can ensure no inference will go through the Kilo Gateway by logging out of the Kilo Gateway in the IDE extension or TUI.
{% /callout %}

## Check the Live Models List

**[👉 See what's working today at kilo.ai/models](https://kilo.ai/models)**
Expand Down
6 changes: 3 additions & 3 deletions packages/kilo-docs/pages/code-with-ai/gastown/settings.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,15 +17,15 @@ The primary model used by all agents (polecats, refinery, mayor). This affects q

Popular choices:
- **Kilo Auto Frontier** — highest quality models, best results (recommended)
- **Kilo Auto Efficient** — cheapest model proven accurate enough for each task, with capability matched to difficulty (minimum for Gas Town)
- **Kilo Auto Efficient** — cheapest model proven accurate enough for each task, with capability matched to difficulty

### Role-Specific Models

Override the default model for specific agent roles. By default, all roles use the town-level model. You can override per-role if you want to optimize cost vs quality for different tasks (e.g., a faster model for the mayor, a stronger model for the refinery).
Override the default model for specific agent roles — **mayor**, **refinery**, and **polecat**. By default, all roles use the town-level default model. You can override per-role if you want to optimize cost vs quality for different tasks (e.g., a faster model for the mayor, a stronger model for the refinery).

### Small Model

Used for lightweight tasks (classification, routing, summarization). Usually a smaller, cheaper model.
Used for session title generation and the `explore` subagent inside your town's containers — not general classification, routing, or summarization. This is a lighter-weight model than your default, and it's independent of the `small_model` config used elsewhere in Kilo Code (see [Model Routing and Configuration](/docs/code-with-ai/agents/model-selection#model-routing-and-configuration)). If left unset, it defaults to Claude Haiku.

## Git & Authentication

Expand Down
Loading