Skip to content

docs: document Kilo model routing/config and correct Gas Town small model docs - #13621

Merged
alexkgold merged 6 commits into
mainfrom
docs/small-model-routing-config
Aug 31, 2026
Merged

docs: document Kilo model routing/config and correct Gas Town small model docs#13621
alexkgold merged 6 commits into
mainfrom
docs/small-model-routing-config

Conversation

@alexkgold

Copy link
Copy Markdown
Contributor

What changed

  • Added a Model Routing and Configuration section to code-with-ai/agents/model-selection.md documenting the four independently configurable model slots (main, small, subagent, autocomplete), how each falls back when unset, and what going fully offline/self-hosted actually requires.
  • Corrected code-with-ai/gastown/settings.md's Small Model description: it's used for session title generation and the explore subagent (not classification/routing/summarization), defaults to Claude Haiku (not a Kilo-managed default), and the "Kilo Auto Balanced — minimum for Gas Town" claim is unenforced in code, so it's now framed as a recommendation.
  • Corrected the stale Legacy autocomplete provider-fallback list in code-with-ai/features/autocomplete/index.md, which described a 9-provider priority chain that isn't implemented anywhere in current code — replaced with the actual 3-provider (Kilo Gateway / Mistral BYOK / Inception BYOK) fail-fast behavior, and noted there's no offline/local autocomplete path today.
  • Fixed a follow-up self-review finding: the offline-setup guidance incorrectly implied the autocomplete model supports local providers like Ollama/LM Studio, contradicting the warning callout describing autocomplete's lack of local fallback.

Why

The small/subagent/autocomplete model configuration surface wasn't documented outside of Gas Town's page, and the Gas Town docs had drifted from actual code behavior. This corrects both gaps with details verified against the implementation (provider.ts, task.ts, kilo-gateway/src/autocomplete.ts, and the Gas Town service in the cloud repo).

Testing

Docs-only change; no build/test commands apply beyond reading the rendered Markdoc content.

@vercel

vercel Bot commented Aug 31, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs (docs-staging) Ready Ready Preview Aug 31, 2026 8:23pm

Request Review

Comment thread packages/kilo-docs/pages/code-with-ai/features/autocomplete/index.md Outdated
Comment thread packages/kilo-docs/pages/code-with-ai/agents/model-selection.md Outdated
@kilo-code-bot

kilo-code-bot Bot commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Code Review Summary

Status: No Issues Found | Recommendation: Merge

Files Reviewed (1 files)
  • packages/kilo-docs/pages/code-with-ai/agents/model-selection.md
Previous Review Summaries (4 snapshots, latest commit 42a1f98)

Current summary above is authoritative. Previous snapshots are kept for context only.

Previous review (commit 42a1f98)

Status: No Issues Found | Recommendation: Merge

Files Reviewed (1 files)
  • packages/kilo-docs/pages/code-with-ai/agents/model-selection.md

Previous review (commit daeaa0d)

Status: 1 Issue Found | Recommendation: Address before merge

Overview

Severity Count
CRITICAL 0
WARNING 1
SUGGESTION 0
Issue Details (click to expand)

WARNING

File Line Issue
packages/kilo-docs/pages/code-with-ai/agents/model-selection.md 31 Mistral BYOK is still described as a fully offline setup option
Files Reviewed (2 files)
  • packages/kilo-docs/pages/code-with-ai/agents/model-selection.md - 1 issue
  • packages/kilo-docs/pages/code-with-ai/gastown/settings.md - 0 issues

Fix these issues in Kilo Cloud

Previous review (commit a815307)

Status: 1 Issue Found | Recommendation: Address before merge

Overview

Severity Count
CRITICAL 0
WARNING 1
SUGGESTION 0
Issue Details (click to expand)

WARNING

File Line Issue
packages/kilo-docs/pages/code-with-ai/features/autocomplete/index.md 116 3-provider correction is in the Legacy tab, uses current Settings UI, and contradicts the Codestral-only callout
Files Reviewed (2 files)
  • packages/kilo-docs/pages/code-with-ai/agents/model-selection.md - 0 issues
  • packages/kilo-docs/pages/code-with-ai/features/autocomplete/index.md - 1 issue

Fix these issues in Kilo Cloud

Previous review (commit f21608b)

Status: 2 Issues Found | Recommendation: Address before merge

Overview

Severity Count
CRITICAL 0
WARNING 1
SUGGESTION 1
Issue Details (click to expand)

WARNING

File Line Issue
packages/kilo-docs/pages/code-with-ai/features/autocomplete/index.md 116 3-provider correction is in the Legacy tab, uses current Settings UI, and contradicts the Codestral-only callout

SUGGESTION

File Line Issue
packages/kilo-docs/pages/code-with-ai/agents/model-selection.md 31 Mistral BYOK is still described as a fully offline setup option
Files Reviewed (3 files)
  • packages/kilo-docs/pages/code-with-ai/agents/model-selection.md - 1 issue
  • packages/kilo-docs/pages/code-with-ai/features/autocomplete/index.md - 1 issue
  • packages/kilo-docs/pages/code-with-ai/gastown/settings.md - 0 issues

Fix these issues in Kilo Cloud


Reviewed by grok-4.6 · Input: 37.7K · Output: 2.3K · Cached: 75.8K

Review guidance: REVIEW.md from base branch main

Comment thread packages/kilo-docs/pages/code-with-ai/agents/model-selection.md Outdated
@alexkgold
alexkgold merged commit e5a962d into main Aug 31, 2026
27 checks passed
@alexkgold
alexkgold deleted the docs/small-model-routing-config branch August 31, 2026 22:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants