Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/users/configuration/settings.md
Original file line number Diff line number Diff line change
Expand Up @@ -203,9 +203,9 @@ The `extra_body` field allows you to add custom parameters to the request body s

#### fastModel

| Setting | Type | Description | Default |
| ----------- | ------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------- |
| `fastModel` | string | Model for background tasks ([suggestion generation](../features/followup-suggestions), speculation). Leave empty to use the main model. A smaller/faster model (e.g., `qwen3.5-flash`) reduces latency and cost. Can also be set via `/model --fast`. | `""` |
| Setting | Type | Description | Default |
| ----------- | ------ | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------- |
| `fastModel` | string | Model used for generating [prompt suggestions](../features/followup-suggestions) and speculative execution. Leave empty to use the main model. A smaller/faster model (e.g., `qwen3-coder-flash`) reduces latency and cost. Can also be set via `/model --fast`. | `""` |

#### context

Expand Down
30 changes: 15 additions & 15 deletions docs/users/features/commands.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,21 +56,21 @@ Commands specifically for controlling interface and output language.

Commands for managing AI tools and models.

| Command | Description | Usage Examples |
| ---------------- | ------------------------------------------------- | --------------------------------------------- |
| `/mcp` | List configured MCP servers and tools | `/mcp`, `/mcp desc` |
| `/tools` | Display currently available tool list | `/tools`, `/tools desc` |
| `/skills` | List and run available skills | `/skills`, `/skills <name>` |
| `/plan` | Switch to plan mode or exit plan mode | `/plan`, `/plan <task>`, `/plan exit` |
| `/approval-mode` | Change approval mode for tool usage | `/approval-mode <mode (auto-edit)> --project` |
| →`plan` | Analysis only, no execution | Secure review |
| →`default` | Require approval for edits | Daily use |
| →`auto-edit` | Automatically approve edits | Trusted environment |
| →`yolo` | Automatically approve all | Quick prototyping |
| `/model` | Switch model used in current session | `/model` |
| `/model --fast` | Set or select the fast model for background tasks | `/model --fast qwen3.5-flash` |
| `/extensions` | List all active extensions in current session | `/extensions` |
| `/memory` | Manage AI's instruction context | `/memory add Important Info` |
| Command | Description | Usage Examples |
| ---------------- | --------------------------------------------- | --------------------------------------------- |
| `/mcp` | List configured MCP servers and tools | `/mcp`, `/mcp desc` |
| `/tools` | Display currently available tool list | `/tools`, `/tools desc` |
| `/skills` | List and run available skills | `/skills`, `/skills <name>` |
| `/plan` | Switch to plan mode or exit plan mode | `/plan`, `/plan <task>`, `/plan exit` |
| `/approval-mode` | Change approval mode for tool usage | `/approval-mode <mode (auto-edit)> --project` |
| →`plan` | Analysis only, no execution | Secure review |
| →`default` | Require approval for edits | Daily use |
| →`auto-edit` | Automatically approve edits | Trusted environment |
| →`yolo` | Automatically approve all | Quick prototyping |
| `/model` | Switch model used in current session | `/model` |
| `/model --fast` | Set a lighter model for prompt suggestions | `/model --fast qwen3-coder-flash` |
| `/extensions` | List all active extensions in current session | `/extensions` |
| `/memory` | Manage AI's instruction context | `/memory add Important Info` |

### 1.5 Built-in Skills

Expand Down
10 changes: 5 additions & 5 deletions docs/users/features/followup-suggestions.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ By default, suggestions use the same model as your main conversation. For faster
### Via command

```
/model --fast qwen3.5-flash
/model --fast qwen3-coder-flash
```

Or use `/model --fast` (without a model name) to open a selection dialog.
Expand All @@ -58,11 +58,11 @@ Or use `/model --fast` (without a model name) to open a selection dialog.

```json
{
"fastModel": "qwen3.5-flash"
"fastModel": "qwen3-coder-flash"
}
```

The fast model is used for background tasks like suggestion generation. When not configured, the main conversation model is used as fallback.
The fast model is used for prompt suggestions and speculative execution. When not configured, the main conversation model is used as fallback.

Thinking/reasoning mode is automatically disabled for all background tasks (suggestion generation and speculation), regardless of your main model's thinking configuration. This avoids wasting tokens on internal reasoning that isn't needed for these tasks.

Expand All @@ -75,13 +75,13 @@ These settings can be configured in `settings.json`:
| `ui.enableFollowupSuggestions` | boolean | `true` | Enable or disable followup suggestions |
| `ui.enableCacheSharing` | boolean | `true` | Use cache-aware forked queries to reduce cost (experimental) |
| `ui.enableSpeculation` | boolean | `false` | Speculatively execute suggestions before submission (experimental) |
| `fastModel` | string | `""` | Model for background tasks (suggestion generation, speculation) |
| `fastModel` | string | `""` | Model for prompt suggestions and speculative execution |

### Example

```json
{
"fastModel": "qwen3.5-flash",
"fastModel": "qwen3-coder-flash",
"ui": {
"enableFollowupSuggestions": true,
"enableCacheSharing": true
Expand Down
2 changes: 1 addition & 1 deletion packages/cli/src/config/settingsSchema.ts
Original file line number Diff line number Diff line change
Expand Up @@ -672,7 +672,7 @@ const SETTINGS_SCHEMA = {
requiresRestart: false,
default: '',
description:
'Model for background tasks (suggestion generation, speculation). Leave empty to use the main model. A smaller/faster model (e.g., qwen3.5-flash) reduces latency and cost.',
'Model used for generating prompt suggestions and speculative execution. Leave empty to use the main model. A smaller/faster model (e.g., qwen3-coder-flash) reduces latency and cost.',
showInDialog: true,
},

Expand Down
4 changes: 2 additions & 2 deletions packages/cli/src/i18n/locales/de.js
Original file line number Diff line number Diff line change
Expand Up @@ -990,8 +990,8 @@ export default {
// Commands - Model
// ============================================================================
'Switch the model for this session': 'Modell für diese Sitzung wechseln',
'Set fast model for background tasks':
'Schnelles Modell für Hintergrundaufgaben festlegen',
'Set a lighter model for prompt suggestions and speculative execution':
'Leichteres Modell für Eingabevorschläge und spekulative Ausführung festlegen',
'Content generator configuration not available.':
'Inhaltsgenerator-Konfiguration nicht verfügbar.',
'Authentication type not available.':
Expand Down
3 changes: 2 additions & 1 deletion packages/cli/src/i18n/locales/en.js
Original file line number Diff line number Diff line change
Expand Up @@ -1152,7 +1152,8 @@ export default {
// Commands - Model
// ============================================================================
'Switch the model for this session': 'Switch the model for this session',
'Set fast model for background tasks': 'Set fast model for background tasks',
'Set a lighter model for prompt suggestions and speculative execution':
'Set a lighter model for prompt suggestions and speculative execution',
'Content generator configuration not available.':
'Content generator configuration not available.',
'Authentication type not available.': 'Authentication type not available.',
Expand Down
4 changes: 2 additions & 2 deletions packages/cli/src/i18n/locales/ja.js
Original file line number Diff line number Diff line change
Expand Up @@ -744,8 +744,8 @@ export default {
'サマリーの生成に失敗 - LLMレスポンスからテキストコンテンツを受信できませんでした',
// Model
'Switch the model for this session': 'このセッションのモデルを切り替え',
'Set fast model for background tasks':
'バックグラウンドタスク用の高速モデルを設定',
'Set a lighter model for prompt suggestions and speculative execution':
'プロンプト提案と投機的実行用の軽量モデルを設定',
'Content generator configuration not available.':
'コンテンツジェネレーター設定が利用できません',
'Authentication type not available.': '認証タイプが利用できません',
Expand Down
4 changes: 2 additions & 2 deletions packages/cli/src/i18n/locales/pt.js
Original file line number Diff line number Diff line change
Expand Up @@ -997,8 +997,8 @@ export default {
// Commands - Model
// ============================================================================
'Switch the model for this session': 'Trocar o modelo para esta sessão',
'Set fast model for background tasks':
'Definir modelo rápido para tarefas em segundo plano',
'Set a lighter model for prompt suggestions and speculative execution':
'Definir modelo mais leve para sugestões de prompt e execução especulativa',
'Content generator configuration not available.':
'Configuração do gerador de conteúdo não disponível.',
'Authentication type not available.': 'Tipo de autenticação não disponível.',
Expand Down
4 changes: 2 additions & 2 deletions packages/cli/src/i18n/locales/ru.js
Original file line number Diff line number Diff line change
Expand Up @@ -998,8 +998,8 @@ export default {
// Команды - Модель
// ============================================================================
'Switch the model for this session': 'Переключение модели для этой сессии',
'Set fast model for background tasks':
'Установить быструю модель для фоновых задач',
'Set a lighter model for prompt suggestions and speculative execution':
'Установить облегчённую модель для подсказок и спекулятивного выполнения',
'Content generator configuration not available.':
'Конфигурация генератора содержимого недоступна.',
'Authentication type not available.': 'Тип авторизации недоступен.',
Expand Down
3 changes: 2 additions & 1 deletion packages/cli/src/i18n/locales/zh.js
Original file line number Diff line number Diff line change
Expand Up @@ -1093,7 +1093,8 @@ export default {
// Commands - Model
// ============================================================================
'Switch the model for this session': '切换此会话的模型',
'Set fast model for background tasks': '设置后台任务的快速模型',
'Set a lighter model for prompt suggestions and speculative execution':
'设置用于输入建议和推测执行的轻量模型',
'Content generator configuration not available.': '内容生成器配置不可用',
'Authentication type not available.': '认证类型不可用',
'No models available for the current authentication type ({{authType}}).':
Expand Down
6 changes: 4 additions & 2 deletions packages/cli/src/ui/commands/modelCommand.ts
Original file line number Diff line number Diff line change
Expand Up @@ -21,11 +21,13 @@ export const modelCommand: SlashCommand = {
},
kind: CommandKind.BUILT_IN,
completion: async (_context, partialArg) => {
if ('--fast'.startsWith(partialArg)) {
if (partialArg && '--fast'.startsWith(partialArg)) {
return [
{
value: '--fast',
description: t('Set fast model for background tasks'),
description: t(
'Set a lighter model for prompt suggestions and speculative execution',
),
},
];
}
Expand Down
2 changes: 1 addition & 1 deletion packages/vscode-ide-companion/schemas/settings.schema.json
Original file line number Diff line number Diff line change
Expand Up @@ -260,7 +260,7 @@
"additionalProperties": true
},
"fastModel": {
"description": "Model for background tasks (suggestion generation, speculation). Leave empty to use the main model. A smaller/faster model (e.g., qwen3.5-flash) reduces latency and cost.",
"description": "Model used for generating prompt suggestions and speculative execution. Leave empty to use the main model. A smaller/faster model (e.g., qwen3-coder-flash) reduces latency and cost.",
"type": "string",
"default": ""
},
Expand Down
Loading