Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/inference/model-capability-audit.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -118,6 +118,7 @@ When importing a completed row from an issue comment, preserve the exact commit
|---|---|---|---|---|---|---|---|---|
| OpenClaw primary agent | NVIDIA Endpoints | `nvidia/nemotron-3-super-120b-a12b` | Managed `inference.local` OpenAI-compatible completions | `not-yet-run` | Add trajectory and session evidence before changing state. | Existing setup keeps Tool Search disabled and preserves direct structured tool calls, overriding the generated `tools.toolSearch.mode: tools` default for this route. | Verify `tool_search`, `tool_describe`, `tool_call`, and final execution before replacing the safeguard. | `scripts/generate-openclaw-config.mts`, `nemoclaw-blueprint/model-specific-setup/openclaw/nemotron-3-super-120b-managed-inference.json`. |
| OpenClaw existing configuration | NVIDIA Endpoints (retired route) | `moonshotai/kimi-k2.6` | Managed `inference.local` OpenAI-compatible completions | `unsupported` | NVIDIA's catalogs still advertised K2.6 while the [live Kimi compatibility job](https://github.com/NVIDIA/NemoClaw/actions/runs/28953873907/job/85907646487) failed route validation with HTTP 404. | The OpenClaw setup manifest remains for existing or custom compatible routes that still serve K2.6. | Select a supported NVIDIA Endpoints model; do not promote K2.7 until its production model ID and chat route are live. | `nemoclaw-blueprint/model-specific-setup/openclaw/kimi-k2.6-managed-inference.json`. |
| OpenClaw primary agent | NVIDIA Endpoints (retired route) | `deepseek-ai/deepseek-v4-pro` | Managed `inference.local` OpenAI-compatible completions | `unsupported` | The featured-model feed still listed this model after the NVIDIA Endpoints model catalog removed it. NemoClaw excludes it from featured selections. | The retirement exclusion applies to NVIDIA Endpoints featured selections. It does not determine whether another compatible endpoint serves the same model ID. | Select a supported NVIDIA Endpoints model. | `src/lib/inference/nvidia-featured-models.ts`, `src/lib/inference/nvidia-featured-models.test.ts`. |
| OpenClaw primary agent | NVIDIA Endpoints | Any model from `CLOUD_MODEL_OPTIONS` | Managed `inference.local` OpenAI-compatible completions unless config selects another API. | `not-yet-run` | Add one evidence row per model before changing state. | Record `none`, model-specific setup, or provider-class transport behavior. | Expand into per-model rows as evidence lands. | `src/lib/inference/config.ts`. |
| OpenClaw primary agent | OpenAI | Any model from `REMOTE_MODEL_OPTIONS.openai` | `openai` provider through `https://inference.local/v1`. | `not-yet-run` | Add one evidence row per model before changing state. | Record Responses or Chat Completions behavior explicitly. | Expand into per-model rows as evidence lands. | `src/lib/inference/model-prompts.ts`, `src/lib/inference/config.ts`. |
| OpenClaw primary agent | Anthropic | Any model from `REMOTE_MODEL_OPTIONS.anthropic` | `anthropic` provider through `https://inference.local` with `anthropic-messages`. | `not-yet-run` | Add one evidence row per model before changing state. | Record native Anthropic Messages behavior explicitly. | Expand into per-model rows as evidence lands. | `src/lib/inference/model-prompts.ts`, `src/lib/inference/config.ts`. |
Expand Down
6 changes: 5 additions & 1 deletion docs/inference/set-up-vllm.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,10 @@ On generic hosts, the entry includes an experimental label.
N1x does not offer the existing-server entry; it offers only the managed **Install vLLM** or **Start vLLM** entry with the **Deferred preview** label.
NemoClaw validates the detected endpoint and records the model reported by `/v1/models`.

When you request a vLLM serving profile, the detected server must report the profile's served model alias or a safe `root` that matches the profile's declared model.
NemoClaw stops onboarding when neither identifier matches, rather than recording a route that the profile does not declare.
Stop the server and rerun the original command, or unset `NEMOCLAW_SERVING_PRESET` and `NEMOCLAW_PROVIDER` before you start fresh onboarding to keep the detected model.

On hosts other than N1x, when an install request encounters an already-running server, NemoClaw selects that server instead of starting another container.
On N1x, explicit managed-preview intent never reuses an already-running server.
Stop the server, then rerun managed onboarding.
Expand Down Expand Up @@ -122,7 +126,7 @@ The same profile selector works with interactive and non-interactive onboarding.
NemoClaw selects the inference provider required by the profile's backend, so onboarding does not show the provider menu.
If the profile's backend has no corresponding inference provider, onboarding exits before it changes runtime resources.
NemoClaw rejects unknown, ambiguous, disabled, incompatible, or conflicting selections before image or model downloads begin.
Before confirmation, the review screen shows the resolved profile and recipe IDs, model, immutable runtime image, support state, and estimated image and model downloads.
Before confirmation, the review screen shows the resolved profile and recipe IDs, declared model, served model alias, immutable runtime image, support state, and estimated image and model downloads.
Do not combine `--profile` with `NEMOCLAW_PROVIDER`, `NEMOCLAW_MODEL`, `NEMOCLAW_VLLM_MODEL`, `NEMOCLAW_MANAGED_CLUSTER_PEERS`, or `NEMOCLAW_VLLM_EXTRA_ARGS_JSON` overrides.
If `NEMOCLAW_SERVING_PRESET` is already set, it must select the same stable profile ID; a different ID conflicts with `--profile`.

Expand Down
3 changes: 3 additions & 0 deletions docs/inference/switch-providers.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,9 @@ $$nemoclaw <name> shields up
For OpenClaw, NemoClaw updates the provider namespace and selected model in the running configuration.
Changes within the current API family hot-reload without replacing the gateway process.
When the API family changes, NemoClaw commits the route and configuration, then restarts only the OpenClaw gateway and verifies its health.
After every changed synchronized route, NemoClaw verifies that the local CLI device has the managed gateway's required pairing scopes before it reports success.
If pairing does not converge, the route and configuration remain committed.
Run `$$nemoclaw <name> doctor --fix`, then retry the agent turn.

</AgentOnly>

Expand Down
10 changes: 9 additions & 1 deletion docs/reference/commands.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,9 @@ If `NEMOCLAW_SERVING_PRESET` is already set, it must select the same stable prof
Run `$$nemoclaw profiles list` to inspect an incompatibility reason before onboarding.

If you omit `--profile`, onboarding uses the same provider and model defaults as an installation without this feature.
The onboarding review screen identifies the resolved profile, recipe, model, runtime image, support state, and download estimates before confirmation.
The onboarding review screen identifies the resolved profile, recipe, declared model, served model alias, runtime image, support state, and download estimates before confirmation.
When onboarding reuses a running vLLM server, its `/v1/models` response must match the requested profile's served alias or declared model root.
Otherwise, onboarding stops before it records a route that the profile does not declare.
After creation, human status shows the profile, recipe, and catalog digest; JSON status includes the complete secret-free `servingProfileProvenance` record for diagnostics and automation.

#### `--host-mount`
Expand Down Expand Up @@ -4149,6 +4151,9 @@ Same-API-family changes hot-reload without replacing the gateway process.
When the API family changes, NemoClaw commits the config and integrity hash, then uses the managed supervisor to restart only the OpenClaw gateway and verify its health and forwards.
The sandbox remains running, but agent requests are briefly interrupted.
If the restart fails, the route and config remain committed; run `$$nemoclaw <name> gateway restart` to finish applying the switch.
After every changed synchronized route, NemoClaw also verifies that the local CLI device has the managed gateway's required pairing scopes before it reports success.
If pairing does not converge, the route and config remain committed.
Run `$$nemoclaw <name> doctor --fix`, then retry the agent turn.

</AgentOnly>
<AgentOnly variant="hermes">
Expand Down Expand Up @@ -4690,6 +4695,9 @@ The JSON diagnostic with `"event":"voice_gateway"` and `"state":"listening"` con

The runtime must keep the raw session grant in process memory.
NemoClaw keeps only the digest needed for constant-time grant validation.
Sequential sessions for the same runtime conversation reuse the same internal OpenClaw context.
A different runtime conversation, runtime identity, runtime profile, sandbox, or agent uses a separate context.
NemoClaw derives the internal context key without exposing the raw runtime conversation ID.
When the session closes or expires, the runtime must discard the raw grant, and NemoClaw removes its validation digest from active session state.
The process owns the OpenClaw session binding, turn state, and response correlation.
It clears that state when the session closes or expires and when the foreground process stops.
Expand Down
Loading