Skip to content

docs(skill): document context_length auto-detection resolution chain - #49483

Closed
Railway9784 wants to merge 1 commit into
NousResearch:mainfrom
Railway9784:docs/skill-context-length-fix
Closed

Railway9784 wants to merge 1 commit into
NousResearch:mainfrom
Railway9784:docs/skill-context-length-fix

Conversation

@Railway9784

Copy link
Copy Markdown
Contributor

When model.context_length is set in config.yaml, it blocks auto-detection from the server's /v1/models endpoint. The skill incorrectly implied a hard fallback to 131072. Add the resolution chain and the fix command (hermes config set model.context_length "") to both the config table and a new troubleshooting section.

What does this PR do?

The bundled hermes-agent skill's config table and troubleshooting
section don't explain that model.context_length blocks auto-detection
from the server's /v1/models endpoint, or how to restore it.

Hermes uses a 4-step resolution chain:

  1. model.context_length in config.yaml (blocking if set)
  2. Custom provider per-model
  3. Persistent cache
  4. /v1/models auto-detect

Two changes:

  • Config table: note that clearing the key enables auto-detect
  • New troubleshooting section: resolution chain + hermes config set model.context_length "" fix

Real-world case: user had -c 262144 but Hermes showed 128k because a stale config value survived from a previous setup.

When model.context_length is set in config.yaml, it blocks auto-detection
from the server's /v1/models endpoint. The skill incorrectly implied a
hard fallback to 131072. Add the resolution chain and the fix command
(hermes config set model.context_length "") to both the config table
and a new troubleshooting section.
@alt-glitch alt-glitch added type/docs Documentation improvements P3 Low — cosmetic, nice to have labels Jun 20, 2026
@teknium1

Copy link
Copy Markdown
Collaborator

Merged via PR #49914 (docs salvage cluster). Your commit was cherry-picked onto current main with your authorship preserved in git log — merged with rebase so it lands under your name. Thanks for the contribution!

@teknium1 teknium1 closed this Jun 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

P3 Low — cosmetic, nice to have type/docs Documentation improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants