fix(honcho): warn about minimal reasoning_level's 250-token output cap - #59494
fix(honcho): warn about minimal reasoning_level's 250-token output cap#59494LavyaTandel wants to merge 2 commits into
Conversation
Duplicate of #59472 (earlier, same fix). Both edit the |
What: honcho_reasoning tool schema described minimal as 'fast/cheap' without mentioning its hard 250-token output cap. The model reliably chooses minimal for multi-fact synthesis queries, which then truncate mid-chain-of-thought before producing a final answer. Why: minimal's 250-token budget is shared between hidden reasoning tokens and visible output — any real synthesis exhausts it. The schema description gave no signal this would happen. Fix: Expand both the tool description and reasoning_level parameter description to document the 250-token cap and steer models to low+ for anything beyond single-fact lookups. Schema-string-only change; no behavioral code modified. Closes NousResearch#59470
8b633ce to
337a9b1
Compare
|
Thanks for the narrowly scoped schema update. Current main still exposes The member triage comment already identifies open PR #59472 as the earlier canonical implementation of the same mitigation. Its patch overlaps this PR at the same parameter description, so maintainers should reconcile the wording rather than apply both independently. Automated hermes-sweeper review. |
|
Superseded on main by #66052 (commit b170f52), which merged the earliest submission for #59470 — #59472 by @vizi0uz, submitted ~40 min before this one. The parameter-guide text on main now carries the 250-token minimal-cap warning your PR also added. Your top-level description tweak was a nice touch we may fold into a future polish pass. Thanks @LavyaTandel, sorry it collided with an earlier duplicate. |
What
Expanded the
reasoning_levelparameter description inREASONING_SCHEMAto documentminimal's hard 250-token output cap and steer models tolow+ for anything beyond single-fact lookups.Why
Honcho's
minimaldialectic tier hard-caps output at 250 tokens — intended for single fast factual lookups. On reasoning-capable models, hidden reasoning tokens share that budget, so synthesis queries truncate before producing a final answer. The schema gave no signal this would happen.Fix
Schema-string-only change in
plugins/memory/honcho/__init__.py:No behavioral code modified.
Runtime Proof
Before: model chose
minimalfor multi-fact query → truncated outputAfter: same query with updated schema → model chose
lowunprompted → complete answerDuplicate Scan
No existing PRs for #59470.
Closes #59470