Conversation
ba7dc21 to
d8ee6dd
Compare
|
Thanks for the focused fixes. Both target behaviors are still present on current main, but the combined change needs separation and the SimpleX repair is incomplete. Problems
Suggested changes
Automated hermes-sweeper review. |
d8ee6dd to
51cd273
Compare
|
Thanks for the review. Scope is now split:
Verified: |
…rch#66959) Weaker models routed via aggregators skip skill_view() when the QQ hint lacks explicit agent-identity framing, relying only on the short skill description. Mirror the CLI hint's 'AI Agent' framing and remind the model to load skill bodies via skill_view. - agent/prompt_builder.py: qqbot hint frames the model as an agent and references skills. - tests/agent/test_prompt_builder.py: substring assertion on PLATFORM_HINTS. - tests/agent/test_system_prompt.py: exercises the real hint-insertion path (build_system_prompt_parts) for platform='qqbot'. Closes NousResearch#66959
51cd273 to
e64b326
Compare
SummaryOne PR, #66976, directly addresses issue #66959 by adding QQ-specific AI-agent and skill-loading guidance to the platform hint, with tests for both the hint content and its insertion into the assembled system prompt. The diff implements the reported prompt-surface change, while the contributor discussion states that the claimed weaker-model behavioral effect still needs reproduction. Related pull requests
DuplicatesNo listed PR duplicates #66976; #63633 is a related but distinct volatile-system-prompt approach, and the unrelated SimpleX work was split into #66969. Suggested consolidationKeep #66976 open with a salvage path focused on its QQ platform-hint change and assembled-system-prompt regression test. Ask the author to provide a reproducible comparison demonstrating the claimed weaker-model skill_view() behavior; there are no listed duplicate PRs to close. Complex graphflowchart LR
classDef open fill:#dbeafe,stroke:#1d4ed8,color:#1e3a8a
classDef merged fill:#dcfce7,stroke:#15803d,color:#14532d
classDef closed fill:#e5e7eb,stroke:#6b7280,color:#1f2937
classDef unverified fill:#f3f4f6,stroke:#9ca3af,color:#374151
classDef best stroke-width:3px,stroke:#b45309
classDef target stroke-width:3px,stroke:#4338ca
I66959(["issue #66959 (open)"])
P66976["PR #66976 (open)"]
P66976 -->|best fix| I66959
class I66959 open
class P66976 open
class P66976 best
class P66976 target
click I66959 "https://github.com/NousResearch/hermes-agent/issues/66959"
click P66976 "https://github.com/NousResearch/hermes-agent/pull/66976"
Graph: solid arrow = fixes / best fix, dashed arrow = partial or unverified (see edge label); boxed group = PRs duplicating each other; amber border = best fix; indigo border = target; gray node = closed (state tag in the node label). Cross-PR triage: Reviewed 1 pull request and 1 issue in this complex. Each diff was read against this issue; Assessment working set: 3 kB of PR diffs, 3 kB of issue/PR text, 2 kB of discussion (5 comments), 2 verify verdicts. verdicts reflect diff content, not PR titles. Part of an automated triage batch. |
Summary
Fixes #66959 — the QQ bot adapter works, but
PLATFORM_HINTS["qqbot"]lacked explicit agent-identity framing. Weaker/free models routed via OmniRoute-style aggregators then skipskill_view()and rely only on the short<available_skills>description, e.g. failing to know the default transaction account.Mirror the CLI hint (
You are a CLI AI Agent) by leading the QQ hint withYou are a QQ AI Agentand reminding the model to load skill bodies viaskill_view.Changes
agent/prompt_builder.py: qqbot hint now frames the model as an agent and references skills.tests/agent/test_prompt_builder.py: addedtest_qqbot_hint_frames_agent_identity.Validation
python3 -m pytest tests/agent/test_prompt_builder.py→ 165 passed (the 2 unrelated failures —test_excludes_disabled_skills,test_walks_parents_inside_git_repo— also fail on clean upstreammainand are pre-existing/ordering-related, not introduced by this change).Closes #66959.