Skip to content

fix(agents): merge separate --provider/-m flags into combined form - #7434

Merged
apurvvkumaria merged 4 commits into
NVIDIA:mainfrom
kagura-agent:fix/hermes-wrapper-merge-provider-flags
Jul 25, 2026
Merged

fix(agents): merge separate --provider/-m flags into combined form#7434
apurvvkumaria merged 4 commits into
NVIDIA:mainfrom
kagura-agent:fix/hermes-wrapper-merge-provider-flags

Conversation

@kagura-agent

@kagura-agent kagura-agent commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Summary

When hermes is invoked with separate --provider <name> and -m <model> flags, the CLI reads the provider's API key directly from .env. For OpenShell-registered providers, .env stores openshell:resolve:env:VAR_NAME placeholder strings that require proxy routing to substitute the real credential. The raw placeholder passes through mask_secret() and the masked output is sent as the literal bearer token → 401.

The combined form -m provider/model works correctly because it routes through the OpenShell proxy rewrite path.

Fix

Add _merge_provider_into_model(argv) to the Hermes wrapper (agents/hermes/hermes-wrapper.py) that translates separate --provider + -m/--model flags into the combined provider/model form before exec. This follows the same pattern as the existing _translate_resumed_oneshot() compatibility layer.

Behavior:

  • Both flags present, model has no / → merge into combined form
  • Model already contains / → unchanged (already combined)
  • Only one flag present → unchanged (fail-closed)
  • Empty values or duplicates → unchanged (fail-closed)

Supports space-separated (--provider foo -m bar) and equals forms (--provider=foo --model=bar).

Testing

The Linux-gated wrapper suite now contains 12 cases covering the intended merge, equals and reordered forms, already-combined and single-flag inputs, empty values, duplicate provider and mixed duplicate model flags, and the -- boundary. The existing live Hermes inference-switch target now invokes separate --provider and --model flags for its final PONG, so a credentialed run proves the wrapper keeps that invocation on the switched route. The Dockerfile source-to-image digest contract passes, and direct Python validation passed the intended merge plus both duplicate fail-closed cases.

Relates to #7361 (partial fix — argv normalization only, transport issue remains open)

Type of Change

  • Code change (bug fix)

Quality Gates

  • Tests added or updated for changed behavior
  • Docs not applicable — this transparent argv normalization adds no supported command, flag, configuration, or protocol.
  • Sensitive paths changed (credentials and sandbox wrapper)
  • Sensitive-path review completed — argv is passed through execv without shell evaluation, ambiguous inputs remain unchanged, no credential values are logged, and the reviewed wrapper digest is pinned.

Documentation Writer Review

  • Documentation writer subagent reviewed the completed changes
  • Result: no-docs-needed
  • Evidence: Canonical docs expose nemohermes inference set, not direct Hermes flag parsing; the exact-head review confirmed existing docs remain accurate. The wrapper digest contract, direct Python cases, 25 E2E-support assertions, semantic-phase and project-membership checks, CLI/plugin builds, CLI type-checking, and normal hooks passed. The credentialed live target is checked in but was not executed locally because credential and Brev authentication were unavailable.
  • Agent: Codex Desktop

Verification

  • PR description includes a Signed-off-by: line and every commit appears as Verified in GitHub
  • Normal pre-commit, commit-msg, and pre-push hooks passed
  • Focused digest and direct wrapper behavior checks passed
  • Durable split-flag credential-path coverage is wired into hermes-inference-switch; 25 E2E-support assertions and phase/project checks pass
  • Quality gates are complete and no secrets or credentials were committed

Signed-off-by: kagura-agent kagura.agent.ai@gmail.com

Summary by CodeRabbit

  • Bug Fixes

    • Improved Hermes CLI handling by merging separate --provider and -m/--model inputs into a single provider/model value when required.
    • Supports both --flag=value and --flag value, preserves provider/model values that already include /, and keeps ---delimited arguments unchanged.
    • Safely avoids rewriting on ambiguous or empty inputs, as well as when flags appear only after --.
  • Tests

    • Added integration tests covering flag ordering, equals-form flags, and -- pass-through behavior.

Advisor infrastructure waiver

The secondary Nemotron advisor timed out during analysis. Its partial one-shot flag hypothesis was checked against the pinned Hermes v0.18.0 parser and one-shot implementation: top-level model and provider flags are explicitly supported with one-shot mode, and the exact live-test argv normalizes to the combined provider/model form. The primary Terra advisor passed, the secondary ledger contains no finding, and no review thread is unresolved. Maintainer review accepts this as an advisor infrastructure timeout, not a code failure.

@copy-pr-bot

copy-pr-bot Bot commented Jul 23, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@coderabbitai

coderabbitai Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

The Hermes wrapper merges separate provider and model arguments into provider/model before execution, preserving ambiguous, incomplete, empty, already combined, and post--- inputs. Integration tests cover supported argument forms and pass-through cases.

Changes

Hermes provider/model merge

Layer / File(s) Summary
Provider/model rewrite and validation
agents/hermes/hermes-wrapper.py, test/hermes-wrapper-provider-merge.test.ts
Adds fail-closed parsing and rewriting for separate provider/model flags, applies the rewrite before os.execv, and tests merged, combined, incomplete, reordered, empty, equals-style, and -- separator arguments.

Estimated code review effort: 3 (Moderate) | ~20 minutes

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 66.67% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and accurately summarizes the main change: merging separate provider and model flags into the combined form.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@agents/hermes/hermes-wrapper.py`:
- Around line 473-475: Stop argv rewriting at the end-of-options delimiter in
the loop near arg processing: when arg is “--”, return the original argv
immediately so all following tokens remain opaque and unchanged. In
test/hermes-wrapper-provider-merge.test.ts lines 22-93, add an integration
assertion covering provider/model-looking arguments after “--” and verify they
are preserved exactly.

In `@test/hermes-wrapper-provider-merge.test.ts`:
- Around line 22-28: Move the CI prerequisite assertion out of the skipped suite
so it executes before describe.skipIf evaluates the suite. Ensure CI fails when
canRun is false, while retaining the conditional skip behavior for non-CI
environments in the hermes-wrapper provider/model merge test suite.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: d3b53fb9-6200-4911-991b-8e5c96fe3ed3

📥 Commits

Reviewing files that changed from the base of the PR and between 21e60ae and 45e6dc0.

📒 Files selected for processing (2)
  • agents/hermes/hermes-wrapper.py
  • test/hermes-wrapper-provider-merge.test.ts

Comment thread agents/hermes/hermes-wrapper.py
Comment thread test/hermes-wrapper-provider-merge.test.ts Outdated
@github-actions

github-actions Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

PR Review Advisor — Blocking findings reported

Advisor assessment: Blockers require maintainer review
Next action: Review the blockers below.
Findings: 1 blocker · 0 warnings · 0 suggestions

Model lanes

  • GPT-5.6 Terra (primary): Completed · high confidence · 1 blocker · 0 warnings · 0 suggestions
  • Nemotron 3 Ultra (second opinion): Failed

Nemotron output stays in workflow artifacts and does not change the assessment above.

E2E guidance

Advisory only. E2E / PR Gate selects and runs jobs independently.

Recommended E2E: cloud-onboard, credential-sanitization, full-e2e, hermes-e2e, security-posture, hermes-inference-switch, inference-routing, network-policy

Blockers

PRA-1 Blocker — Do not rewrite provider flags after a subcommand

  • Location: agents/hermes/hermes-wrapper.py:476
  • Category: correctness
  • Problem: The merge parser continues after positional arguments and rewrites later --provider and -m/--model flags. A Hermes subcommand can therefore receive different arguments, although the wrapper states that non-intercepted subcommands pass through unchanged.
  • Impact: A subcommand that uses these option names can receive a provider/model selection it did not request. This changes CLI behavior outside the top-level invocation that needs proxy routing.
  • Fix: Stop parsing at the first positional argument. Rewrite only top-level provider and model options before that boundary.
  • Verification: Use the wrapper harness with an argv such as ["chat", "--provider", "p", "-m", "m"] and confirm hermes.real receives the original argv.
  • Test coverage: Add a harness test that a positional subcommand followed by separate --provider and -m/--model flags passes through unchanged.
  • Evidence: agents/hermes/hermes-wrapper.py:476-530 scans all argv entries until -- and has no positional-command boundary. agents/hermes/hermes-wrapper.py:104-105 states that non-intercepted Hermes subcommands pass through unchanged. agents/hermes/hermes-wrapper.py:435 returns None when _translate_resumed_oneshot encounters a positional command, but main then invokes _merge_provider_into_model on that original argv.

Workflow run details

This automated review informs maintainers. Warnings and suggestions do not require a response. A maintainer decides whether to merge.

@wscurran wscurran added area: cli Command line interface, flags, terminal UX, or output bug-fix PR fixes a bug or regression integration: hermes Hermes integration behavior labels Jul 23, 2026
@wscurran

Copy link
Copy Markdown
Contributor

✨ Thanks for the fix. This resolves the credential resolution issue where separate --provider/-m flags sent masked placeholder strings as literal API keys. Maintainers will review the flag merging logic and Hermes wrapper changes.


Related open issues:

@kagura-agent

Copy link
Copy Markdown
Contributor Author

Pushed fix for remaining CodeRabbit finding:

CI prerequisite assertion (minor): Moved the assert(canRun, ...) out of the describe.skipIf block to module scope, so it fires unconditionally in CI. If Linux + python3 aren't available, the test file now fails immediately instead of silently skipping.

The major finding (post--- preservation) was already addressed in 7904ed0.

@kagura-agent
kagura-agent force-pushed the fix/hermes-wrapper-merge-provider-flags branch from 13c441b to 1a664ca Compare July 24, 2026 02:18
@kagura-agent

Copy link
Copy Markdown
Contributor Author

Rebased onto latest main and squashed into a single commit. Fixed the codebase-growth-guardrails failure:

test-conditionals violation: Removed the top-level if (process.env.CI) assertion block — the describe.skipIf(!canRun) already handles skipping when prerequisites are missing.

The assert import is also removed (no longer needed).

@kagura-agent
kagura-agent force-pushed the fix/hermes-wrapper-merge-provider-flags branch from 1a664ca to 672dd6f Compare July 24, 2026 12:11
@kagura-agent

Copy link
Copy Markdown
Contributor Author

Fixed -- sentinel handling: previously, encountering -- aborted the entire merge even when both --provider and -m appeared before it. Now the parser breaks on -- and merges already-collected flags. Added a test for flags appearing only after -- (should pass through unchanged).

@prekshivyas prekshivyas self-assigned this Jul 25, 2026

@prekshivyas prekshivyas left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed at 7257574. Argument rewriting is fail-closed for ambiguous input, uses execv without shell evaluation, logs no credentials, and pins the reviewed wrapper digest. Duplicate-flag coverage passes. The credential-path E2E warning remains independently enforced by the required gate.

Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com>

@prekshivyas prekshivyas left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed at a0af57c. The wrapper remains fail-closed for ambiguous arguments and uses execv without shell evaluation. The Hermes inference-switch live target now invokes separate provider/model flags, so future credentialed runs directly cover the rewritten route. E2E support, phase, project-membership, digest, and hook checks pass; the credentialed target remains independently gated.

@apurvvkumaria
apurvvkumaria merged commit d681222 into NVIDIA:main Jul 25, 2026
105 of 113 checks passed
@cv cv mentioned this pull request Jul 26, 2026
23 tasks
apurvvkumaria pushed a commit that referenced this pull request Jul 27, 2026
<!-- markdownlint-disable MD041 -->
## Summary

Add the canonical `docs/changelog/2026-07-25.mdx` release entry with the
exact `## v0.0.96` heading.
The entry reconciles all 90 first-parent commits since v0.0.95 with all
92 merged PRs in the live `v0.0.96` label ledger and groups the
user-visible changes by operator journey.

## Changes

- Add the parser-safe dated MDX changelog entry for v0.0.96 with
root-absolute links to the focused user guides.
- Source summary:
- [#7194](#7194) ->
`docs/changelog/2026-07-25.mdx`: Document persistent baseline network
policy exclusions and their inspection, rebuild, and snapshot behavior.
- [#7188](#7188),
[#7427](#7427), and
[#7546](#7546) ->
`docs/changelog/2026-07-25.mdx`: Document DNS-backed HTTPS inference
routing, keyless loopback endpoints, and provider-marker isolation.
- [#7238](#7238) ->
`docs/changelog/2026-07-25.mdx`: Document blueprint sandbox and provider
identifier validation before state writes or OpenShell calls, with
bounded terminal-safe rejection previews.
- [#7319](#7319),
[#7274](#7274),
[#7528](#7528),
[#7353](#7353), and
[#7560](#7560) ->
`docs/changelog/2026-07-25.mdx`: Document the managed default gateway
service, onboarding readiness, and container-runtime identity
safeguards.
- [#7349](#7349),
[#7498](#7498),
[#7406](#7406),
[#7196](#7196),
[#7559](#7559),
[#7421](#7421),
[#7510](#7510),
[#7295](#7295), and
[#7565](#7565) ->
`docs/changelog/2026-07-25.mdx`: Document gateway-scoped status,
lifecycle diagnostics, managed MCP recovery, delete-edge safeguards, and
fail-closed CLI prompt and command output.
- [#7591](#7591) ->
`docs/changelog/2026-07-25.mdx`: Document opt-in authenticated MCP
tool-name discovery, its bounded and names-only contract, probe
interaction, and rebuild requirement.
- [#7305](#7305),
[#7480](#7480),
[#7471](#7471),
[#7365](#7365), and
[#7541](#7541) ->
`docs/changelog/2026-07-25.mdx`: Document installer version checks,
version-tag reporting, license guidance, WSL Ollama selection, and DGX
Station vLLM detection.
- [#7482](#7482),
[#7466](#7466),
[#7208](#7208),
[#7434](#7434), and
[#7586](#7586) ->
`docs/changelog/2026-07-25.mdx`: Document Ollama resource details,
reasoning precedence, Hermes onboarding behavior, and preserved managed
Hermes BuildKit failures.

- [#6830](#6830),
[#7492](#7492),
[#7563](#7563), and
[#7582](#7582) ->
`docs/changelog/2026-07-25.mdx`: Document the authoritative OpenClaw
production lock, fixed managed-image dependencies, immutable Hermes base
adoption, and Hermes image-size reduction.
- [#7505](#7505),
[#7530](#7530),
[#7547](#7547),
[#7508](#7508),
[#7548](#7548),
[#7549](#7549),
[#7537](#7537),
[#7534](#7534),
[#7515](#7515),
[#7511](#7511),
[#7551](#7551),
[#7562](#7562),
[#7575](#7575),
[#7496](#7496),
[#7594](#7594),
[#7595](#7595), and
[#7599](#7599) ->
`docs/changelog/2026-07-25.mdx`: Summarize release validation, transient
and bounded dispatch reconciliation, exact pre-tag qualification,
identity revalidation, npm-audit retry, sharding, image reuse, timeout,
telemetry, and workflow-hardening changes.
- Reconciled without separate changelog prose:
- [#7539](#7539),
[#7526](#7526),
[#7507](#7507),
[#7506](#7506),
[#7519](#7519),
[#7516](#7516),
[#7396](#7396),
[#7254](#7254),
[#7583](#7583),
[#7596](#7596), and
[#7598](#7598): Test-harness or
fixture-only changes.
- [#7403](#7403),
[#7161](#7161),
[#6877](#6877),
[#7531](#7531),
[#7525](#7525),
[#7522](#7522),
[#7536](#7536),
[#7552](#7552),
[#7566](#7566),
[#7553](#7553),
[#7561](#7561),
[#7577](#7577),
[#7569](#7569),
[#7585](#7585),
[#7584](#7584),
[#7592](#7592),
[#7580](#7580),
[#7571](#7571),
[#7517](#7517),
[#7589](#7589),
[#7402](#7402),
[#7558](#7558),
[#7544](#7544), and
[#7601](#7601): Dependency,
internal recovery, validation, contributor-workflow, E2E optimization,
telemetry, or CI trust changes with no separate user-facing release
claim.
- [#7556](#7556),
[#7573](#7573),
[#7576](#7576), and
[#7578](#7578): Experimental
repository-maintainer conflict automation with no canonical user
documentation surface.

## Type of Change

- [ ] Code change (feature, bug fix, or refactor)
- [ ] Code change with doc updates
- [x] Doc only (prose changes, no code sample modifications)
- [ ] Doc only (includes code sample changes)

## Quality Gates

- [ ] Tests added or updated for changed behavior
- [x] Existing tests cover changed behavior — justification:
`test/changelog-docs.test.ts` validates dated changelog structure,
version headings, and published links.
- [ ] Tests not applicable — justification:
- [x] Docs updated for user-facing behavior changes
- [ ] Docs not applicable — justification:
- [ ] Sensitive paths changed (security, policy, credentials, preflight,
onboarding, inference, runner, sandbox, or messaging)
- [ ] Sensitive-path review completed or maintainer-approved waiver
recorded — reviewer/approval link/justification:
- [ ] Non-success, skipped, or missing CI check accepted by maintainer —
check name, approval link, and follow-up issue:

## Documentation Writer Review

- [x] Documentation writer subagent reviewed the completed changes
- Result: `docs-updated`
- Evidence: Reviewed `docs/changelog/2026-07-25.mdx` at exact head
`0f5dedb47` against 90 first-parent release commits and 92 merged PRs
labeled `v0.0.96`. Verified parser-safe MDX SPDX, the exact version
heading, literal CLI names, writing style, skip terms, all 20
root-absolute published links, and the accepted #7591 opt-in
authenticated discovery bounds. #7544, #7599, and #7601 remain internal
or CI-only release-ledger entries. Changelog tests passed 6/6, the docs
build passed with 0 errors and two pre-existing Fern warnings, and `npm
run check:diff` plus the final diff check passed.
- Agent: Codex Desktop documentation-writer subagent
<!-- docs-review-head-sha: 0f5dedb -->
<!-- docs-review-agents-blob-sha: be20a09 -->

## DGX Station Hardware Evidence

- [ ] Tested on DGX Station
- Tested commit:
- Station profile/scenario:
- Result:
- Supporting evidence:

## Verification

- [x] PR description includes a `Signed-off-by:` line and every commit
appears as `Verified` in GitHub
- [x] Normal `pre-commit`, `commit-msg`, and `pre-push` hooks passed, or
`npm run check:diff` passed when hooks were skipped or unavailable
- [x] Targeted behavior tests pass for the current change set, or tests
are marked not applicable above — `npx vitest run
test/changelog-docs.test.ts`: 6/6 passed.
- [ ] Applicable broad gate passed — `npm test` for broad
runtime/test-harness changes; `npm run check` for repo-wide
validation/coverage changes — command/result: Not applicable to this
prose-only changelog entry.
- [x] Quality Gates section completed with required justifications or
waivers
- [x] No secrets, API keys, or credentials committed
- [ ] `npm run docs` builds without warnings (doc changes only) — the
build passed with 0 errors and 2 existing Fern warnings; the
published-route check passed.
- [x] Doc pages follow the [style
guide](https://github.com/NVIDIA/NemoClaw/blob/main/docs/CONTRIBUTING.md)
(doc changes only)
- [ ] New doc pages include SPDX header and frontmatter (new pages only)
— native changelog files use the required parser-safe MDX SPDX comment
and no frontmatter.

---
Signed-off-by: Carlos Villela <cvillela@nvidia.com>


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **New Features**
* Persistent network policy exclusions with consistent restore/exclusion
reporting across rebuilds/snapshots.
* Opt-in MCP tool discovery via `mcp status --tools` with bounded,
redacted authenticated traffic.
* Improved HTTPS inference switching for custom endpoints and refreshed
onboarding/model menu details.
* Refined OpenShell gateway defaults for port `8080`, including more
reliable readiness checks.
* **Bug Fixes**
* Prevent incorrect provider/model restoration after compatible-provider
update failures.
* Preserve managed MCP state after exec loss and tighten gateway/doctor
status scoping.
* **Tests**
* Stronger, fail-closed release validation with hardened
evidence/artifact handoff and bounded timeouts/retries.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com>
Co-authored-by: Prekshi Vyas <prekshiv@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: cli Command line interface, flags, terminal UX, or output bug-fix PR fixes a bug or regression integration: hermes Hermes integration behavior

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants