Skip to content

docs: multi-host computer_use design (blocked on Cua paired hosts) - #71160

Open
skyzea1 wants to merge 1 commit into
NousResearch:mainfrom
skyzea1:docs/71157-multi-host-computer-use-design
Open

skyzea1 wants to merge 1 commit into
NousResearch:mainfrom
skyzea1:docs/71157-multi-host-computer-use-design

Conversation

@skyzea1

@skyzea1 skyzea1 commented Jul 25, 2026

Copy link
Copy Markdown

Summary

  • Add docs/design/71157-multi-host-computer-use.md — Hermes as thin consumer of Cua paired multi-host Driver
  • Document current one machine per process limitation in computer-use user docs, with workaround + links
  • No runtime / tool schema change in this PR (cannot implement remote host attach until Cua ships protocol)

Why docs PR (not implementation)

Remote desktop control protocol + pairing must live in trycua/cua. Implementing Hermes-only remote click would be the wrong layer and likely rejected.

Upstream:

Hermes tracking: #71157

Related (orthogonal)

Test plan

  • Docs-only; no code paths changed
  • Docs preview / link check as CI requires
  • Maintainer: confirm design note location (docs/design/) is acceptable

Ask

If Cua accepts paired multi-host Driver, is a follow-up default-off consumer implementation PR welcome under existing computer_use (host arg / session pin + approvals), without a new core tool?

Add design note for routing computer_use across paired Cua Driver hosts
and document the current single-machine limitation with links to
NousResearch#71157 and upstream trycua/cua#2562 / PR NousResearch#2563.

No runtime behavior change — design + docs only.
@alt-glitch alt-glitch added type/docs Documentation improvements P3 Low — cosmetic, nice to have comp/tools Tool registry, model_tools, toolsets blocked Waiting on external dependency or decision labels Jul 25, 2026
@teknium1 teknium1 added the sweeper:blast-contained Sweeper blast radius: contained — one narrow path / opt-in / few users label Jul 30, 2026
@OutThisLife

Copy link
Copy Markdown
Contributor

Pointer for whenever the upstream block clears: #90380 adds a ComputerUseProvider ABC and registry, so multi-host computer use is now a provider question rather than a core-dispatcher one. A paired-host runtime registers through ctx.register_computer_use_provider() and is selected by computer_use.provider in config.yaml.

Worth a pass over the design doc against that seam before this unblocks — some of what it describes as needing core changes no longer does.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

blocked Waiting on external dependency or decision comp/tools Tool registry, model_tools, toolsets P3 Low — cosmetic, nice to have sweeper:blast-contained Sweeper blast radius: contained — one narrow path / opt-in / few users type/docs Documentation improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants