Skip to content

feat(connections): balance new threads across connected machines - #9895

Merged
maria-rcks merged 12 commits into
pingdotgg:mainfrom
maria-rcks:t3code/connection-load-balancing
Sep 6, 2026
Merged

feat(connections): balance new threads across connected machines#9895
maria-rcks merged 12 commits into
pingdotgg:mainfrom
maria-rcks:t3code/connection-load-balancing

Conversation

@maria-rcks

@maria-rcks maria-rcks commented Sep 5, 2026

Copy link
Copy Markdown
Collaborator

When enabled in Connections, new threads in shared projects choose a connected machine using whole-host CPU and available memory, with per-machine choices (Prefer, Normal, Less often, or Manual only) in Connections. The composer calls this Auto balance and gives it a scales icon, without appending a machine name. Automatic routing is opt-in and defaults off in web/desktop, supports any number of machines, and keeps the selected machine stable; choosing a machine, branch, or worktree manually pins the draft. Existing threads and the native mobile app keep their current routing.

Auto balance defaults off for new settings and older settings that omit the field; saved choices are preserved. The opt-in revision passes scoped lint and 119 existing-file settings tests across contracts, web hydration, and desktop persistence. CI and both independent source reviews pass on 61423c5; no conflicts or unresolved review threads remain. Fresh visual evidence for the preference dropdowns remains blocked by preview capture failures; earlier interaction and persistence checks passed. Native macOS/Windows resource sampling remains unverified.

Before the name/icon refinement:

composer before the standalone auto balance name

After:

auto balance with a scales icon and no machine suffix

auto balance in the narrow dark composer

auto balance in the narrow light composer

Implemented with gpt-5.6-sol in Codex.


Note

Medium Risk
Changes default draft routing for multi-machine projects (load balancing defaults on) and adds host resource RPC sampling; wrong eligibility or stale metrics could send work to a busy machine or block send until override.

Overview
Adds automatic load balancing for new draft threads in multi-environment shared projects. Web/desktop clients can enable it under Settings → Connections, set per-machine preference weights (0 = manual only), and pick Auto balance in the composer to re-check resources or override with a specific machine.

The server exposes server.getHostResources, sampling whole-host CPU (200ms delta) and platform-specific available memory with a 5s shared cache. The client scores eligible connected machines (provider-ready, positive weight, not saturated) via chooseLoadBalancedEnvironment, then pins the draft’s loadBalancedEnvironmentId until the user chooses a machine, branch, or worktree manually. Send is blocked until settings hydrate and balancing finishes; attachments require staying on the current machine for auto routing.

Draft persistence gains environmentSelection (auto | manual) and clears balanced routing on project remaps. Existing threads and mobile stay on manual environment selection.

Reviewed by Cursor Bugbot for commit 93b7303. Bugbot is set up for automated code reviews on this repo. Configure here.

Note

Add automatic load balancing for new threads across connected machines

  • Adds a HostResources service that samples host CPU and memory capacity and exposes it over websocket RPC (serverGetHostResources).
  • Adds client settings for loadBalancingEnabled and per-environment loadBalancingWeights, configurable in the Connections settings UI.
  • Draft composers use the useLoadBalancedEnvironment hook and chooseLoadBalancedEnvironment selector to persist an automatic environment choice based on resource capacity and configured weights.
  • Risk: manual environment or branch changes mark the draft selection as manual in composerDraftStore.ts; project remapping clears the persisted load-balanced environment identifier.

Macroscope summarized 61423c5.

@github-actions github-actions Bot added vouch:trusted PR author is trusted by repo permissions or the VOUCHED list. size:XL 500-999 changed lines (additions + deletions). labels Sep 5, 2026
Comment thread apps/web/src/components/ChatView.tsx Outdated
Comment thread apps/web/src/components/ChatView.tsx
Comment thread apps/web/src/components/ChatView.tsx
Comment thread apps/server/src/resourceTelemetry/HostResources.ts Outdated
Comment thread apps/server/src/ws.ts Outdated
Comment thread apps/server/src/resourceTelemetry/HostResources.ts Outdated

@cursor cursor Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

Comment thread apps/web/src/components/BranchToolbarBranchSelector.tsx
Comment thread apps/server/src/resourceTelemetry/HostResources.ts Outdated
@macroscopeapp

macroscopeapp Bot commented Sep 5, 2026

Copy link
Copy Markdown
Contributor

Approvability

Verdict: Not approved

Macroscope's review found this PR not approvable — This PR adds a cross-cutting load-balancing workflow with new host telemetry, authenticated RPCs, persisted routing state, settings, and composer send-path behavior. The feature is opt-in, but its implementation is substantial and touches sensitive authorization code, so the changes warrant focused human review.

You can add or adjust custom eligibility rules. Learn more.

Comment thread apps/web/src/components/ChatView.tsx

@cursor cursor Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit d3eb4c3. Configure here.

Comment thread apps/server/src/resourceTelemetry/HostResources.ts Outdated
Comment thread apps/web/src/components/settings/LoadBalancingSettings.tsx Outdated
Comment thread apps/web/src/components/settings/LoadBalancingSettings.tsx
Comment thread apps/web/src/components/ChatView.tsx
Comment thread apps/web/src/components/GitActionsControl.tsx
@maria-rcks
maria-rcks merged commit 420fd76 into pingdotgg:main Sep 6, 2026
26 checks passed
github-actions Bot added a commit to omarcresp/t3code-flake that referenced this pull request Sep 6, 2026
## What's Changed
* fix(web): keep timestamp tooltip dates in English by @Lucenx9 in pingdotgg/t3code#10256
* fix(web): let authorized clients scrolling reach settings by @flamboh in pingdotgg/t3code#10080
* fix(web): remember usage page selection by @extoci in pingdotgg/t3code#10189
* fix(server): keep the Antigravity Google sign-in across server restarts by @t3dotgg in pingdotgg/t3code#10244
* fix(antigravity): load user skills from ~/.gemini for every project by @t3dotgg in pingdotgg/t3code#10257
* fix(web): respect reduced motion in shared disclosures by @saphid in pingdotgg/t3code#10258
* feat(marketing): add a Windows 95 landing page by @t3dotgg in pingdotgg/t3code#10286
* refactor(web): remove unused runtime wrappers and exports by @juliusmarminge in pingdotgg/t3code#10225
* refactor(web): keep feature component helpers private by @juliusmarminge in pingdotgg/t3code#10226
* refactor(web): keep app utilities private and remove dead helpers by @juliusmarminge in pingdotgg/t3code#10227
* ci: enforce unused runtime exports in the web app by @juliusmarminge in pingdotgg/t3code#10228
* test(desktop): cover Clerk setup through the service by @juliusmarminge in pingdotgg/t3code#10284
* test(desktop): cover WSL hashes through runtime resolution by @juliusmarminge in pingdotgg/t3code#10285
* test(desktop): cover password store through startup by @juliusmarminge in pingdotgg/t3code#10287
* test(desktop): cover WSL paths through public behavior by @juliusmarminge in pingdotgg/t3code#10289
* test(desktop): exercise WSL cache safety through public scripts by @juliusmarminge in pingdotgg/t3code#10301
* test(web): cover file classification through diff ordering by @juliusmarminge in pingdotgg/t3code#10304
* test(web): focus command palette tests on search behavior by @juliusmarminge in pingdotgg/t3code#10302
* fix(web): add project settings to legacy sidebar project menu by @hwanseoc in pingdotgg/t3code#10021
* test(web): keep Markdown gutter styling private by @juliusmarminge in pingdotgg/t3code#10306
* feat(settings): add shared project defaults and scoped overrides by @maria-rcks in pingdotgg/t3code#9754
* feat(connections): balance new threads across connected machines by @maria-rcks in pingdotgg/t3code#9895
* test(web): keep settings viewport comparison private by @juliusmarminge in pingdotgg/t3code#10307
* fix(web): prevent file tree search focus ring clipping by @GuilhermeVieiraDev in pingdotgg/t3code#10175
* fix(mobile): stop the work log flickering during subagent runs and failing calls by @juliusmarminge in pingdotgg/t3code#10273
* fix(mobile): save linked media from chat by @juliusmarminge in pingdotgg/t3code#10271
* feat(markdown): show the GitHub mark for github.com links by @juliusmarminge in pingdotgg/t3code#10324
* fix(marketing): show a real preview card when t3.codes is shared by @t3dotgg in pingdotgg/t3code#10305


**Full Changelog**: pingdotgg/t3code@v0.0.39-nightly.20260906.1292...v0.0.39-nightly.20260906.1293

Upstream release: https://github.com/pingdotgg/t3code/releases/tag/v0.0.39-nightly.20260906.1293
aorwall added a commit to aorwall/t3code that referenced this pull request Sep 7, 2026
Merges 141 upstream commits (`b438447f6..8b2838e`) into the fork,
following the
`fork-upstream-merge` skill. Landed as a merge commit; conflicts
resolved by the
path-policy verdicts in `docs/fork/inventory.json`.

## Merge shape

563 files landed (`git diff --stat HEAD^1 HEAD`) against 563 in the
upstream
range, so no upstream work was dropped. Fork delta 720 files.

## Conflicts

14 files, resolved by concern. The merge commit message names each. Two
are worth
carrying forward:

- Upstream extracted the project action rows into
`ProjectActionsList.tsx`. The
fork's Edit gate now rides an `editable` prop that defaults to
upstream's
  always-editable behavior, so the gate survives the next extraction.
- Upstream moved the `agent-browser-access` setting onto its new
`/settings/projects` page. `settingsSearch.ts` points that item there
and drops
  a fork delta.

## Two things a clean merge did not show

**Upstream can delete an export the fork still imports.** pingdotgg#10225 removed
`ClientTracingLive` as unused. `apps/web/src/lib/runtime.ts` still
installs it,
and neither file conflicted, so the typecheck failed four ways on a
merge git
called clean. Restored with a `// Fork:` comment naming the consumer.

**A green test step can hide a suite that never finished.** `vp run -r
test`
kills the packages still running when one of them fails. A
`@t3tools/desktop`
failure truncated `apps/web` and `@t3tools/mobile` after each had
reported
hundreds of passing files, and `verify.mjs` counted any package with
labeled
output as tested. Four failing web tests went unreported. The check now
keys on
the closing `Test Files` line and runs every unfinished package alone.

## Unsupported methods

`unsupported-methods.mjs` reports 0 ADD, 0 DROP, 2 KEEP, against 61
dispatched
backend methods and 131 contract methods.

Getting there took a fix. The backend moved its dispatch from
`crates/t3code/src/lib.rs` to `crates/t3code/src/rpc/dispatch.rs`, where
every
arm is a one-line call into a handler below the match. The script read
the old
path and reported zero dispatched methods, then read the new one and
called
`vcs.switchRef` a DROP, because the `unsupported_exit` that refuses it
had moved
out of the arm. It now tries both paths and follows an arm two calls
deep.

Contract changes: `provider.consumeResetCredit` and
`server.getHostResources`
gained `UnsupportedMethodError`; `server.getUsageSummary` lost it, which
closes
the item the previous merge left open.

## Feature classification

**Usable as-is** — client-only, nothing new on the wire. Sidebar drag
across
sections with destination cues and a named drop action (pingdotgg#9731, pingdotgg#9750,
pingdotgg#10378,
pingdotgg#10453, pingdotgg#10464). Composer behavior: a multiline draft survives timeline
scrolling (pingdotgg#10444), the composer stops collapsing on blur (pingdotgg#10437) and
regains
focus when you tab back (pingdotgg#10463). Panel and preview chrome: resize the
floating
preview from any edge (pingdotgg#10467), toolbar controls stay anchored (pingdotgg#10478),
the
stuck resize cursor clears (pingdotgg#10461), the browser hides as the right
panel closes
(pingdotgg#10385), manual panel choices hold during a turn (pingdotgg#10113). Settings and
accessibility polish (pingdotgg#10177, pingdotgg#10262, pingdotgg#10415, pingdotgg#10258, pingdotgg#10124, pingdotgg#10125,
pingdotgg#10127,
pingdotgg#10128, pingdotgg#10175). Performance (pingdotgg#10413, pingdotgg#10190, pingdotgg#10118). Plus the GitHub
mark on
`github.com` links (pingdotgg#10324), the Tux icon for WSL (pingdotgg#8511), a remembered
usage
page selection (pingdotgg#10189), project settings in the legacy sidebar menu
(pingdotgg#10021),
and text-only preview snapshots (pingdotgg#10232).

**Unsupported in Moatless** — resolves to a refusal, or falls through to
its own
empty state. Each is recorded in `docs/fork/gaps.md`:

- Reset credits through the hub and CLIProxyAPI (pingdotgg#10462, pingdotgg#10395,
pingdotgg#10308).
`provider.consumeResetCredit`, new union entry. `UsageLimits.tsx`
catches the
  refusal and shows "Could not use the reset credit."
- Balancing new threads across connected machines (pingdotgg#9895, pingdotgg#10433,
pingdotgg#10407).
`server.getHostResources`, new union entry. Nothing polls until a user
picks
automatic routing, and the composer then reads "Auto balance
unavailable."
- Onboarding: import grouped by repository (pingdotgg#10493), the shared
multi-computer
  wizard (pingdotgg#10465), agent install without Node or npm (pingdotgg#10402). All ride
  `agentSessions.scan` and `.import`, an existing gap.
- Shared project defaults and scoped overrides (pingdotgg#9754). The page reads,
and every
  write goes through `server.updateSettings`, which the backend does not
  dispatch.
- Two new `orchestration.dispatchCommand` types: `thread.active.reorder`
(pingdotgg#9729)
and `thread.user-input.dismiss` (pingdotgg#10431). Both are ordinary controls, a
sidebar
drag and a Dismiss button, and a dispatched command cannot be refused
per type.
That is the standing _A command cannot be refused_ gap, now 26 members
wide.

**Backend behavior to consider reproducing in Moatless** — upstream
server fixes
whose behavior the fork's client assumes:

- Invalid script IDs no longer crash threads (pingdotgg#10019). The fork ships
project
  scripts, so this one is worth reading first.
- Settlement: settle inactive threads without a PR lookup (pingdotgg#10103), skip
disabled
settlement lookups (pingdotgg#10424), settle threads with unanswered async
questions
  (pingdotgg#10400).
- Interrupted threads stay resumable after a restart (pingdotgg#10421).
- Completed requests stay closed across clients (pingdotgg#10123).
- Placeholder branches are followed after a checkout updates (pingdotgg#10441).
- A thread's PR links without an open client (pingdotgg#10101), and checkpoints
are
  captured before a PR status refresh (pingdotgg#10347).
- Adapters declare their own context compaction (pingdotgg#10112).
- Transcripts with oversized tool records import (pingdotgg#10430), and git
status scans
  are skipped while the index is locked (pingdotgg#9845).
- Usage limits pool per provider across accounts and environments
(pingdotgg#10300). The
client renders what `server.getUsageSummary` returns, so this shows
something
  only if the Moatless payload carries per-account limits.

Mobile, marketing, desktop, provider adapters and release tooling are
not this
fork's surface and are not classified.

## Also fixed here, and not upstream's doing

- Three `browser-*` search items still routed to
`/settings/integrations`, which
the fork owns for its Moatless administration page. A non-administrator
who
  searched for them was redirected away from the result.
- `moatless/listSearch.ts` carried no fork-only declaration.
- `pnpm fmt:check` failed on 294 files, 293 of them orval output. The
generator
  now formats what it writes through an `afterAllFilesWrite` hook.
- `@t3tools/moatless-api` exported `./generated`, a barrel that is never
checked
  in.

## Verification

`inventory-check.mjs` clean. `verify.mjs` green on seven checks:
duplicate-adds,
tripwires, resolution-check, unsupported-methods, `fmt:check` (3876
files),
`lint` and `typecheck`.

`test` is red on one package, and it is the machine.
`@t3tools/desktop`'s
`bundled libsecret helper` shells out to `pkg-config` for `libsecret-1`,
which
this sandbox does not have; it fails the same way when retried alone.
Everything
else passes: `apps/web` 369 files, `t3` 291, `@t3tools/mobile` 149,
`t3code-relay` 27, `@t3tools/client-runtime` 71, plus the smaller
packages.

`spec:check` cannot run in a sandbox: it needs a sibling `moatless`
checkout or a
deployment URL and has neither.

Written by Claude Opus 5 in Claude Code.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

---
Moatless task:
https://moatless.soaplabstest.com/tasks/8d348ecf-f9cb-4e65-b96b-6c1054a8ed33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XL 500-999 changed lines (additions + deletions). vouch:trusted PR author is trusted by repo permissions or the VOUCHED list.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant