feat: build one client per rollout, share renderers process-wide - #2218

Merged

mikasenghaas merged 27 commits into

mainfrom

feat/per-rollout-clients

Aug 3, 2026

Commits on Jul 31, 2026

Commits on Aug 1, 2026

docs: drop the model-client paragraph from Borrowed Resources

mikasenghaas
and
claude
committed
fcdc59c
chore: drop transport-settings comment from EvalClient

mikasenghaas
and
claude
committed
2d80d69
fix: dedup only version-shaped segments in the upstream URL join

mikasenghaas
and
claude
committed
13e0def
refactor: lift the upstream URL join into clients.client.join_url

mikasenghaas
and
claude
committed
32933a7
chore: public VERSION_SEGMENT, trim the join_url docstring

mikasenghaas
and
claude
committed
292aeca
refactor: move transport settings and build_async_openai to clients.client

mikasenghaas
and
claude
committed
cedc939
chore: drop seat-resolution comment in Env

mikasenghaas
and
claude
committed
30c071f
refactor: client utils into clients.base, multiplex out of the pool key

mikasenghaas
and
claude
committed
b491474
fix: annotate ElasticRendererPool._shared as ClassVar (RUF012)

mikasenghaas
and
claude
committed
69c0a50
fix: recover from a warm task cancelled by a dead event loop

mikasenghaas
and
claude
committed
a0d057a
chore: log a failed warm at debug, drop unused contextlib import

mikasenghaas
and
claude
committed
ae0da58
docs: give the client example its own section

mikasenghaas
and
claude
committed
0b25aa2
chore: shorten the transport-defaults comment

mikasenghaas
and
claude
committed
f36f6cf
feat: elastic renderer pool, aligned with the interception pool

mikasenghaas
and
claude
committed
339fb37
chore: no underscore methods on ElasticRendererPool

mikasenghaas
and
claude
committed
d3d27b1

Commits on Aug 3, 2026

feat: bare renderers with slot-owned locking

mikasenghaas
and
claude
committed
62ba589
chore: name the pool registry _pools

mikasenghaas
and
claude
committed
480aa7a
feat: process-shared renderer list, pools as cheap views

mikasenghaas
and
claude
committed
7780331
chore: inline _pool_for at its call sites

mikasenghaas
and
claude
committed
6449686
chore: trim client docstrings, fix multiplex doc, drop dead code

mikasenghaas
and
claude
committed
4e8e91c
Merge branch 'main' into feat/per-rollout-clients

mikasenghaas
and
claude
committed
b6b0e0c
chore: drop the session client docstring

mikasenghaas
and
claude
committed
01f3a3e
fix: close the legacy server's cached v0 clients on shutdown

mikasenghaas
and
claude
committed
c7c19d2

Navigation Menu

Uh oh!

feat: build one client per rollout, share renderers process-wide - #2218

feat: build one client per rollout, share renderers process-wide#2218
mikasenghaas merged 27 commits into
mainfrom
feat/per-rollout-clients

Commits on Jul 31, 2026

feat: build one client per rollout, share renderers process-wide

feat: match OpenAI SDK transport defaults, no client retries

Merge branch 'main' into feat/per-rollout-clients

feat: elastic renderer pool, sized by a multiplex knob

Commits on Aug 1, 2026

docs: drop the model-client paragraph from Borrowed Resources

chore: drop transport-settings comment from EvalClient

fix: dedup only version-shaped segments in the upstream URL join

refactor: lift the upstream URL join into clients.client.join_url

chore: public VERSION_SEGMENT, trim the join_url docstring

refactor: move transport settings and build_async_openai to clients.client

chore: drop seat-resolution comment in Env

refactor: client utils into clients.base, multiplex out of the pool key

fix: annotate ElasticRendererPool._shared as ClassVar (RUF012)

fix: recover from a warm task cancelled by a dead event loop

chore: log a failed warm at debug, drop unused contextlib import

docs: give the client example its own section

chore: shorten the transport-defaults comment

feat: elastic renderer pool, aligned with the interception pool

chore: no underscore methods on ElasticRendererPool

Commits on Aug 3, 2026

feat: bare renderers with slot-owned locking

chore: name the pool registry _pools

feat: process-shared renderer list, pools as cheap views

chore: inline _pool_for at its call sites

chore: trim client docstrings, fix multiplex doc, drop dead code

Merge branch 'main' into feat/per-rollout-clients

chore: drop the session client docstring

fix: close the legacy server's cached v0 clients on shutdown