Repository navigation

Host overhead 3/N: worker speculates as columns, fused route+send, skips unread publishes; speculation and stream-buffer objects - #850

Merged

NSagan271 merged 14 commits into

mainfrom

host-overhead/pr3-worker-spec

Oct 30, 2026

Merged

Host overhead 3/N: worker speculates as columns, fused route+send, skips unread publishes; speculation and stream-buffer objects#850
NSagan271 merged 14 commits into
mainfrom
host-overhead/pr3-worker-spec

Commits on Oct 30, 2026
- Worker: speculate a loop's next step as columns, route device-loopback steps in one call, skip unread publishes
  
  NSagan271
  and
  claude
  committed
  281ff2f
- Worker: columnar speculation for any one-walk step, TP leaders included; never publish a resource with one lockstep instance
  
  NSagan271
  and
  claude
  committed
  3073a62
- conductor: pass the instance map as a trailing keyword; give the conductor fakes the new attribute
  
  NSagan271
  and
  claude
  committed
  219e8c3
- Worker: speculation prep and build as SpeculationPreparer and SpeculationBuilder; columnar path for mixed-walk steps; review fixes
  
  NSagan271
  and
  claude
  committed
  b766b41
- tests: drop the speculation and publish tests that duplicate the parity tests or restate the code; publish-skip decisions as tables
  
  NSagan271
  and
  claude
  committed
  2c424b4
- Speculation reads a context, and stream buffers get a manager
  
  NSagan271
  and
  claude
  committed
  e52c962
- tests: the host-copies worker fake gets a stream manager
  
  NSagan271
  and
  claude
  committed
  2cfe3ed
- tests: import the resource-runner stub by module name, as CI's pytest path allows
  
  NSagan271
  and
  claude
  committed
  a437353
- publish skip: decide on every node that declares a resource, across the deployment
  
  NSagan271
  and
  claude
  committed
  0c8944e
- tests: the spec-rows scheduler stub answers the readiness check
  
  NSagan271
  and
  claude
  committed
  cc9ac91
- Worker: the GPU thread no longer calls into the graph runtime
  
  stephen-dwq
  authored and
  NSagan271
  committed
  5609bab
- tests: speculation end to end over real graph runtimes
  
  stephen-dwq
  authored and
  NSagan271
  committed
  a2f699e
- tests: main's speculation-readiness and withheld-output stubs on this PR's worker
  
  NSagan271
  and
  claude
  committed
  68adef7
- configs: Qwen3.5 0.8B runs with the knobs it was benchmarked with
  
  NSagan271
  and
  claude
  committed
  65d188b

Commits

Commits on Oct 30, 2026