Repository navigation

nemotron_duplex: live calls at one-shot cost (full duplex 5/6) - #595

Merged

dghosef merged 78 commits into

duplex/nemotron-livefrom

duplex/perf

Oct 27, 2026

Merged

nemotron_duplex: live calls at one-shot cost (full duplex 5/6)#595
dghosef merged 78 commits into
duplex/nemotron-livefrom
duplex/perf

Commits on Oct 21, 2026
- nemotron_duplex: capture the streaming encoder's layer stack
  
  dghosef
  and
  claude
  committed
  e993809
- nemotron_duplex: capture the codec's steady-state decode
  
  dghosef
  and
  claude
  committed
  7f919cb
- nemotron_duplex codec: build the iSTFT window envelope once per shape
  
  dghosef
  and
  claude
  committed
  e3fba43
- nemotron_duplex encoder: bounded front end in a pool, a live step as one graph
  
  dghosef
  and
  claude
  committed
  ad124b5
- R1.1: the codec's inverse STFT keeps no envelope per length
  
  dghosef
  and
  claude
  committed
  a612053
- R1.2: refuse a session cap a per-session resource cannot hold
  
  dghosef
  and
  claude
  committed
  876bdcb
- R1.16: drive the encoder's and codec's regions through the real runner
  
  dghosef
  and
  claude
  committed
  0732042
- R1.4: the encoder reads each pool's plan where it uses it, before a region re-plans
  
  dghosef
  and
  claude
  committed
  1cd9bd6
- R1.5: store the encoder's layer state in the dtype the layers compute it in
  
  dghosef
  and
  claude
  committed
  49d6cc7
- R1.6: the layer region runs only the calls that got a frame
  
  dghosef
  and
  claude
  committed
  01a07ef
- R1.10: test the recurrent pool's gather / scatter_, and refuse the sentinel
  
  dghosef
  and
  claude
  committed
  493448f
- R1.11: gather reads with the plan's int32 indices, without a cast
  
  dghosef
  and
  claude
  committed
  e6e0882
- R1.7: describe the encoder's pools and graphs as they are
  
  dghosef
  and
  claude
  committed
  12ddec7
- R1.13: tell live clients which append size takes the encoder's fast path
  
  dghosef
  and
  claude
  committed
  a115c76
- R1.15: say that per-message deflate is off for every WebSocket route
  
  dghosef
  and
  claude
  committed
  76f6b7f
- R1.17: one list of session batch sizes; the codec reads its runners directly
  
  dghosef
  and
  claude
  committed
  5ee201a
- R2.1: check the codec's window envelope on the host, so it builds on meta
  
  dghosef
  and
  claude
  committed
  739b56d
- R2.2: cap the encoder's and codec's batches at their widest graph
  
  dghosef
  and
  claude
  committed
  44c8105
- R2.3: size and check nano_kv for the session cap, as talker_kv is
  
  dghosef
  and
  claude
  committed
  4cfac81
- R2.4: the encoder's layer state takes the engine's compute dtype
  
  dghosef
  and
  claude
  committed
  1d042b6
- R2.5: per-message deflate is a serving setting, off in the duplex configs
  
  dghosef
  and
  claude
  committed
  0164d83
- R2.6: the streamer takes any featurizer geometry the offline encoder does
  
  dghosef
  and
  claude
  committed
  98ecd5d
- R2.7: refuse a checkpoint the declared resources were not sized for
  
  dghosef
  and
  claude
  committed
  fc5db60
- R2.8: tell live clients the whole-step graph keeps to the call's frame grid
  
  dghosef
  and
  claude
  committed
  a322b95
- R2.9: decide once whether a call takes the whole-step region
  
  dghosef
  and
  claude
  committed
  ba262f7
- R2.10: an encoder step copies its calls' chunks to the device at once
  
  dghosef
  and
  claude
  committed
  1d09a92
- R2.13: the encoder tests take their region leases from the engine's own method
  
  dghosef
  and
  claude
  committed
  9306c94
- R2.14: replay the encoder's step region and the codec's region with a padding row
  
  dghosef
  and
  claude
  committed
  bca60c8
- R2.16: the default session count is its own constant, not the capture list's
  
  dghosef
  and
  claude
  committed
  6737e6d
- R2.17: correct the duplex docs and comments the review found stale
  
  dghosef
  and
  claude
  committed
  6304de4
- R1.9: keep cuFFT out of the captured encoder step and codec decode
  
  dghosef
  and
  claude
  committed
  26d6221
- nemotron_duplex: the encoder no longer takes max_session_samples
  
  dghosef
  and
  claude
  committed
  1873ecb
- nemotron_duplex: separate long encoder chunks by can_batch; drop RecurrentAddressing.narrow
  
  dghosef
  and
  claude
  committed
  7497253
- nemotron_duplex tests: capture on CPU as main's runner does; the engine fake has a capture_runner
  
  dghosef
  and
  claude
  committed
  aaa25e2
- test_recurrent_padding_rows: drop the stale select wording from a docstring
  
  dghosef
  and
  claude
  committed
  e4030ee
- Merge branch 'duplex/nemotron-live-v3' into duplex/perf-v3
  dghosef
  committed
  246222c
Commits on Oct 22, 2026
- Bounded KV: a sink + window per-request KV resource
  
  authored and
  dghosef
  committed
  791c31f
- Bounded KV: a per-query causal window
  
  dghosef
  and
  claude
  committed
  e2cd2e1
- Bounded KV: guard the online softmax against a fully masked tile
  
  dghosef
  and
  claude
  committed
  951c94a
- Bounded KV: cast the probabilities to the values' dtype before the dot
  
  dghosef
  and
  claude
  committed
  7c9d2cb
- Bounded KV: dtype=None is the engine's KV dtype
  
  dghosef
  and
  claude
  committed
  a51fc80
- Bounded KV: rename the graph-buffer hook to main's name
  
  dghosef
  and
  claude
  committed
  69c7a7a
- Bounded KV: admit refusals name the request at fault
  
  dghosef
  and
  claude
  committed
  8cdc9e8
- Bounded KV: commit skips span-0 segments
  
  dghosef
  and
  claude
  committed
  32fb8fc
- Bounded KV: drop force_double_buffer, whose hazard this resource lacks
  
  dghosef
  and
  claude
  committed
  8cff7bb
- Bounded KV: tests for the per-query window, bf16, span 0 and the hooks
  
  dghosef
  and
  claude
  committed
  d67309c
- docs: bounded KV's per-query window and dtype=None
  
  dghosef
  and
  claude
  committed
  94e5067
- Bounded KV: the per-query window is a config field, retention may be constant
  
  dghosef
  and
  claude
  committed
  de6be73
- Bounded KV: resolve retention once per source length
  
  dghosef
  and
  claude
  committed
  6cc08d0
- Bounded KV: per step, a row attends only the step's keys it writes
  
  dghosef
  and
  claude
  committed
  e03a4a2
- Bounded KV: pick the query tile from T and the element size
  
  dghosef
  and
  claude
  committed
  2acf397
- Bounded KV: rollback_admit gives back the slots an admit took
  
  dghosef
  and
  claude
  committed
  c0e4499
- Bounded KV: refuse arguments the kernel would misread
  
  dghosef
  and
  claude
  committed
  710b188
- Bounded KV: say the online softmax's -inf guard is defensive; undangle a docs path
  
  dghosef
  and
  claude
  committed
  0abfcf4
- Bounded KV: only CPU tensors take the torch path
  
  dghosef
  and
  claude
  committed
  bb0fb52
- Bounded KV: resolve dtype=None without writing it into the config
  
  dghosef
  and
  claude
  committed
  ff59d32
- nemotron_duplex: the encoder's attention window on bounded KV
  
  dghosef
  and
  claude
  committed
  521566a
- nemotron_duplex: a steady call falls back to the eager path again
  
  dghosef
  and
  claude
  committed
  e716ec2
- nemotron_duplex: the front end makes the frames prepare_inputs counted
  
  dghosef
  and
  claude
  committed
  b5124e0
- nemotron_duplex: a call's KV position is built once per step
  
  dghosef
  and
  claude
  committed
  68cd0d8
- nemotron_duplex: name the all-steady declaration test for its three resources
  
  dghosef
  and
  claude
  committed
  0b7b7de
- nemotron_duplex: the module docstring lists the encoder's bounded KV
  
  dghosef
  and
  claude
  committed
  0e7fb5c
- Merge branch 'duplex/nemotron-live' into duplex/perf
  
  dghosef
  and
  claude
  committed
  c00670c
Commits on Oct 26, 2026
- Merge remote-tracking branch 'origin/duplex/nemotron-live' into HEAD
  dghosef
  committed
  d475815
Commits on Oct 27, 2026
- Merge duplex/nemotron-live (with origin/main) into duplex/perf
  
  dghosef
  and
  claude
  committed
  9e45084
- Merge follow-up: the encoder plan test checks only the KV's plan under #891's gather / scatter_
  
  dghosef
  and
  claude
  committed
  f4ac338
- Merge merge/594-main (round-1 fixes R1.1-R1.3) into merge/595-main
  
  dghosef
  and
  claude
  committed
  c361af0
- Merge merge/594-main (P3b) into merge/595-main
  dghosef
  committed
  9a9ac66
- P3b: nemotron_duplex configs (#595 wording): a live call past the cap gets a 503
  
  dghosef
  and
  claude
  committed
  27925f8
- P3a: the recurrent pool resolves a dtype=None block without writing it back
  
  dghosef
  and
  claude
  committed
  f0ef4a5
- P3a: size the recurrent pool's startup log from its resolved blocks
  
  dghosef
  and
  claude
  committed
  51a07e0
- R2.3: linear-attn managers take the state dtype the pool stores
  
  dghosef
  and
  claude
  committed
  f3d3c1a
- R2.4: delete RecurrentBlockConfig's unused byte sizes
  
  dghosef
  and
  claude
  committed
  e1d22cc
- Merge merge/594-main (R2.1, R2.2) into merge/595-main
  dghosef
  committed
  b08a02c
- Merge merge/594-main into merge/595-main (R3.1)
  dghosef
  committed
  c2110d6
- R3.2: resolve a recurrent block's dtype on RecurrentBlockConfig
  
  dghosef
  and
  claude
  committed
  afa4364
- R3.4: two blank lines before RecurrentStateSpec; fold a test import
  
  dghosef
  and
  claude
  committed
  0587065
- Merge merge/594-main into merge/595-main (test fakes for #593 fields)
  
  dghosef
  and
  claude
  committed
  838b5d8

Commits

Commits on Oct 21, 2026

Commits on Oct 22, 2026

Commits on Oct 26, 2026

Commits on Oct 27, 2026