Add SCV graph replay and adaptive controller for NWOR staging#2

Merged

yuz207 merged 9 commits intomainfrom

Oct 15, 2025

Commits on Oct 14, 2025

refactor(worker): simplify mask_work computation in GPUModelRunner

yuz207
authored and
yuz207
committed
feat: add SCV mode scaffolding

yuz207
authored and
yuz207
committed
feat(gpu_model_runner): add SCV mode with CUDA graph optimized mask computation

yuz207
and
terragon-labs[bot]
committed
fix: guard SCV mode for test harness
yuz207
committed
feat(gpu_model_runner): add adaptive SCV mode to dynamically adjust speculation tokens

yuz207
and
terragon-labs[bot]
committed
test(deferred_writer): add test for _build_nwor_acceptance_mask in SCV adaptive mode

yuz207
and
terragon-labs[bot]
committed

Commits on Oct 15, 2025