feat(sc): gate-authoritative token capture on the Gym tokidcap stack - #3455

Closed

pthombre wants to merge 44 commits into

mainfrom

pthombre/tq-tokidcap-migration

Commits on Jun 28, 2026

squash #2700

yuki-97
and
mehraakash
committed
bf22d4f
squash rollout pump (e48aa9f -> 8b5d01f)
yuki-97
committed
22be51a
squash staleness sampler + tq replay buffer (eadf626 -> ac5571a)
yuki-97
committed
6b05f56
[rollout pump] fix batch
yuki-97
committed
e961303
squash entrypoint + fix (f335c92 -> 57f8eb2)
yuki-97
committed
4942d29
refactor(single-controller): rename setup entrypoint; drop dryrun test
yuki-97
committed
41f88f0
feat(single-controller): add over_sampling=false batch-quota mode via reserve/commit slots
yuki-97
committed
04b3788
fix config
yuki-97
committed
87d805d
limit max_train_steps by max_num_epochs
yuki-97
committed
4443ecc
elegant shutdown
yuki-97
committed
462ce21
lint
yuki-97
committed
8b50c27
support setup weight_synchronizer and uncomment
yuki-97
committed
5f757dd
feat(single-controller): log per-step train metrics
yuki-97
committed
37cfcbf
add prepare_for_lp/training
yuki-97
committed
c56cf47
add nightly
yuki-97
committed
cfaaeeb
copyright
yuki-97
committed
5ad58e3
add timing
yuki-97
committed
e05861b
add nightly sync
yuki-97
committed
3c51421
fix(sc): unblock train_pump asyncio, add set_seed, fix LR log ordering
yuki-97
committed
888cb8e
feat(sc): add force_in_order target-step matching to async_rl sampler
yuki-97
committed
d515ddb
feat(sc): assert num_prompts * num_gen == train_global_batch_size
yuki-97
committed
bfb2467
[tmp] upload yaml/script for debug
yuki-97
committed
2bc4b63
refactor(sc): drop async_rl.target_prompt_groups_per_step, use grpo.num_prompts_per_step
yuki-97
committed
50de76f
refactor(sc): move batch_selection_strategy to top of async_rl, fix functional test buffer sizing
yuki-97
committed
c48c050
fix rebase
yuki-97
committed
1e0107e
feat(sc): wire NeMo-Gym rollouts into SingleController
yuki-97
committed
2c50b8e
ci: add L1_Functional_Tests_SingleController; move grpo_dp_single_controller and grpo_async_gym_single_controller into it
yuki-97
committed
c4347ce

Commits on Jun 30, 2026

feat(sc): add max_prompt_groups cap to StalenessSampler.select
yuki-97
committed
42f66e3

Commits on Jul 7, 2026

refactor(sc): clear DP samples per sub-select
yuki-97
committed
05d18d6
fix exposed_generation
yuki-97
committed
fe8ac47

Commits on Jul 28, 2026

feat(sc): S1 token-capture primitives — TQ sink/source, TokenCaptureConfig, replay-buffer surgery

pthombre
and
claude
committed
b06727a
feat(sc): S2 token-capture worker hosting — install_capture, fan-outs, weight-version stamping

pthombre
and
claude
committed
591fa91
feat(sc): S3 token-capture — Gym gate (submodule pin 05986b04)

pthombre
and
claude
committed
7f89d7a
docs(sc): record S3-pin flag-off functional evidence in the capture log

pthombre
and
claude
committed
bab7dd6
feat(sc): S4 token-capture — receipts, blackbox finalizer, SC integration

pthombre
and
claude
committed
6b32665
feat(sc): S5 verification — gate metrics, row dump, byte counters, capture L1 test, SWE A/B runbook

pthombre
and
claude
committed
8408cba

Commits on Jul 29, 2026

feat(sc): add examples/swe_bench async GRPO SWE launcher + recipe

pthombre
and
claude
committed
ef4ef4b
fix(sc): forward NG_HTTP_BYTES_DIR/NRL_HTTP_BYTES_DIR into the SWE job env

pthombre
and
claude
committed
e710556
docs(sc): add pinned launch record for the SWE token-capture A/B

pthombre
and
claude
committed
26b845e
fix(sc): use image-baked /opt/gym_venvs in the SWE A/B launcher

pthombre
and
claude
committed
3249559
fix(sc): skip reference logprobs when reference_policy_kl_penalty == 0

pthombre
and
claude
committed
1f567c9
docs(sc): add setup/try-it guide for gate-authoritative token capture

pthombre
and
claude
committed
4ba182d

Commits on Jul 31, 2026

feat(sc): migrate token capture onto the Gym tokidcap stack

pthombre
and
claude
committed
8c942f6
chore(sc): update uv.lock for the tokidcap-stack submodule pin

pthombre
and
claude
committed
624bb27