Repository navigation

feat(rl): add score-centered policy gradients - #4

Closed

nanjiangwill wants to merge 1130 commits into

mainfrom

feat/score-centering-paper

Closed

feat(rl): add score-centered policy gradients#4
nanjiangwill wants to merge 1130 commits into
mainfrom
feat/score-centering-paper

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 4, 2026
Commits on Sep 7, 2026
- refactor(rollout): rename shared filter output (#3095)
  guapisolo
  authored
  51853a1
- refactor(rollout): centralize common group filters (#3094)
  guapisolo
  authored
  5185f13
- fix(rollout): drop groups with missing rewards (#2814)
  
  guapisolo
  and
  DavidBellamy
  authored
  4a58e4e
- refactor(docs): nest CI pages under developer (#3134)
  guapisolo
  authored
  78747f6
Commits on Sep 8, 2026
Commits on Sep 9, 2026
- smoke: manual golden episodes on real sandbox APIs (#2868)
  
  nblintao
  and
  claude
  authored
  4501b26
- Bound the trainer's GPU memory during the LoRA weight sync (#3147)
  yueming-yuan
  authored
  bf48205
- examples: launcher for the in-process Harbor path (#2836)
  
  nblintao
  and
  claude
  authored
  4f8e0b8
- [feat] Enable THD packed-sequence training for DeepSeek-V4-Flash, with context parallelism (#2038)
  
  authored
  7bf0539
- [AMD] docker: retire the rocm700 variants, add a rocm10-mi35x variant (#2854)
  
  XinyuJiangCMU
  and
  JessicaJiang-123
  authored
  8d9826e
- [CI] disable the two FT determinism tests #3148 missed (#3160)
  yueming-yuan
  authored
  aa46ead
- ci: repeat a failed test's last output in the suite summary (#3149)
  yueming-yuan
  authored
  f207d59
- ci(lark): explain each failed job on the CI status card (#3152)
  
  yueming-yuan
  and
  Alan Livshin
  authored
  327eefa
- Scan full responses for repetition metrics (#3115)
  Shi-Dong
  authored
  d8dd0de
- Fix Nemotron-H forward compatibility when MTP is disabled (#3164)
  Shi-Dong
  authored
  021d311
- Fix missing Nemotron-H Mamba convolution mappings (#3163)
  
  Shi-Dong
  and
  Zhichenzzz
  authored
  f1eac9b
- fix(ci): keep the Nemotron-H plugin importable without megatron.bridge (#3169)
  yueming-yuan
  authored
  b6dc430
- ci(lark): report every failing test in a job (#3168)
  yueming-yuan
  authored
  fa7939f
- fix: use host weights when syncing an offloaded actor (#3128)
  
  Shi-Dong
  and
  Zhichenzzz
  authored
  f01f9a3
- ci: pin the DSv4 bshd/thd parity test to the miles impl (#3162)
  JessicaJiang-123
  authored
  031fe3d
- docs(tito): explain abnormal Qwen3 endoftext output (#3167)
  guapisolo
  authored
  e5125a9
Commits on Sep 10, 2026
Commits on Sep 11, 2026
Commits on Sep 12, 2026
- test(agentic): run the sandbox tests on any provider, not just e2b (#3195)
  nblintao
  authored
  8760515
Commits on Sep 14, 2026
Commits on Sep 15, 2026
Commits on Sep 16, 2026
Commits on Sep 17, 2026
- feat(dashboard): render conversation images (#3239)
  BaiqingL
  authored
  ef3807c
Commits on Sep 18, 2026
Commits on Sep 19, 2026
- fix(rollout): isolate cancelled groups in fully async generation (#3319)
  
  Shi-Dong
  and
  yueming-yuan
  authored
  e2a5a3e
Commits on Sep 20, 2026
- fix(docker): pin Bridge to the compatible revision (#3336)
  yueming-yuan
  authored
  d4137b9
Commits on Sep 21, 2026
Commits on Sep 22, 2026
Commits on Sep 23, 2026
- fix(rl): allow sampling replay through SGLang router
  nanjiangwill
  committed
  5ba2872
- style(rl): format sampling replay e2e arguments
  nanjiangwill
  committed
  fd87bf3
- test(rl): model derived sampling replay default
  nanjiangwill
  committed
  f20c909
- test(session): model sampling replay default in parity runs
  nanjiangwill
  committed
  d7e28bd
- test(e2e): check sampling-support replay exactly under true-on-policy (#3)
  
  guapisolo
  and
  claude
  authored
  d00746e
- docs(rl): remove stale sampling replay router requirement
  nanjiangwill
  committed
  f345ebb
- feat(rl): add score-centered policy gradients
  nanjiangwill
  committed
  52a21b0

Commits

Commits on Sep 4, 2026

Commits on Sep 7, 2026

Commits on Sep 8, 2026