[doc,algo] feat: Rollout Correction - Fix Metrics, Add Documentation, and Add Batch Normalization#4070

Merged

ISEEKYAN merged 20 commits intoverl-project:mainfrom

szrlee:yingru/rollout_correction_fix

Nov 12, 2025

Commits on Nov 10, 2025

fix(rollout_corr): compute metrics in actor for bypass mode and fix trainer bugs
szrlee
committed
docs(rollout_corr): move to algo/ and add pure_rs preset
szrlee
committed
feat(rollout_corr): add batch normalization option for IS weights
szrlee
committed
docs(rollout_corr_math): use REINFORCE in aggregation loss examples for clarity
szrlee
committed
refactor(rollout_corr): simplify metrics computation by removing unused config and IS weight logic
szrlee
committed
docs(rollout_corr): add prominent cross-references between usage and math docs
szrlee
committed
docs(rollout_corr_math): add dedicated section for batch normalization
szrlee
committed

Commits on Nov 11, 2025