Skip to content

feat(pretrain): pretraining in the SFT trainer (token shards, from-scratch init, log-likelihood evals) - #4062

Closed
snimu wants to merge 171 commits into
mainfrom
feat/pretrain
Closed

snimu wants to merge 171 commits into
mainfrom
feat/pretrain

fix(sft): eval_on_end keeps the eval_on_start round of a one-step run

b816470
Select commit
Loading
Failed to load commit list.
Cursor / Cursor Bugbot completed Oct 22, 2026 in 2m 19s

Bugbot Review

Bugbot Analysis Progress (2m 22s elapsed)

✅ Gathered PR context (3s)
✅ Completed bug detection (2m 18s)
✅ Posted analysis results (1s)

Final Result: Bugbot completed review - no issues found. 1 previously reported issue remain unresolved.

Request ID: e1aa85b7-6bd7-459f-b7b3-4139f7b19c5a

Details