feat(sft): add SFT v2 stage 1 with the Energon multimodal data path - #3917

Merged

terrykong merged 72 commits into

NVIDIA-NeMo:mainfrom

rohitrango:rohit/sft_v2_stage1

Sep 7, 2026

Commits on Aug 30, 2026

SFT v2
rohitrango
committed
db03f96
packer refactor
rohitrango
committed
8522a4a
remove dead code from nemotron cookers
rohitrango
committed
8ff1ed3
refactor(sft): defer Energon packing and dataset prep to stage 2
rohitrango
committed
ebbc40c
refactor(sft): strip Energon packing from the stage 1 surface
rohitrango
committed
7a54112
SFTV2Config existed only to parameterize _run_loader_measurement, a benchmark path that never runs in a real SFT job. Keeping it forced every SFTv2 config to carry a required sft_v2 block whose onl…
rohitrango
committed
d043777
config
rohitrango
committed
6744f40
removed packing api from stage 1
rohitrango
committed
40b0d3b
config compaction
rohitrango
committed
0395b5f
export
rohitrango
committed
a5b7806
fingerprint
rohitrango
committed
a089e7a
fix(sft): log policy metrics from the SFTv2 train step
rohitrango
committed
65e313b
feat(data-plane): add checkpoint save/load and list_sample_ids to the local adapter
rohitrango
committed
d53e016
chore(deps): move megatron-energon from the energon extra into mcore
rohitrango
committed
a6ac194

Commits on Aug 31, 2026

fix(sft): address SFTv2 review, unblock CI, and rebuild the processor in-worker

rohitrango
and
claude
committed
23d9700
chore(deps): relock for megatron-energon[av-decode] in the mcore extra

rohitrango
and
claude
committed
d2401bb
tests cleanup (patch regressions from stage 2)
rohitrango
committed
0a45c45
add copyright notice
rohitrango
committed
a8adf5c
lint/pyrefly
rohitrango
committed
8771080
remove partition generation
rohitrango
committed
72b7cdb

Commits on Sep 1, 2026

repair config and pyproject.toml
rohitrango
committed
d88bf5b
remove energon plumbing for v1
rohitrango
committed
c3aca71
end by timeout added
rohitrango
committed
d9b31b7

Commits on Sep 2, 2026

feat(sft_v2): rank checkpoints on train metrics via checkpointing.metric_name

rohitrango
and
claude
committed
4cb00d5

Commits on Sep 3, 2026

change topology mapper
rohitrango
committed
b260bdb
Update nemo_rl/data_plane/adapters/local.py

rohitrango
and
terrykong
authored
f47bb28
added test
rohitrango
committed
215141b
Update tests/unit/data/test_energon_sft.py

rohitrango
and
terrykong
authored
2e370fe
Update tests/test_suites/disabled.txt

rohitrango
and
terrykong
authored
f9f4f8e
Update nemo_rl/data/energon/sft_dataloader.py

rohitrango
and
terrykong
authored
e32af45
Update tests/unit/data/test_energon_multimodal_registry.py

rohitrango
and
terrykong
authored
cc6fdff
Update nemo_rl/data/energon/topology.py

rohitrango
and
terrykong
authored
4a4fc0f
removed fingerprinting
rohitrango
committed
8c224da
Merge branch 'rohit/sft_v2_stage1' of github.com:rohitrango/NeMo-RL into rohit/sft_v2_stage1
rohitrango
committed
d2f43d9
update uv.lock
rohitrango
committed
dbfa18d
fix(data-plane): pair local batches with materialize_local and fix local checkpoint filename
rohitrango
committed
0928773
Update nemo_rl/data_plane/adapters/local.py

rohitrango
and
terrykong
committed
fa7748d
Update tests/unit/data/test_energon_sft.py

rohitrango
and
terrykong
committed
83c7256
Update tests/test_suites/disabled.txt

rohitrango
and
terrykong
committed
89dd231
Update nemo_rl/data/energon/sft_dataloader.py

rohitrango
and
terrykong
committed
d23405f
Update tests/unit/data/test_energon_multimodal_registry.py

rohitrango
and
terrykong
committed
b022619
Update nemo_rl/data/energon/topology.py

rohitrango
and
terrykong
committed
e5bf0b3
update uv.lock
rohitrango
committed
be6b6c2
fix(data-plane): pair local batches with materialize_local and fix local checkpoint filename
rohitrango
committed
b85d50c
Merge remote-tracking branch 'nv/main' into rohit/sft_v2_stage1
rohitrango
committed
9bc865b
Merge branch 'rohit/sft_v2_stage1' of github.com:rohitrango/NeMo-RL into rohit/sft_v2_stage1
rohitrango
committed
b8e2b80
corrected energon regression
rohitrango
committed
426a1f8
chore: restore Megatron-Bridge pointer to main's b11414c7
rohitrango
committed
d65008c
Update tests/test_suites/disabled.txt

rohitrango
and
terrykong
authored
e4e37c2
Update nemo_rl/data/energon/sft_dataloader.py

rohitrango
and
terrykong
authored
6ca21f2
Update tests/unit/data/test_energon_sft.py

rohitrango
and
terrykong
authored
ad3fba3
Merge branch 'main' into rohit/sft_v2_stage1
rohitrango
authored
0714271
lint check
rohitrango
committed
ef3ba97
configg_cli fix for _override_ subdicts
rohitrango
committed
bb83579
Merge branch 'main' into rohit/sft_v2_stage1
rohitrango
authored
7b2ae92
ci: drop nemo_rl/modelopt/utils.py from pyrefly project-includes
rohitrango
committed
0147b60
fix energon tests and match energon <> HF parity
rohitrango
committed
98c8dc9
Merge branch 'main' into rohit/sft_v2_stage1
rohitrango
authored
a9b7ea8

Commits on Sep 4, 2026

Commits on Sep 5, 2026

Commits on Sep 6, 2026

Merge branch 'main' into rohit/sft_v2_stage1
rohitrango
authored
a0d0826

Commits on Sep 7, 2026

Merge branch 'main' of github.com:NVIDIA-NeMo/RL into rohit/sft_v2_stage1
rohitrango
committed
b8c8b63