Skip to content

Integrate sequence-packing scheduler into training loop and wire varlen dataset into GPT pretraining - #6742

Open
ilml wants to merge 4 commits into
NVIDIA:mainfrom
ilml:split/3386-training-r2
Open

Integrate sequence-packing scheduler into training loop and wire varlen dataset into GPT pretraining#6742
ilml wants to merge 4 commits into
NVIDIA:mainfrom
ilml:split/3386-training-r2

Collapse the _loader_args call for black

97a73f7
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 29, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO