Skip to content

Add DP-balanced sequence-packing scheduler and integrate it into GPT pretraining - #6679

Closed
ilml wants to merge 4 commits into
NVIDIA:mainfrom
ilml:split/3386-dcp-scheduler
Closed

Add DP-balanced sequence-packing scheduler and integrate it into GPT pretraining#6679
ilml wants to merge 4 commits into
NVIDIA:mainfrom
ilml:split/3386-dcp-scheduler

Integrate sequence-packing scheduler into training loop and GPT pretr…

65727ed
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 19, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO