Integrate sequence-packing scheduler into training loop and GPT pretraining - #6628

Integrate sequence-packing scheduler into training loop and GPT pretraining#6628

ilml wants to merge 2 commits into

NVIDIA:pull-request/6627NVIDIA/Megatron-LM:pull-request/6627from

ilml:split/3386-07-scheduler-training-integrationilml/Megatron-LM:split/3386-07-scheduler-training-integrationCopy head branch name to clipboard