Integrate sequence-packing scheduler into training loop and wire varlen dataset into GPT pretraining - #6742

Integrate sequence-packing scheduler into training loop and wire varlen dataset into GPT pretraining#6742

ilml merged 5 commits into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

ilml:split/3386-training-r2ilml/Megatron-LM:split/3386-training-r2Copy head branch name to clipboard