Skip to content

Add inter-document attention masking to GPTDataset - #5298

Merged
asolergi-nv merged 3 commits into
NVIDIA:mainfrom
deepakn94:dnarayanan/pack_sequences_gpt_dataset
Jun 28, 2026
Merged

Add inter-document attention masking to GPTDataset#5298
asolergi-nv merged 3 commits into
NVIDIA:mainfrom
deepakn94:dnarayanan/pack_sequences_gpt_dataset

Pad cu_seqlens to fixed length in GPTDataset for collation

da75e3d
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 26, 2026 in 0s

DCO

All commits are signed off!