Improving packed sequences SFT for large datasets#2395

cuichenx merged 6 commits intoNVIDIA-NeMo:mainNVIDIA-NeMo/Megatron-Bridge:mainfrom

shaltielshmid:feature/improved_sft_packingshaltielshmid/Megatron-Bridge:feature/improved_sft_packingCopy head branch name to clipboard