[data] switch pretrain from broadcast to replicated load#491

ananthsub merged 1 commit intoNVIDIA-NeMo:mainNVIDIA-NeMo/Megatron-Bridge:mainfrom

ananthsub:tp-replicated-loadananthsub/Megatron-Bridge:tp-replicated-loadCopy head branch name to clipboard