Update RNG sharding to include EP rank#2658

dimapihtar merged 3 commits intoNVIDIA:mainNVIDIA/Megatron-LM:mainfrom

paul-gibbons:pg/rng_state_fix_eppaul-gibbons/Megatron-LM:pg/rng_state_fix_epCopy head branch name to clipboard