cp: Making URL Generator's / FilePartioningStage Xenna spec to be one worker per node (1350) into r1.1.0 - #1366

cp: Making URL Generator's / FilePartioningStage Xenna spec to be one worker per node (1350) into r1.1.0#1366

sarahyurick merged 4 commits into

r1.1.0NVIDIA-NeMo/Curator:r1.1.0from

cherry-pick-1350-r1.1.0NVIDIA-NeMo/Curator:cherry-pick-1350-r1.1.0Copy head branch name to clipboard