Skip to content

Where is the code (of BucketingSampler) that splits the cuts up by rank when doing distributed training? #1122

Answered by pzelasko
RuABraun asked this question in Q&A
Discussion options

You must be logged in to vote

It's in the base CutSampler class

selected = batches[self.rank]

Replies: 1 comment 11 replies

Comment options

You must be logged in to vote
11 replies
@pzelasko
Comment options

@lifeiteng
Comment options

@RuABraun
Comment options

@pzelasko
Comment options

@RuABraun
Comment options

Answer selected by RuABraun
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
3 participants