stage_1_and_2.py: no allreduce needed when mp size is 1#2494

Merged

tjruwase merged 1 commit intodeepspeedai:masterfrom

guoyejun:noallreduce

Nov 10, 2022

Commits on Nov 10, 2022

stage_1_and_2.py: no allreduce needed when mp size is 1
guoyejun
committed