[ZeRO] non-MoE stage 1 requires CG disabled#2703

jeffra merged 2 commits intomasterdeepspeedai/DeepSpeed:masterfrom

jeffra/z1-perf-fixdeepspeedai/DeepSpeed:jeffra/z1-perf-fixCopy head branch name to clipboard