Relax DeepSpeed MoE ZeRO-1 Assertion#2007

Merged

jeffra merged 2 commits intomasterfrom

qanthony/moe-fix

Jun 13, 2022

Commits on Jun 9, 2022

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1
Quentin-Anthony
committed

Commits on Jun 13, 2022

Merge branch 'master' into qanthony/moe-fix
tjruwase
authored