Merge from master#2

Merged

trajepl merged 27 commits intotrajepl:masterfrom

deepspeedai:master

Jul 21, 2022

Commits on Jun 23, 2022

Commits on Jun 27, 2022

correct partition_id in fp32 param -> fp16 param for MoE+z2 (#2058)
siddharth9820
authored

Commits on Jun 29, 2022

Commits on Jul 6, 2022

Commits on Jul 7, 2022

Fix partition id in the fp32->fp16 param copying step for z2+cpu-offload (#2059)

siddharth9820
and
tjruwase
authored

Commits on Jul 8, 2022

Codeowner addendum and fix to small model debugging script (#2076)
samadejacobs
authored

Commits on Jul 18, 2022

Commits on Jul 20, 2022