ZeRO-Offload v1 (squash)#345

Merged

jeffra merged 4 commits intostaging-zero-dual-v2from

staging-zero-dual-v1

Sep 2, 2020

Commits on Aug 28, 2020

update DSE to point to ZeRO-Offload staging
jeffra
committed

Commits on Aug 29, 2020

ZeRO-2 enable CPU offload (#313)

jren73
and
jeffra
authored

Commits on Sep 1, 2020

Enable ZeRO checkpointing for ZeRO-Offload (#337)
tjruwase
authored

Commits on Sep 2, 2020

Add ZeRO-Offload checkpointing model tests (#344)
tjruwase
authored