ZeRO-Offload (squash)#381

Merged

jeffra merged 49 commits intostaging-zero-dual-v5from

staging-zero-dual-v4

Sep 9, 2020

Commits on Sep 2, 2020

Commits on Sep 4, 2020

Commits on Sep 5, 2020

fixing adam copy fp16-param-add more compile flags for cpu_adam
Reza Yazdani
committed
run precommit
Reza Yazdani
committed
fix variance indexes
Reza Yazdani
committed
fix array-sizes
Reza Yazdani
committed
ZeRO-Offload passing model functionality tests (#366)
tjruwase
authored
move adam_test
Reza Yazdani
committed
rename perf test
Reza Yazdani
committed
fixing adam copy fp16-param and add more compile flags for cpu_adam (#367)
RezaYazdaniAminabadi
authored
Perf tests
tjruwase
committed
BumpDSE
tjruwase
committed
fixed a typo; this was fixed before but seems like it has been lost in the refactor (#364)
arashashari
authored
Move code quality tests to Azure-hosted agents. (#368)
Shaden Smith
authored

Commits on Sep 6, 2020

add casting kernel
Reza Yazdani
committed
run precommit
Reza Yazdani
committed
revert changes
Reza Yazdani
committed
revert changes
Reza Yazdani
committed
Merge branch 'staging-zero-dual-v3' into reza/deepspeed_adam_merge_v3
Reza Yazdani
committed
Merge branch 'reza/deepspeed_adam_merge_v3' into staging-zero-dual-v3
Reza Yazdani
committed
merging
Reza Yazdani
committed
ZeRO-Offload: Integration code fixes (#370)
tjruwase
authored
Update installation instructions (#362)
tjruwase
authored
Update Sparse Attention Tutorial (#357)

arashashari
and
arashashari
authored
fixing corner cases (#371)
RezaYazdaniAminabadi
authored
fix adam perormance (#372)
RezaYazdaniAminabadi
authored

Commits on Sep 8, 2020

ZeRO-Offload passing model tests (#374)
tjruwase
authored
fix cpu adam compilation for AVX2 (#378)

RezaYazdaniAminabadi
and
jeffra
authored
Move code quality tests to Azure-hosted agents. (#368)

Shaden Smith
authored and
Reza Yazdani
committed