fix adam perormance#372

Merged

RezaYazdaniAminabadi merged 5 commits intostaging-zero-dual-v3from

reza/fix_adam_perf

Sep 6, 2020

Commits on Sep 6, 2020

fixing corner cases
Reza Yazdani
committed
revert to the previous perf for adam
Reza Yazdani
committed
adam high performance
Reza Yazdani
committed
merging
Reza Yazdani
committed
run precommit
Reza Yazdani
committed