APAM: Parallel and distributed asynchronous adaptive stochastic gradient methods

This repository contains C++-MPI/C++-OpenMP/Python-MP4PY implementations of APAM (Xu et al. 2020).

Reference

• Yangyang Xu, Yibo Xu, Yonggui Yan, Colin Sutcher-Shepard, Leopold Grinberg, and Jie Chen. Parallel and distributed asynchronous adaptive stochastic gradient methods. Preprint arXiv:2002.09095, 2020.