This repository was archived by the owner on Nov 17, 2023. It is now read-only.

[mxnet 2.0][item 4.11] Gluon Distributed Training Usability Enhancement #17111

Closed

eric-haibin-lin opened this issue Dec 18, 2019 · 1 comment

Assignees

Labels

Feature request

Member

eric-haibin-lin commented Dec 18, 2019 •

edited

Loading

Scope:

~~more flexibility for communication with kvstore UDFs~~
add distribution strategies to estimator
plugin for communication backends (horovod, byteps, parameter server) for data parallel training
data sharding/sampling/streaming enhancement for distributed training
better documentation for new users

eric-haibin-lin added the Feature request label

Member Author

eric-haibin-lin commented Dec 18, 2019

RFC for 3: [RFC] Unified API for Distributed Data Parallel Training #16795
Initial PR for the plugin interface: [API] unified API for custom kvstores #17010

eric-haibin-lin self-assigned this

apeforest mentioned this issue

Integrate Horovod training API as part of MXNet native distributed training API #17531

Merged

szha closed this as completed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.