Improve distributed training setup#13

chrisbraddock wants to merge 1 commit intomainchrisbraddock/gpu-tune:mainfrom

codex/replace-dataparallel-with-distributeddataparallelchrisbraddock/gpu-tune:codex/replace-dataparallel-with-distributeddataparallelCopy head branch name to clipboard