-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Distributed unit tests. #4
Labels
enhancement
New feature or request
Comments
This is addressed by PR #6. |
Merged
Complete |
rraminen
pushed a commit
to rraminen/DeepSpeed
that referenced
this issue
Apr 28, 2021
liamcli
pushed a commit
to determined-ai/DeepSpeed
that referenced
this issue
Sep 27, 2021
Merge latest changes from DeepSpeed
delock
referenced
this issue
in delock/DeepSpeedSYCLSupport
Sep 21, 2022
…t#60) commit a8c119455d2ab3e58f9f6714f023fa0c0c0be817 (HEAD -> xpu-main, origin/xpu-main, origin/HEAD) Author: Guo Yejun <[email protected]> Date: Thu Jul 21 01:18:39 2022 -0700 add locate data commit 79ee62539d76c3fefd5b1277b46077217eed71c7 Author: Liangliang-Ma <[email protected]> Date: Fri Aug 26 17:12:26 2022 +0800 megatron with zero offload scripts (#6) commit 38cb62ae4a8b468f27e3dddf929e3e53d302bb44 Author: Guo Yejun <[email protected]> Date: Fri Aug 19 08:32:34 2022 -0700 ds_zero2_config_bf16.json&gpt-3.6b.sh: update bs per tile from 1 to 8 commit 65e6bb5e33d5a1244ce665b826f278244f5d0790 Author: Guo Yejun <[email protected]> Date: Tue Aug 2 20:49:38 2022 +0800 ds_zero2_config_bf16.json: use the correct option flops_profiler (#4)
jeffra
added a commit
that referenced
this issue
Nov 9, 2022
Co-authored-by: cmikeh2 <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
DeepSpeed needs an easy way to write distributed, multi-GPU unit tests.
The text was updated successfully, but these errors were encountered: