File tree 1 file changed +5
-1
lines changed
1 file changed +5
-1
lines changed Original file line number Diff line number Diff line change @@ -57,15 +57,19 @@ DS_BUILD_FUSED_LAMB=1 pip install deepspeed
57
57
58
58
Available ` DS_BUILD ` options include:
59
59
* ` DS_BUILD_OPS ` toggles all ops
60
+ * ` DS_BUILD_AIO ` builds asynchronous (NVMe) I/O op
61
+ * ` DS_BUILD_CCL_COMM ` builds the communication collective libs
60
62
* ` DS_BUILD_CPU_ADAM ` builds the CPUAdam op
61
63
* ` DS_BUILD_FUSED_ADAM ` builds the FusedAdam op (from [ apex] ( https://github.com/NVIDIA/apex ) )
64
+ * ` DS_BUILD_CPU_ADAGRAD ` builds the CPUAdagrad op
62
65
* ` DS_BUILD_FUSED_LAMB ` builds the FusedLamb op
66
+ * ` DS_BUILD_QUANTIZER ` builds the quantizer op
67
+ * ` DS_BUILD_RANDOM_LTD ` builds the random ltd op
63
68
* ` DS_BUILD_SPARSE_ATTN ` builds the sparse attention op
64
69
* ` DS_BUILD_TRANSFORMER ` builds the transformer op
65
70
* ` DS_BUILD_TRANSFORMER_INFERENCE ` builds the transformer-inference op
66
71
* ` DS_BUILD_STOCHASTIC_TRANSFORMER ` builds the stochastic transformer op
67
72
* ` DS_BUILD_UTILS ` builds various optimized utilities
68
- * ` DS_BUILD_AIO ` builds asynchronous (NVMe) I/O op
69
73
70
74
To speed up the build-all process, you can parallelize the compilation process with:
71
75
You can’t perform that action at this time.
0 commit comments