From 9889cd930dbc1968ef5f6499fe63fd9bb5e97d52 Mon Sep 17 00:00:00 2001 From: Jeff Rasley Date: Fri, 23 Sep 2022 11:51:12 -0700 Subject: [PATCH] fix zero docs --- docs/_pages/config-json.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/_pages/config-json.md b/docs/_pages/config-json.md index 423dc5f85d23..0d049b57c6a2 100755 --- a/docs/_pages/config-json.md +++ b/docs/_pages/config-json.md @@ -373,7 +373,7 @@ Enabling and configuring ZeRO memory optimizations | Description | Default | | --------------------------------------------------------------------------------------------------------- | ------- | -| Enable ZeRO memory optimization wrapper for FP16 Training. Currently compatible only with Adam optimizer. | `false` | +| Enable ZeRO memory optimizations, compatible with FP16/BF16/FP32 and the Adam optimizer. | `false` | **stage**: [integer]