Skip to content

Commit

Permalink
Add note
Browse files Browse the repository at this point in the history
  • Loading branch information
SeanNaren committed Feb 17, 2021
1 parent f789b77 commit 31d6267
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/source/advanced/multi_gpu.rst
Original file line number Diff line number Diff line change
Expand Up @@ -707,6 +707,7 @@ Additionally if you run into any issues installing m4py, ensure you have openmpi

.. note::
Currently ``resume_from_checkpoint`` and manual optimization are not supported.

DeepSpeed only supports single optimizer, single scheduler.

ZeRO-Offload
Expand Down

0 comments on commit 31d6267

Please sign in to comment.