Enable ZeRO tests for CI, fix to/half function calls for LightningDistributedWrapper#6070

Merged

Borda merged 20 commits intomasterfrom fix/enable_zero_fix_dtype

Feb 21, 2021

+88-23

Commits on Feb 18, 2021

Enable ZeRO optimization, and make sure that the lightning module hook is called when we move to half precision
SeanNaren
committed
Added test, update to function
SeanNaren
committed

Commits on Feb 19, 2021

Use device type mixin
SeanNaren
committed
Add precision
SeanNaren
committed
Turn off zero for checking optimizers are correct
SeanNaren
committed
Remove import
SeanNaren
committed
Use FP16 Wrapper
SeanNaren
committed
Merge branch 'master' into fix/enable_zero_fix_dtype
SeanNaren
committed
Move mixin to the base class
SeanNaren
committed
Better name for the test, test precision move
SeanNaren
committed
Added CHANGELOG.md
SeanNaren
committed
Revert "Added CHANGELOG.md"
SeanNaren
committed
Move precision check into a separate test that requires cuda
SeanNaren
committed
Merge branch 'master' into fix/enable_zero_fix_dtype
SeanNaren
committed
Provide ZeRO config
SeanNaren
committed
Revert "Revert "Added CHANGELOG.md""
SeanNaren
committed
Support torch device as input to cuda, as is with upstream pytorch
SeanNaren
committed

Commits on Feb 20, 2021

Modify test to include all possible cuda variations
SeanNaren
committed
Merge branch 'master' into fix/enable_zero_fix_dtype
SeanNaren
committed
Trigger Build
SeanNaren
committed