Skip to content

Commit

Permalink
Revert "comment out PipelineMixedPrecisionPlugin to fix conversion er…
Browse files Browse the repository at this point in the history
…ror"

This reverts commit 0fc8241.
  • Loading branch information
xingyaoww committed Apr 16, 2024
1 parent 02a981d commit d7debba
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -178,8 +178,8 @@ def convert(args):

if nemo_config.get('megatron_amp_O2', False):
plugins.append(MegatronHalfPrecisionPlugin(precision=plugin_precision, device='cuda', scaler=scaler))
# else:
# plugins.append(PipelineMixedPrecisionPlugin(precision=plugin_precision, device='cuda', scaler=scaler))
else:
plugins.append(PipelineMixedPrecisionPlugin(precision=plugin_precision, device='cuda', scaler=scaler))

if precision == 32:
dtype = torch.float32
Expand Down

0 comments on commit d7debba

Please sign in to comment.