Fix random token-generation issue + MP-checkpoint loading/saving#2132

Merged

jeffra merged 29 commits intomasterfrom

ds-inference/bloom-fix

Jul 29, 2022

Commits on Jul 25, 2022

Fix random token-generation issue + MP-checkpoint loading/saving
Reza Yazdani
committed
Merge branch 'master' into ds-inference/bloom-fix
RezaYazdaniAminabadi
authored
small fix
Reza Yazdani
committed
Merge branch 'master' into ds-inference/bloom-fix
jeffra
authored

Commits on Jul 26, 2022

get the path for saving mp-checkpoints
Reza Yazdani
committed
Merge branch 'ds-inference/bloom-fix' of github.com:microsoft/DeepSpeed into ds-inference/bloom-fix
Reza Yazdani
committed
Merge branch 'master' into ds-inference/bloom-fix
jeffra
authored
bug fix + formatting
jeffra
committed
fix save_checkpoint path
Reza Yazdani
committed
Merge branch 'ds-inference/bloom-fix' of github.com:microsoft/DeepSpeed into ds-inference/bloom-fix
Reza Yazdani
committed
Merge branch 'master' into ds-inference/bloom-fix
RezaYazdaniAminabadi
authored
Merge branch 'master' into ds-inference/bloom-fix
jeffra
authored

Commits on Jul 27, 2022

Commits on Jul 28, 2022

Modify checkpoint saving to include the config json used during loading
Reza Yazdani
committed
git pushMerge branch 'ds-inference/bloom-fix' of github.com:microsoft/DeepSpeed into ds-inference/bloom-fix
Reza Yazdani
committed
set ckpt_mp_size to world_size by default
Reza Yazdani
committed
add missing None
Reza Yazdani
committed
small fix: change None -> 0
Reza Yazdani
committed
Merge branch 'master' into ds-inference/bloom-fix
RezaYazdaniAminabadi
authored
fix indentation
Reza Yazdani
committed
several fixes
Reza Yazdani
committed
support checkpoint as dict or json file
jeffra
committed
fix for non-bloom models
jeffra
committed
add default if parallelization doesn't exist
jeffra
committed
fix the path to save non-tp checkpoint
Reza Yazdani
committed
Merge branch 'ds-inference/bloom-fix' of github.com:microsoft/DeepSpeed into ds-inference/bloom-fix
Reza Yazdani
committed

Commits on Jul 29, 2022

Merge branch 'master' into ds-inference/bloom-fix
jeffra
authored