Merge#1

Merged

yhna940 merged 10 commits intofeature/zero3from

feature/zero3-merge

Apr 18, 2023

Commits on Mar 24, 2023

import ParallelMode (#166)
bzantium
authored

Commits on Mar 28, 2023

Commits on Mar 30, 2023

Add restarting model from saved model and fix bug (#171)
tree-park
authored
Make decoder-only models to be able to generate with `inputs_embeds` (#172)
ingyuseong
authored

Commits on Apr 5, 2023

Wrong import in zero (#169)
jinwonkim93
authored

Commits on Apr 13, 2023

[Fix] Support gradient accumulation for DDP (#173)
KKIEEK
authored

Commits on Apr 17, 2023

[Fix] minor bug for single output in _DistributedDataParallel (#177)
yhna940
authored

Commits on Apr 18, 2023