BLOOM Inference via DeepSpeed-Inference, Accelerate and DeepSpeed-ZeRO#308

Merged

stas00 merged 58 commits intomainfrom

bloom-inference

Aug 10, 2022

Commits on Jul 11, 2022

fixes
stas00
committed
fix
stas00
committed

Commits on Jul 12, 2022

Commits on Jul 13, 2022

fix for offline use
stas00
committed
add benchmark
stas00
committed
add benchmark
stas00
committed
update
stas00
committed
cleanup
stas00
committed
update
stas00
committed
msecs
stas00
committed
cleanup
stas00
committed
improve
stas00
committed
fix benchmark, add warmup
stas00
committed
update
stas00
committed
fix; thanks Michael Wyatt
stas00
committed
clarify
stas00
committed
Merge branch 'bloom-inference' of https://github.com/bigscience-workshop/Megatron-DeepSpeed into bloom-inference
Reza Yazdani
committed
add bloom batch-inference script
Reza Yazdani
committed
removed the names :-)
Reza Yazdani
committed
fold the bs functionality from the other script
stas00
committed
fix
stas00
committed
restore do_sample
stas00
committed
dump generate args
stas00
committed

Commits on Jul 14, 2022

Commits on Jul 15, 2022

Commits on Jul 16, 2022

wip
stas00
committed
wip
stas00
committed

Commits on Jul 18, 2022

stats
stas00
committed

Commits on Jul 20, 2022

bug fix
stas00
committed
update
stas00
committed

Commits on Jul 22, 2022

update
stas00
committed

Commits on Aug 9, 2022