Followup PR for adding generation-server#339

Merged

mayank31398 merged 8 commits intomainfrom

mayank/generation-server

Sep 11, 2022

Commits on Sep 1, 2022

fix grpc

Mayank Mishra
authored and
Mayank Mishra
committed

Commits on Sep 2, 2022

use functools.partial

Mayank Mishra
authored and
Mayank Mishra
committed

Commits on Sep 3, 2022

fix ds-inference server

Mayank Mishra
authored and
Mayank Mishra
committed
add support for int8 in the future

Mayank Mishra
authored and
Mayank Mishra
committed

Commits on Sep 11, 2022

bug fix

Mayank Mishra
authored and
Mayank Mishra
committed
update README

Mayank Mishra
authored and
Mayank Mishra
committed
fix

Mayank Mishra
authored and
Mayank Mishra
committed
Merge branch 'main' of https://github.com/bigscience-workshop/Megatron-DeepSpeed into mayank/generation-server

Mayank Mishra
authored and
Mayank Mishra
committed