add OnDevice and remove zero-inference#316

stas00 merged 1 commit intobloom-inferencebigscience-workshop/Megatron-DeepSpeed:bloom-inferencefrom

bloom-inference-w-metabigscience-workshop/Megatron-DeepSpeed:bloom-inference-w-metaCopy head branch name to clipboard