Skip to content

Add support of tp_size != WORLD_SIZE to bloom#428

Merged
regisss merged 2 commits into
huggingface:mainfrom
NirSonnenschein:inference_tp_size_issue
Oct 23, 2023
Merged

Add support of tp_size != WORLD_SIZE to bloom#428
regisss merged 2 commits into
huggingface:mainfrom
NirSonnenschein:inference_tp_size_issue

Commits

Commits on Oct 18, 2023

Commits on Oct 23, 2023