[moe training] fix scaling type bug; refactor distributed tests#2749

danielvegamyhre merged 1 commit intomainpytorch/ao:mainfrom

danielvegamyhre/stack/35pytorch/ao:danielvegamyhre/stack/35Copy head branch name to clipboard