[moe training] update tests and benchmarks for torchtitan moe refactor#2718

danielvegamyhre wants to merge 1 commit intomainpytorch/ao:mainfrom

refacpytorch/ao:refacCopy head branch name to clipboard