[FSDP2] Cast model to uniform dtype before fully_shard to fix mixed-dtype AssertionError#3985

SunMarc merged 5 commits into

huggingface:mainhuggingface/accelerate:mainfrom

roycho96:fix/mixed-precisionroycho96/accelerate:fix/mixed-precisionCopy head branch name to clipboard