General handling of issues related to FSDP parameter ‘to’ and ‘cpu’ f…#1

kunlunl merged 1 commit intokunlunl:kunlunl/megatron-fsdp-fp8-paramskunlunl/Megatron-LM:kunlunl/megatron-fsdp-fp8-paramsfrom

shjwudp:mfsdp_mxfp8_gather_patch_nov13shjwudp/Megatron-LM:mfsdp_mxfp8_gather_patch_nov13Copy head branch name to clipboard