Perf: skip per-param copy_ dispatch in the MXFP8 param copy-back - #6094

Perf: skip per-param copy_ dispatch in the MXFP8 param copy-back#6094

fanshiqing merged 2 commits into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

fanshiqing:shiqingf/gpt_fp8_param_reduce_fwd_cast_overaheadfanshiqing/Megatron-LM:shiqingf/gpt_fp8_param_reduce_fwd_cast_overaheadCopy head branch name to clipboard