Fix layer-wise distributed optimizer MXFP8 wgrad failure by padding per-param start - #4889
Closed
Wohox wants to merge 2 commits into
Closed
Fix layer-wise distributed optimizer MXFP8 wgrad failure by padding per-param start#4889Wohox wants to merge 2 commits into
Wohox wants to merge 2 commits into
background
wait
wait-all
cancel
parallel
Loading