[draft] support async param gather in layer-wise optimizer - #2787

[draft] support async param gather in layer-wise optimizer#2787

FDecaYed wants to merge 1 commit into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

FDecaYed:deyuf/layerwise_async_gatherFDecaYed/Megatron-LM:deyuf/layerwise_async_gatherCopy head branch name to clipboard