Increase Megatron-FSDP overlap test dim to 8192 for reliable overlap - #5770

Increase Megatron-FSDP overlap test dim to 8192 for reliable overlap#5770

wujingyue merged 1 commit into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

wujingyue:mfsdp-overlap-test-dimwujingyue/Megatron-LM:mfsdp-overlap-test-dimCopy head branch name to clipboard