Add single-process checkpoint save to avoid forked multiprocessing#3424

sbak5 merged 2 commits intoNVIDIA:mainNVIDIA/Megatron-LM:mainfrom

sbak5:sbak/seq_async_savesbak5/Megatron-LM:sbak/seq_async_saveCopy head branch name to clipboard