Skip to content

[CUDAGraph] GPT3-175B Pipeline Parallel Training with CUDAGraph using PipelineParallelMicroStepCallback #65634

Merged
ForFishes merged 5 commits intoPaddlePaddle:developfrom
eee4017:cudagraph_175b_github_submit
Jul 29, 2024
Merged

[CUDAGraph] GPT3-175B Pipeline Parallel Training with CUDAGraph using PipelineParallelMicroStepCallback #65634
ForFishes merged 5 commits intoPaddlePaddle:developfrom
eee4017:cudagraph_175b_github_submit

Commits

Commits on Jul 24, 2024