support auto parallel in dit and largedit#551

Merged

nemonameless merged 35 commits intoPaddlePaddle:developfrom jeff41404:add_auto_parallel_in_dit

Oct 10, 2024

+2,554-8

Commits on May 23, 2024

Commits on May 27, 2024

fix import error
jeff41404
committed

Commits on May 30, 2024

fix issue of flatten
jeff41404
committed

Commits on Jun 3, 2024

use transpose instead of einsum to work around issue of spmd of einsum_grad
jeff41404
committed

Commits on Jun 5, 2024

fix issue of incorrectly shard adaln_input and rope
jeff41404
committed

Commits on Jun 6, 2024

fix bug
jeff41404
committed

Commits on Jun 17, 2024

delete print
jeff41404
committed

Commits on Jun 20, 2024

fix printing issues and clean up useless code
jeff41404
committed

Commits on Jun 24, 2024

add infrastructure of pipeline parallel and dynamic to static
jeff41404
committed

Commits on Jun 26, 2024

fix the issues that block dynamic to static operation
jeff41404
committed

Commits on Aug 15, 2024

Merge branch 'develop' into add_auto_parallel_in_dit
jeff41404
authored

Commits on Sep 13, 2024

Commits on Sep 14, 2024

temporarily remove modifications to ppdiffusers/ppdiffusers/models
jeff41404
committed

Commits on Sep 19, 2024

Merge branch 'develop' into add_auto_parallel_in_dit
jerrywgz
authored

Commits on Sep 23, 2024

Commits on Sep 24, 2024

Commits on Sep 25, 2024

set use_fused_rms_norm to true
jeff41404
committed

Commits on Sep 26, 2024

Merge branch 'develop' into add_auto_parallel_in_dit
jeff41404
authored

Commits on Sep 27, 2024

clean up annotations and debug print information, remove _extract_into_shardtensor
jeff41404
committed

Commits on Sep 29, 2024

Merge branch 'develop' into add_auto_parallel_in_dit
jeff41404
authored

Commits on Oct 8, 2024

Commits on Oct 9, 2024

Commits on Oct 10, 2024