fix(mfsdp): support fsdp v2 zero-1 and zero-2 - #10

Merged

shjwudp merged 14 commits into

shjwudp:mfsdp_refactor_main_stage2from

Autumn1998:tongliu/fsdp-v2-mixed-precision

May 29, 2026

Commits on May 25, 2026

fix(mfsdp): support fsdp v2 zero-1 and zero-2
Autumn1998
committed
6b23d34
Merge remote-tracking branch 'origin/mfsdp_refactor_main_stage2' into develop/mfsdp-refactor-main-stage2
Autumn1998
committed
434fa2e

Commits on May 26, 2026

Commits on May 27, 2026

Fix FSDP v2 ZeRO-1/2 grad sync
Autumn1998
committed
3664634
refactor(mfsdp): merge FSDP v2 grad sync traversal
Autumn1998
committed
d072fbf
docs(mfsdp): align FSDP v2 grad sync docs
Autumn1998
committed
54ef471

Commits on May 28, 2026

Refactor FSDP v2 unshard and reduce_grad
Autumn1998
committed
00507fd
Refine FSDP v2 replicated buffer refresh
Autumn1998
committed
123d7f9

Commits on May 29, 2026

Fix FSDP v2 async grad install
Autumn1998
committed
090e26e
Merge mfsdp_refactor_main_stage2 into PR branch
Autumn1998
committed
152802f
Allow FSDP v2 ZeRO-1 and ZeRO-2 strategies
Autumn1998
committed
1670574