Skip to content

Fix Megatron-FSDP GDN optimizer checkpoint metadata for FSDP DTensor - #2

Open
conver334 wants to merge 5 commits into
wplf:jinliang/fix-mfsdp-optimizer-offloadfrom
conver334:codex/fsdp-dtensor-explicit-metadata
Open

Fix Megatron-FSDP GDN optimizer checkpoint metadata for FSDP DTensor#2
conver334 wants to merge 5 commits into
wplf:jinliang/fix-mfsdp-optimizer-offloadfrom
conver334:codex/fsdp-dtensor-explicit-metadata

Fix Megatron-FSDP DTensor checkpoint reload

171a880
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs