Skip to content

[1/N] Megatron FSDP: Introduce Megatron-FSDP2 with per-module fully_shard() API - #4435

Closed
shjwudp wants to merge 42 commits into
NVIDIA:mainfrom
shjwudp:mfsdp_refactor_main
Closed

[1/N] Megatron FSDP: Introduce Megatron-FSDP2 with per-module fully_shard() API#4435
shjwudp wants to merge 42 commits into
NVIDIA:mainfrom
shjwudp:mfsdp_refactor_main

revert ddp_config & megatron_fsdp.py

694c09d
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.