Skip to content

[Dev] Fix mis-set decoupled gradient for Megatron-FSDP. - #4426

Merged
cspades merged 2 commits into
NVIDIA:devfrom
cspades:cye/mfsdp-decgrad-segfault-dev
Apr 25, 2026
Merged

[Dev] Fix mis-set decoupled gradient for Megatron-FSDP.#4426
cspades merged 2 commits into
NVIDIA:devfrom
cspades:cye/mfsdp-decgrad-segfault-dev

Add more tests catching the mis-placed gradient and FusedAdam(use_dec…

aba018e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.