Introduce GDN to Mamba - #3535

Merged

Phlip79 merged 25 commits into

NVIDIA:mainfrom

Phlip79:philip/mamba-gdn

Mar 23, 2026

Commits on Feb 23, 2026

Introduce GDN to Mamba
Phlip79
committed
acc49e7

Commits on Feb 25, 2026

Fix linting
Phlip79
committed
2fb3d8d
Fix import order
Phlip79
committed
a2cfc0e

Commits on Feb 27, 2026

Merge branch 'main' of https://github.com/NVIDIA/Megatron-LM into philip/mamba-gdn
Phlip79
committed
4057f9c
Fix GDN layer building to use new layer_number and pp_layer_offset API

Phlip79
and
claude
committed
6b9a8f7

Commits on Mar 2, 2026

Remove pp_layer_offset
Phlip79
committed
699d6ca
Moved GDN symbol
Phlip79
committed
9676905
Cleanup a few things
Phlip79
committed
2735952

Commits on Mar 3, 2026

Update various files for GDN
Phlip79
committed
7487e4f
Removed is_mtp_layer and add_layer_offset flags from GDN layer
Phlip79
committed
28fb4e9
Change ordering of layers for Mamba
Phlip79
committed
bb3d3ca
Another re-ordering
Phlip79
committed
ba1f00d
Merge branch 'main' of https://github.com/NVIDIA/Megatron-LM into philip/mamba-gdn
Phlip79
committed
44f34b0
Fix linting errors
Phlip79
committed
3912e10
Merge branch 'main' of https://github.com/NVIDIA/Megatron-LM into philip/mamba-gdn
Phlip79
committed
e037c2e

Commits on Mar 10, 2026

Commits on Mar 11, 2026

Commits on Mar 12, 2026

Merge branch 'main' of https://github.com/NVIDIA/Megatron-LM into philip/mamba-gdn
Phlip79
committed
a48b54f

Commits on Mar 16, 2026

Merge branch 'main' of https://github.com/NVIDIA/Megatron-LM into philip/mamba-gdn
Phlip79
committed
133ce82

Commits on Mar 17, 2026

Remove GDN from inference as it's not supported
Phlip79
committed
bd9317e

Commits on Mar 20, 2026

Merge branch 'main' into philip/mamba-gdn
Phlip79
authored
5a5e206

Commits on Mar 22, 2026

Merge branch 'main' into philip/mamba-gdn
Phlip79
authored
cb665a7