Add unit tests for GDP inference - #6505

Merged

santhnm2 merged 25 commits into

NVIDIA:mainfrom

santhnm2:gdp_inference_unit_tests

Aug 13, 2026

Commits on Aug 10, 2026

Add gated delta product (GDP) mixer and spec (#45)

authored and
santhnm2
committed
d025a7f
Skip Muon on GDP's inproj matrix (#119)

authored and
santhnm2
committed
299c118
Fix GDP checkpoint resharding across TP sizes

deepakn94
authored and
santhnm2
committed
a3feea2
Add GDP dynamic inference support

deepakn94
authored and
santhnm2
committed
d669b4a
Add inter-document masking (packed sequence) support to GDP training path

deepakn94
authored and
santhnm2
committed
210ae41
Tag GDP packed parameters for refit

root
authored and
santhnm2
committed
02a7cf9
Fail fast on invalid module specs

devnkong
authored and
santhnm2
committed
c3af950
Fix GDP mixer module naming

devnkong
authored and
santhnm2
committed
e2c8855
Update FLOPs calculation to account for GDP

rogerwaleffe
authored and
santhnm2
committed
9c4f6de
fix(optimizer): skip Muon for Mamba input projection

devnkong
authored and
santhnm2
committed
0e95267
chore: add missing GDP test copyright header

devnkong
authored and
santhnm2
committed
f286a4c
chore: apply PR formatting fixes

devnkong
authored and
santhnm2
committed
2feb52b
refactor(ssm): rename packed sequence helper module

devnkong
authored and
santhnm2
committed
2fe04d6
docs(ssm): describe gated delta product mixer

devnkong
authored and
santhnm2
committed
20d9d5b
refactor(ssm): remove unused GDP constructor arguments

devnkong
authored and
santhnm2
committed
fe926f0
fix(ssm): configure GDP Householder reflections

devnkong
authored and
santhnm2
committed
0d03d60
perf(ssm): avoid packed sequence host sync

devnkong
authored and
santhnm2
committed
0ceca77
refactor(ssm): name GDP mixer submodules explicitly

devnkong
authored and
santhnm2
committed
cd15964
test(models): update hybrid MoE config golden

devnkong
authored and
santhnm2
committed
25386da
Linting
santhnm2
committed
6878aeb
Merge with main
santhnm2
committed
2483de0
refactor(ssm): move GDP dynamic inference onto the shared SSM interface
santhnm2
committed
052282e

Commits on Aug 11, 2026

Merge remote-tracking branch 'upstream/main' into gdp_common_interface
santhnm2
committed
b0280ab
Add GDP inference unit tests
santhnm2
committed
3b8a54f

Commits on Aug 13, 2026

Merge remote-tracking branch 'upstream/main' into gdp_inference_unit_tests
santhnm2
committed
02dc028