[4/4] Hyperparameter Transfer across Muon and preconditioned optimizers. - #5000

Draft

plugyawn wants to merge 25 commits into

NVIDIA:mainfrom

plugyawn:feature/muon-spectral-mup

Commits on May 15, 2026

Commits on May 16, 2026

Test stable optimizer group resume matching
plugyawn
committed
4aecae6
Default missing optimizer group identifiers
plugyawn
committed
274a4c6
Merge branch 'main' into feature/scaling-policy-infra
plugyawn
authored
aad8b8d

Commits on May 21, 2026

Merge branch 'main' into feature/scaling-policy-infra
plugyawn
authored
dcac36a

Commits on May 27, 2026

Remove PR sequencing references from scaling policy docs
plugyawn
committed
762c4bf
Merge remote-tracking branch 'upstream/main' into feature/scaling-policy-infra
plugyawn
committed
8ced307
Rename scaling policy infrastructure objects
plugyawn
committed
5683740
Run autoformatter on scaling policy infra
plugyawn
committed
9e801db
Add canonical width-MuP scaling context
plugyawn
committed
10c13dc
Compare checkpoint scaling by resolved context
plugyawn
committed
1b7ec22
Document and test canonical width-MuP
plugyawn
committed
e5e92b1
Reset absent checkpoint scaling args
plugyawn
committed
8191ade
Add depth-MuP config and validation
plugyawn
committed
49763fb
Apply depth-MuP model and runtime scaling
plugyawn
committed
24d04b8
Add depth-MuP optimizer policy
plugyawn
committed
14cea49
Document and test depth-MuP
plugyawn
committed
e0e4884
Fix depth-MuP resume and vector weight decay
plugyawn
committed
b2c303b
Test depth optimizer identifier defaults
plugyawn
committed
ef280a9
Validate Muon scalar optimizer selection
plugyawn
committed
f50fad7
Route Muon scalar params through configured optimizer
plugyawn
committed
2c89a6e
Document and test Muon spectral-MuP interaction
plugyawn
committed
15fb60a