General scaling policy for HP transfer + Depth MuP recipe - #4381

Open

plugyawn wants to merge 28 commits into

NVIDIA:mainfrom

plugyawn:feature/scaling-transfer

Commits on May 11, 2026

Introduce canonical scaling recipe scaffold
plugyawn
committed
78da6b6
Route model scaling through resolved policy
plugyawn
committed
0656111
Route optimizer scaling through training policy
plugyawn
committed
f43cbec
Clean up remaining internal MuP runtime branches
plugyawn
committed
4218004
Scale BERT and T5 MuP logits on all paths
plugyawn
committed
28e335e
Add depth_mup recipe surface
plugyawn
committed
e030495
Tighten depth_mup surface validation
plugyawn
committed
a5335d7
Finalize depth_mup recipe contract
plugyawn
committed
3b8a3cd
Harden depth_mup validation and Muon scalar routing
plugyawn
committed
d1eb05b
Stabilize Muon-to-Lion regression coverage
plugyawn
committed
7fd894e
Make scaling-policy regression tests backend-agnostic
plugyawn
committed
0dbe937
Stabilize model-level scaling policy tests
plugyawn
committed
fb714b8
Make model parity tests single-node tolerant
plugyawn
committed
4d9d40c
Narrow unsupported MLA scaling scope
plugyawn
committed
fc58dfe
Tighten depth_mup claim wording
plugyawn
committed
822adfc
Align depth_mup with spectral AdamW recipe
plugyawn
committed
7f5b29b
Preserve Adam optimizer surface for depth_mup
plugyawn
committed
4f36e8e
Allow validation-only depth_mup evaluation
plugyawn
committed
953892b
Deprecate legacy MuP CLI aliases
plugyawn
committed
b1829ad
Enforce depth_mup AdamW weight decay
plugyawn
committed
1e547cf
Refine depth_mup vector weight decay roles
plugyawn
committed
42d9582
Fix depth_mup resume and YAML compatibility
plugyawn
committed
f1840d7
Clarify scaling recipe design contract
plugyawn
committed
39aa856
Split scaling recipe docs by audience
plugyawn
committed
05b1f09
Apply post-rebase autoformat
plugyawn
committed
7647593
Default missing YAML batch schedule field
plugyawn
committed
f8641df
Merge branch 'main' into feature/scaling-transfer
plugyawn
authored
7caebc1

Commits on May 12, 2026

Merge branch 'main' into feature/scaling-transfer
plugyawn
authored
ae8a45c

Navigation Menu

Uh oh!

General scaling policy for HP transfer + Depth MuP recipe - #4381

General scaling policy for HP transfer + Depth MuP recipe#4381
plugyawn wants to merge 28 commits into
NVIDIA:mainfrom
plugyawn:feature/scaling-transfer

Commits on May 11, 2026

Introduce canonical scaling recipe scaffold

Route model scaling through resolved policy

Route optimizer scaling through training policy

Clean up remaining internal MuP runtime branches

Scale BERT and T5 MuP logits on all paths

Add depth_mup recipe surface

Tighten depth_mup surface validation

Finalize depth_mup recipe contract

Harden depth_mup validation and Muon scalar routing

Stabilize Muon-to-Lion regression coverage

Make scaling-policy regression tests backend-agnostic

Stabilize model-level scaling policy tests

Make model parity tests single-node tolerant

Narrow unsupported MLA scaling scope

Tighten depth_mup claim wording

Align depth_mup with spectral AdamW recipe

Preserve Adam optimizer surface for depth_mup

Allow validation-only depth_mup evaluation

Deprecate legacy MuP CLI aliases

Enforce depth_mup AdamW weight decay

Refine depth_mup vector weight decay roles

Fix depth_mup resume and YAML compatibility

Clarify scaling recipe design contract

Split scaling recipe docs by audience

Apply post-rebase autoformat

Default missing YAML batch schedule field

Merge branch 'main' into feature/scaling-transfer

Commits on May 12, 2026

Merge branch 'main' into feature/scaling-transfer