[DO NOT MERGE] Upstream feb 26 - #15

Draft

guapisolo wants to merge 9 commits into

radixark:miles-mainfrom

guapisolo:upstream_feb_26

Commits on Mar 2, 2026

[1/8] fix: misc compatibility fixes for PyTorch and TE (#2)

authored and
guapisolo
committed
9ca7af6
[2/8] feat: support partial checkpoint loading (#3)

authored and
guapisolo
committed
307390e
[3/8] feat: add post-attention and post-MLP layernorm support (#4)

yueming-yuan
authored and
guapisolo
committed
4cef384
[4/8] fix: MLA RoPE triton kernel head indexing and v_dim=0 support (#5)

authored and
guapisolo
committed
470b592
[5/8] feat: support MTP training in RL (#6)

authored and
guapisolo
committed
e970a6f
[6/8] feat: support rollout routing replay (R3) and bypass for MTP layers (#10)

guapisolo
and
yueming-yuan
committed
db61536
[7/8] feat: add INT4 fake QAT for MoE grouped linear (#9)

authored and
guapisolo
committed
bd0b03b
[8/8] fix: CUDA IPC incompatibility from Megatron bump (#11)

guapisolo
and
claude
committed
8900933
fix: dp_reshardable checkpoint backward compat in Megatron core

guapisolo
and
claude
committed
d08ead7