[feat] FSDP support for HybridStack EP-overlap (3/4 of #4798) - #4943

Draft

Connor-XY wants to merge 11 commits into

NVIDIA:mainfrom

Connor-XY:pr4798-3-fsdp-hybrid

Commits on Jul 28, 2026

[feat] HybridStack grouped syntax + checkpoint compat + EP-overlap

Connor-XY
and
claude
committed
ba1e5c0
[fix] Drop redundant pre_mlp_layernorm recompute hook in moe_combine

Connor-XY
and
claude
committed
baa7256
fix(hybrid): add missing enumerate index in HybridStack layer-build loop

committed
dbcf0cb
fix: apply black formatting to hybrid callables
Connor-XY
committed
b567967
fix(hybrid): preserve MTP postprocess state
Connor-XY
committed
0004229
Fix grouped hybrid review issues
Connor-XY
committed
f5796d0
Fix grouped hybrid unit test failures
Connor-XY
committed
2c75fea
Address review: scope hybrid checkpoint key rename, honor output_processor
Connor-XY
committed
de0edd4
Opt directly-constructed grouped HybridStack into transformer keys
Connor-XY
committed
6b3772f
[feat] FSDP support for HybridStack EP-overlap

Connor-XY
and
claude
committed
343e029
fix(mtp): detach mtp_hidden_states chunks at chunk_state boundary

committed
bc5a0f7