[dev] [DeepSeek-v4] Part 3: MTP support with mHC and new mHC contract - #4518

Merged

hxbai merged 17 commits into

May 14, 2026

Commits on May 14, 2026

MTP support with mHC; new mHC contract
hxbai
committed
25ad602
minor fix
hxbai
committed
2f363ae
fix new contract dtype
hxbai
committed
0c99d96
format and add tests
hxbai
committed
5b27dc9
fix mscale

yuzhongw-nvidia
authored and
hxbai
committed
ecfb6f3
fix state_dict
hxbai
committed
e1fc689
fix eps in learned_output_contract
hxbai
committed
6d80f37
fix tests
hxbai
committed
c7adacb
add yarn arg original-max-position-embeddings
hxbai
committed
61f71c8
fix mtp spec; add tflops calc
hxbai
committed
e9f95e3
add functional test
hxbai
committed
8664bd9
fix test
hxbai
committed
4ace391
fix test config
hxbai
committed
ffb96e9
fix indexer loss logging; fix ckpt
hxbai
committed
8e4f78c
add swiglu clamp to shared expert
hxbai
committed
9d2fcd6
fix test
hxbai
committed
44e12b1
update golden values due to new mhc contract
hxbai
committed
60ff377