[dev] [DeepSeek-v4] Packed Sequence (THD) support for DSv4 Hybrid Attention - #5011

Merged

hxbai merged 13 commits into

Jun 26, 2026

Commits on Jun 24, 2026

dsv4 thd support
hxbai
committed
9cb9867
fix mtp thd dataload; fix compressor softmax dtype
hxbai
committed
f88490b
add padding process to dsv4 attn
hxbai
committed
c0315d2
fix mtp thd
hxbai
committed
dd850cd
fix rope and loss; remove bwd WAR; refactor test
hxbai
committed
22ec898
cudagraph fix; mask and hash moe
hxbai
committed
2bcd473
minor code clean
hxbai
committed
8838154
refine according to reviews
hxbai
committed
034f201
fix rope and tests
hxbai
committed
929585b
fix test
hxbai
committed
7f3c633

Commits on Jun 25, 2026

fix mtp roll; fix indexer loss
hxbai
committed
215de5e
Merge branch 'dev' into dsv4_thd
hxbai
authored
7e38374

Commits on Jun 26, 2026

add padding related tests
hxbai
committed
e1bdccc