[dev] fix(moe): Fix DSA spec and rope. - #3402

Merged

hxbai merged 14 commits into

yuzhongw-nvidia:yuzhongw/fix_dsa_spec_dev

Mar 6, 2026

Commits on Mar 5, 2026

Update experimental_attention_variant_module_specs.py
yuzhongw-nvidia
committed
affb92a
Update experimental_attention_variant_module_specs.py
yuzhongw-nvidia
committed
8a5419f
add a functional test
yuzhongw-nvidia
committed
05daf93
fix
yuzhongw-nvidia
committed
1069227
update dependency
yuzhongw-nvidia
committed
8851869
add comment about why using unfused qk layernorm
yuzhongw-nvidia
committed
54dec8e
fix rope order
yuzhongw-nvidia
committed
ed27bd0
refactor apply_rotary_pos_emb and disable rope interleaving for DSA indexer
yuzhongw-nvidia
committed
7f8cc87
add a UT for apply rope refactor
yuzhongw-nvidia
committed
e003145
add a UT for exp spec
yuzhongw-nvidia
committed
f58b762
update exp spec UT
yuzhongw-nvidia
committed
311b567

Commits on Mar 6, 2026

Merge branch 'dev' into yuzhongw/fix_dsa_spec_dev
yuzhongw-nvidia
authored
3307414
Merge branch 'dev' into yuzhongw/fix_dsa_spec_dev
yuzhongw-nvidia
authored
f362a99
fix mhc
yuzhongw-nvidia
committed
484fd1a