[MAIN][NVFP4] Support NVFP4 MOE with Proper Padding - #1985

Merged

yanring merged 12 commits into

NVIDIA:mainfrom

zhongbozhu:zhongbo/support_nvfp4_group_linear

Nov 18, 2025

Commits on Nov 13, 2025

proper fp4 padding
zhongbozhu
committed
5d7d14c
change naming based on comments
zhongbozhu
committed
b8d0fd4
add compatibility toggle moe_router_padding_for_fp8 back
zhongbozhu
committed
436ed43
ADLR/megatron-lm!4225 - [Dev][NVFP4][MOE] Proper NVFP4 Zero Padding for MOE
zhongbozhu
committed
0471d46
attempt to fix NVFP4 + selective recompute
zhongbozhu
committed
0688715
don't raise error in MTP when seeing fp4 config
zhongbozhu
committed
9222a0a
fix moe router map padding nvfp4

xrennvidia
authored and
zhongbozhu
committed
4076e64
bump up align size for fp4 to 64
zhongbozhu
committed
c0860b2
autoformat
zhongbozhu
committed
d3e8064

Commits on Nov 18, 2025

fix lint
yaox12
authored
1276e49
Merge branch 'main' into zhongbo/support_nvfp4_group_linear
yaox12
authored
3c9f88c
Update token_dispatcher.py
yaox12
authored
08141bb