Skip to content

[Main] Numerical fix for moe single grouped weight with fp8 fp4 primary weight and grad norm spikes - #5487

Merged
zhongbozhu merged 23 commits into
NVIDIA:mainfrom
zhongbozhu:main_fix_single_weight
Jul 23, 2026
Merged

[Main] Numerical fix for moe single grouped weight with fp8 fp4 primary weight and grad norm spikes#5487
zhongbozhu merged 23 commits into
NVIDIA:mainfrom
zhongbozhu:main_fix_single_weight

enforce single weight to be used with te op fuser, bug fixes

7d0c34f
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 9, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO