Skip to content

Fix the batch-invariant RMSNorm forward and its input gradient - #6859

Merged
guihong-nv merged 5 commits into
NVIDIA:mainfrom
huthvincent:fix/B001-batch-invariant-rmsnorm-zero-centered-gamma
Oct 15, 2026
Merged

guihong-nv merged 5 commits into
NVIDIA:mainfrom
huthvincent:fix/B001-batch-invariant-rmsnorm-zero-centered-gamma

Remove the duplicated weight factor from the RMSNorm input gradient

57dadea
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 31, 2026 in 1s

DCO

All commits are signed off!