Skip to content

Fix the batch-invariant RMSNorm forward and its input gradient - #6859

Open
huthvincent wants to merge 2 commits into
NVIDIA:mainfrom
huthvincent:fix/B001-batch-invariant-rmsnorm-zero-centered-gamma
Open

Fix the batch-invariant RMSNorm forward and its input gradient#6859
huthvincent wants to merge 2 commits into
NVIDIA:mainfrom
huthvincent:fix/B001-batch-invariant-rmsnorm-zero-centered-gamma

Remove the duplicated weight factor from the RMSNorm input gradient

57dadea
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 31, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO