Skip to content

[RMSNorm] Fix rms norm init for models that center around 1#40796

Merged
vasqu merged 10 commits into
huggingface:mainfrom
vasqu:fix-rms-norm-init
Sep 19, 2025
Merged

[RMSNorm] Fix rms norm init for models that center around 1#40796
vasqu merged 10 commits into
huggingface:mainfrom
vasqu:fix-rms-norm-init