Skip to content

[RMSNorm] Fix rms norm init for models that center around 1#40796

Merged
vasqu merged 10 commits intohuggingface:mainfrom
vasqu:fix-rms-norm-init
Sep 19, 2025
Merged

[RMSNorm] Fix rms norm init for models that center around 1#40796
vasqu merged 10 commits intohuggingface:mainfrom
vasqu:fix-rms-norm-init

Commits

Commits on Sep 10, 2025

Commits on Sep 17, 2025

Commits on Sep 19, 2025