Add full broadcasting support to LayerNormalization and RMSNormalization#26613

Merged

tianleiwu merged 8 commits intomicrosoft:mainfrom

naomiOvad:fix/rmsnorm-broadcast-26432

Dec 11, 2025

Commits on Nov 6, 2025

WIP: partial work on rmsnorm tests
naomiOvad
committed

Commits on Nov 19, 2025

Fix RMSNormalization & LayerNormalization broadcast handling and add comprehensive tests
naomiOvad
committed
Update LayerNorm tests to run on CPU only
naomiOvad
committed

Commits on Nov 20, 2025

LayerNorm: unify generic implementation, add mixed-broadcast test, and improve input validation
naomiOvad
committed

Commits on Nov 25, 2025

Added rank check, renamed sc_/bi_, and added a test for invalid Scale/Bias rank.
naomiOvad
committed

Commits on Nov 29, 2025

Merge branch 'main' into fix/rmsnorm-broadcast-26432
naomiOvad
committed

Commits on Dec 9, 2025

Refactor LayerNorm macro into separate header to fix CUDA build
naomiOvad
committed

Commits on Dec 10, 2025

Apply clang-format on LayerNorm macro
naomiOvad
committed