Add skip layer normalization#3865

Closed

TedThemistokleous wants to merge 15 commits intoadd_attention_contrib_opfrom

add_skip_layer_normalization

Commits on Mar 7, 2025

Took simplified version and tweaked a little
Ted Themistokleous
committed
Adjust parameters to match onnxruntime implimentation
Ted Themistokleous
committed
Add initial parser tests - leverage existing parser for skipSimplifiedLayerNormalization with added beta input
Ted Themistokleous
committed
Bit of cleanup
Ted Themistokleous
committed
Replace sub/mul with sqdiff
Ted Themistokleous
committed
Add updated test.
Ted Themistokleous
committed
Fix parser to ensure inv_std_var is always float and fix standard test to reflect this
Ted Themistokleous
committed
Update tests and handle error found with beta input
Ted Themistokleous
committed
Add verify for skip_layer_normalization - WIP
Ted Themistokleous
committed

Commits on Mar 27, 2025