Skip to content

Add QK layernorm support for dot-product attention in MambaModel - #4067

Merged
Phlip79 merged 21 commits into
NVIDIA:mainfrom
Phlip79:philip/add-qk-norm
Apr 17, 2026
Merged

Add QK layernorm support for dot-product attention in MambaModel#4067
Phlip79 merged 21 commits into
NVIDIA:mainfrom
Phlip79:philip/add-qk-norm

Fix TENorm isinstance check and add L2Norm config-fallback test

1ca9061
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning

The logs for this run have expired and are no longer available.