Repository navigation

[Dev] Add configurable attention latent normalization epsilon - #6204

Merged

buptzyb merged 3 commits into

buptzyb:robinz/attention-latent-norm-epsilon-dev

Aug 27, 2026

Merged

[Dev] Add configurable attention latent normalization epsilon#6204
buptzyb merged 3 commits into
NVIDIA:devfrom
buptzyb:robinz/attention-latent-norm-epsilon-dev

Commits on Aug 26, 2026
- Port Multi-Latent Attention to `HybridModel` (#4452)
  
  janEbert
  authored and
  buptzyb
  committed
  e0956a5
- Add configurable attention latent normalization epsilon
  buptzyb
  committed
  5dff175
- Apply attention latent norm epsilon to DSv4
  buptzyb
  committed
  3b437a7