Skip to content

Add norm before up projection for LatentMoE - #6819

Open
i-riyad wants to merge 2 commits into
NVIDIA:mainfrom
santhnm2:rislam/mimo-checkpoint-compat-main
Open

Add norm before up projection for LatentMoE#6819
i-riyad wants to merge 2 commits into
NVIDIA:mainfrom
santhnm2:rislam/mimo-checkpoint-compat-main

Restore LatentMoE up-projection norm from checkpoints

d4eee06
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 24, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO