Skip to content

feat(optim): Muon symmetric-GEMM Newton-Schulz + orthogonalize expert stacks in place - #3873

Closed
faresobeid wants to merge 1 commit into
mainfrom
feat/muon-symmetric-ns-local-experts
Closed

feat(optim): Muon symmetric-GEMM Newton-Schulz + orthogonalize expert stacks in place#3873
faresobeid wants to merge 1 commit into
mainfrom
feat/muon-symmetric-ns-local-experts

feat(optim): symmetric-GEMM Newton-Schulz and in-place expert Muon up…

e67deb3
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar