Skip to content

feat(optim): heads_per_block for MLA up-projections (GLM-5 Muon Split) - #4119

Closed
faresobeid wants to merge 2 commits into
feat/muon-heads-per-blockfrom
muona/muon-mla-split
Closed

feat(optim): heads_per_block for MLA up-projections (GLM-5 Muon Split)#4119
faresobeid wants to merge 2 commits into
feat/muon-heads-per-blockfrom
muona/muon-mla-split

Commits

  1. Commits on Oct 16, 2026

  2. Commits on Oct 17, 2026