Skip to content

feat(optim): heads_per_block for MLA up-projections (GLM-5 Muon Split) - #4119

Closed
faresobeid wants to merge 2 commits into
feat/muon-heads-per-blockfrom
muona/muon-mla-split
Closed

faresobeid wants to merge 2 commits into
feat/muon-heads-per-blockfrom
muona/muon-mla-split

Merge remote-tracking branch 'origin/feat/muon-heads-per-block' into …

41f92bf
Select commit
Loading
Failed to load commit list.