Metal optimisation #3

Merged

GustavoA1604 merged 19 commits into

GustavoA1604:multilingual_mergedfrom

mario-rei:multilingual_merged

May 4, 2026

Commits on Apr 28, 2026

perf(t3-mtl): batch CFG cond+uncond into a single Metal forward (B=2)
reichert-dev
committed
feat(cli): --cfm-steps N for non-streaming multilingual
reichert-dev
committed
perf(t3-mtl): use ggml_swiglu_split for fused SiLU*Mul on Metal
reichert-dev
committed
docs(README,PROGRESS): MTL Metal optimisation pass §3.21
reichert-dev
committed
perf(mtl): drop redundant gallocr_reserve + thread_local HiFT/time_mlp scaffolding
reichert-dev
committed
docs(PROGRESS): §3.22 — MTL allocator-overhead clean-up
reichert-dev
committed
perf(t3-mtl): stack W_q+W_k+W_v into one mat-mul on Metal
reichert-dev
committed
docs(PROGRESS): §3.23 — T3-MTL fused Q/K/V mat-mul
reichert-dev
committed

Commits on Apr 29, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026