Skip to content

metal : add remaining fa-vec tunings for M4 Pro - #27915

Merged
nikwen merged 1 commit into
masterfrom
nikwen/fa-vec-m4-pro
Aug 29, 2026
Merged

metal : add remaining fa-vec tunings for M4 Pro#27915
nikwen merged 1 commit into
masterfrom
nikwen/fa-vec-m4-pro

Conversation

@nikwen

@nikwen nikwen commented Aug 28, 2026

Copy link
Copy Markdown
Member

Overview

Refs #27668

Follow-up to #27824 that adds Q4_0/Q4_1/Q5_0/Q5_1.

Additional information

Run on the M4 Pro variant with 12 CPU and 16 GPU cores.

Requirements

@nikwen
nikwen requested a review from a team as a code owner August 28, 2026 22:42
@github-actions github-actions Bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Aug 28, 2026
@nikwen nikwen added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Aug 29, 2026
@nikwen
nikwen merged commit 17252c7 into master Aug 29, 2026
34 of 37 checks passed
@nikwen

nikwen commented Aug 31, 2026

Copy link
Copy Markdown
Member Author

@forforever73 Here's the log: fa_vec_sweep.log

@forforever73

Copy link
Copy Markdown
Contributor

@nikwen thanks!

@nikwen
nikwen deleted the nikwen/fa-vec-m4-pro branch August 31, 2026 12:05
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request Sep 5, 2026
thecodacus pushed a commit to thecodacus/llama.cpp that referenced this pull request Sep 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants