Skip to content

metal : add fa-vec tunings for M2 - #27940

Merged
nikwen merged 1 commit into
ggml-org:masterfrom
ring2003:metal-fa-vec-m2
Aug 29, 2026
Merged

metal : add fa-vec tunings for M2#27940
nikwen merged 1 commit into
ggml-org:masterfrom
ring2003:metal-fa-vec-m2

Conversation

@ring2003

@ring2003 ring2003 commented Aug 29, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Overview

This adds fa_vec_tuned_table records for Apple M2 to ggml-metal-tuning.cpp.

Additional information

Attached are the raw files output by ggml-metal-tuning:

F16,Q4_0

Q8_0

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: NO. I did not use any AI/LLM to run these commands or author this commit.

@ring2003
ring2003 requested a review from a team as a code owner August 29, 2026 09:01
@ggml-gh-bot

ggml-gh-bot Bot commented Aug 29, 2026

Copy link
Copy Markdown

Hi @ring2003, thanks for your contribution!

Per our contribution guidelines, the automated PR checker found the following issue(s) that need your attention:

  • PR Template not respected: Please respect the template when creating a new pull request. Make sure to fill out all required sections.

Please note that maintainers reserve the right to make final decisions on PRs. If you believe there is a mistake, please comment below.

@ggml-gh-bot ggml-gh-bot Bot added the draft PR will be changed to draft by github-actions bot label Aug 29, 2026
@github-actions
github-actions Bot marked this pull request as draft August 29, 2026 10:58
@github-actions github-actions Bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) and removed draft PR will be changed to draft by github-actions bot labels Aug 29, 2026
@nikwen
nikwen marked this pull request as ready for review August 29, 2026 12:37
@nikwen nikwen added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Aug 29, 2026
@nikwen

nikwen commented Aug 29, 2026

Copy link
Copy Markdown
Member

If you could also do Q4_1/Q5_0/Q5_1 in a follow-up PR, that would be awesome. :)

@nikwen
nikwen merged commit c589f0e into ggml-org:master Aug 29, 2026
35 of 36 checks passed
@ring2003 ring2003 mentioned this pull request Aug 30, 2026
Merged
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request Sep 5, 2026
@ring2003 @fewtarius
metal : add fa-vec tunings for M2 (ggml-org#27940)
e0777bf
thecodacus pushed a commit to thecodacus/llama.cpp that referenced this pull request Sep 7, 2026
@ring2003
metal : add fa-vec tunings for M2 (ggml-org#27940)
26798f5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikwen nikwen nikwen approved these changes
@taronaeo taronaeo taronaeo approved these changes

Assignees

No one assigned

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ring2003 @nikwen @taronaeo