Skip to content

Improve SYCL doc#23025

Merged
ggerganov merged 5 commits into
ggml-org:masterfrom
aicss-genai:sycl-readme
Jun 4, 2026
Merged

Improve SYCL doc#23025
ggerganov merged 5 commits into
ggml-org:masterfrom
aicss-genai:sycl-readme

Conversation

@malsbat
Copy link
Copy Markdown
Contributor

@malsbat malsbat commented May 13, 2026

Overview

The main change is to move the SYCL Docker instructions to the common docker.md file: this should improve accessibility for users navigating from the top-level README.md

Additional information

Beyond some small editorial fixes, this also corrects the documented default of the GGML_SYCL_GRAPH build argument.

Requirements

malsbat added 3 commits May 12, 2026 13:14
- Add explicit links to referenced items
- Fix spelling errors

Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
The default is ON, not OFF:

  $ cmake -LAH -B build | grep GGML_SYCL_GRAPH
  ...
  GGML_SYCL_GRAPH:BOOL=ON

Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
This makes them directly accesible from the Quick Start section
of the top-level README.md.

Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
@github-actions github-actions Bot added documentation Improvements or additions to documentation SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language labels May 13, 2026
Comment thread docs/docker.md Outdated
@kha84
Copy link
Copy Markdown

kha84 commented May 17, 2026

Guys, can I ask you to add few more things to SYCL docs, pls.

Remove from the project-level README.md the mentioning of Nvidia being supported by SYCL

Currently the top project-level README.md page says SYCL backend can be used for Nvidia:

Backend Target devices
... ...
SYCL Intel and Nvidia GPU
... ...

but from the recent news I read:

2026.02
Remove support for Nvidia & AMD GPU, because the oneAPI plugin for Nvidia & AMD GPU is unavailable: download/installation channels are out of work. User can't build up the software for Nvidia & AMD GPU.

This is inconsistecy

Add some short performance comparison table for the reference

It would greatly help to newcomers to understand what to expect from performance standpoint, when SYCL is used as a backend, compared say to Vulcan. I'm not expecting a wide-range comparison, but just few typical models would help a lot, like this:

card model backend pp512 tg128
Arc b580 Qwen3.5-9B-Q4_K_M.gguf Vulcan ??? ???
Arc b580 Qwen3.5-9B-Q4_K_M.gguf SYCL ??? ???

Without this table, people will be running llama.cpp with using SYCL backend blindly, questioning if they're reaching the reference performance or not, wasting their time on troubleshooting issues they might not have. Having reference performance numbers will benefit community.

NB: I do not own the Intel card unfortunately, otherwise I would gladly help you to benchmark it

@NeoZhangJianyu
Copy link
Copy Markdown
Contributor

Agree to change "Intel and Nvidia GPU" to "Intel GPU" in README.md.

"Add some short performance comparison table for the reference": I don't think it's goo idea.
Compare to other backends will make unnecessary trouble.
But we could create a table to list the performance data of LLM on Intel GPU as reference.
It can be handled by another PR.

Thank you!

malsbat added 2 commits June 1, 2026 17:22
The defaults are always changing; this avoids accuracy errors
from duplicating the information.

Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
This support was removed in 2026.02 - refer to the SYCL.md News.

Signed-off-by: Todd Malsbary <todd.malsbary@intel.com>
@malsbat malsbat requested a review from ggerganov as a code owner June 1, 2026 17:26
@malsbat
Copy link
Copy Markdown
Contributor Author

malsbat commented Jun 1, 2026

Comments addressed, ready for review again

Copy link
Copy Markdown
Contributor

@arthw arthw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's good job!

Thank you!

@arthw arthw added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Jun 3, 2026
@ggerganov ggerganov merged commit f478f1b into ggml-org:master Jun 4, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants