Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Any plans of adding GPU support for linux? #128

Closed
PeterBagnegaard opened this issue Nov 6, 2023 · 2 comments
Closed

Any plans of adding GPU support for linux? #128

PeterBagnegaard opened this issue Nov 6, 2023 · 2 comments
Labels
configuration-runtimes enhancement New feature or request GPU

Comments

@PeterBagnegaard
Copy link

I'm developing a feature that requires Whisper to be fairly responsive. It would be nice if I could use my GPU instead of CPU, but as far as I can tell this feature isn't implemented for anything but Windows. Are there any plans to change this?
@sandrohanea
Copy link
Owner

Indeed, the runtimes are currently only built for Windows with Cublas / OpenBlas
Also, CoreML is used for Apple devices, but currently there is no whisper.net runtime on linux.

However, if someone builds it from the original whisper.cpp, it should work with the whisper.net which is just a wrapper around that.

Indeed, the preferred solution would be to have the runtime for linux as well, but unfortunately, I didn't have time for it yet.

@Alumniminium Alumniminium mentioned this issue Nov 19, 2023
Merged
@sandrohanea
Copy link
Owner

Cublas support for Linux - x64 is now added in Whisper.net.Runtime.Cublas 1.5.0

Clblast is not supported yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
configuration-runtimes enhancement New feature or request GPU
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sandrohanea @PeterBagnegaard