Running onnxruntime with a gpu in nodejs? #14127
Labels
ep:CUDA
issues related to the CUDA execution provider
feature request
request for unsupported feature or enhancement
platform:web
issues related to ONNX Runtime web; typically submitted using template
platform:windows
issues related to the Windows platform
Comments
github-actions
bot
added
ep:CUDA
faxu
added
the
platform:web
snnn
pushed a commit
that referenced
this issue
Aug 25, 2023
### Description I've added changes to support CUDA and DML (only on Windows, on other platforms it will throw an error) ### Motivation and Context It fixes this feature request #14127 which is tracked here #14529 I was working on StableDiffusion implementation for node.js and it is very slow on CPU, so GPU support is essential. Here is a working demo with a patched and precompiled version https://github.com/dakenf/stable-diffusion-nodejs ---------
|
I am using the onnxruntime-node v1.16.0 on Windows. The directml and cuda provider are still not working. |
|
Still waiting for the gpu backends for onnxruntime-node@fs-eire. |
|
Is there any news @fs-eire ? |
|
The team puts it as a work item in 2024 planning to working on updating the CI pipeline to include shared libraries of ONNX Runtime to support GPU EPs for Node.js binding. |
kleiti
pushed a commit
to kleiti/onnxruntime
that referenced
this issue
Mar 22, 2024
) ### Description I've added changes to support CUDA and DML (only on Windows, on other platforms it will throw an error) ### Motivation and Context It fixes this feature request microsoft#14127 which is tracked here microsoft#14529 I was working on StableDiffusion implementation for node.js and it is very slow on CPU, so GPU support is essential. Here is a working demo with a patched and precompiled version https://github.com/dakenf/stable-diffusion-nodejs ---------
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the issue
Hello!
I'm trying to run yolov7 in nodejs but I am getting poor performance as it is using my cpu instead of my gpu.
Onnxruntime-web mentions the capability of using nodejs and gpu but when requiring it in node.js I get "Uncaught Error Error"
How would I get onnxruntime-node to run on my gpu for better performance?
Thanks!
To reproduce
I'm using yolov7-w6-pose-nms.onnx from https://github.com/trancongman276/yolov7-pose
Urgency
No response
Platform
Windows
OS Version
Windows 10
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
[email protected]
ONNX Runtime API
JavaScript
Architecture
X64
Execution Provider
CUDA
Execution Provider Library Version
No response
The text was updated successfully, but these errors were encountered: