-
Notifications
You must be signed in to change notification settings - Fork 7.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Problems while running the demo Check failed: status == CUDNN_STATUS_SUCCESS (1 vs. 0) CUDNN_STATUS_NOT_INITIALIZED #1527
Comments
I have the same problem running the example:
Computer information:
Any suggestions? If I compile using only CUDA and not cuDNN, I can run it without hands and faces options, otherwise OpenPose consumes more than 6GB (maximum for RTX 2060) and aborts (out of memory). Thanks in advance. |
I run the demo successfully by only using the CPU, but it is really slow. |
Please use the option, --net_resolution 160x80 (or 320x176) (ex : bin\OpenPoseDemo.exe --face --hand --net_resolution 160x80) |
Thank you, but I need it for real-time, so CPU its not an option.
Thank you, I tried with these net resolutions and I get an cuDNN internal error when faces or hands are activated.
I forgot to say that I am trying to run OpenPose in Ubuntu 18.04 LTS |
similar issue found here #1508 |
Thank you. I have reinstalled Cuda and cuDNN more than a couple of times, updated all symbolic links, check all OpenPose information, even update to the latest NVIDIA Driver, and nothing works for me. I think there is an issue with Turing architecture in RTX graphics cards, probably related to Caffe (I have tried to compile it changing Makefiles to add sm_75 and compute_75 architecture used by RTX graphics cards, but it does not work either). |
In your first reply i see you have used CUDA 10.2 and cuDNN 7.6.5 |
I've tried this setup and it works fine (pretty slow at 6 fps with hands and faces), although nvidia-smi still says CUDA 10.2 is installed. But I can at least start working. Thank you! |
I have solved the problem, it turns out that my GPU only support CUDA version lower than v10.2.141, I finally successfully run the tutorial demo 01 by using CUDA v10.1. But I come up with a new error Check failed: status == CUDNN_STATUS_SUCCESS (2 vs. 0) while running tutorial demo 02, maybe it is because the memory of my GPU can not support the code. I decide to use the CPU vesrion to start working, although it is REALLY slow |
Hello, You can solve the problem using Cuda 10.0 and cuDNN 7.5.0, try it, it worked for me. Also, you can install both Cuda versions (I have 10.0 and 10.2, the first with cuDNN 7.5.0 and the second with cuDNN 7.6.5). Just ensure that you include the path for Cuda 10.0 before using OpenPose, otherwise, it will find Cuda 10.2 and will fail.
|
Well...I still get this error after using the version 10.0, maybe my GPU can not support computing of face or hand. |
How big if your GPU memory? Hand/face might need >4 GB of GPU memory, that error might be an out of memory issue. (Closing assuming that's the issue, but feel free to post otherwise). Reducing EDITED (Nov 2020): Please try the latest OpenPose, I modified the CMake and Caffe versions to be compatible with CUDA 10 and 11. |
I ran into this problem before, but now I've solved it. You can try this:
|
I ran into same issue when I had cudnn 7.6.* and Cuda 10.2.* in ubuntu 18.04 in RTX 2070. After I downgrade to cudnn 7.5.* and Cuda 10.0.* This issue is resolved. If you need to install cuda 10 and cudnn 7.5 follow this link |
i add " -gencode arch=compute_75,code=sm_75 " in my Makefile.config , the problem is solved , thanks . my environment ( cuda 10.2 cudnn 7.5) |
@leoluopy Hi, mine is Ubuntu 18.04 cuda 10.2 cudnn 7.5, and I have the same problem. But I don't find Makefile.config. In
|
@Ctiger96 there's a example cmake file in the caffe src directory |
Hi, I ran the examples 02_whole_body_from_image.py ,and have the same problem.And I had try to add :
in openpose/3rdparty/caffe/Makefile.config.* .And then cmake _ make -j _ make install.But it still doesn't work. |
Hi, I ran the examples 02_whole_body_from_image.py ,and have the same problem.And I had try to add :
in openpose/3rdparty/caffe/Makefile.config.* .And then cmake _ make -j _ make install.But it still doesn't work. |
Hi, I have been facing the same issue when I try to run the demo file. I followed the steps for custom Caffe and OpenCV when compiling (BUILD_CAFFE flag is off, etc.) . I tried downgrading CUDA and CUDNN as someone suggested but that didn't help either. I had to reinstall my OS at some point to get a clean setup but still the issue persists. Am I missing something or openpose doesn't support the CUDNN version? Thanks. |
For Windows, this is my Caffe repo to compile Windows: https://github.com/gineshidalgo99/caffeCompilerForWindowsAndCUDA It is based on the Windows Caffe one. I have not been able to compile cuDNN for Windows, it keeps giving me this error:
If anybody is able to get it to work without giving the CUDNN_STATUS_NOT_INITIALIZED error, I'd very highly appreciate some hints of the exact CUDA/cuDNN version and/or instructions to get it to work! :) Please, continue this discursion in #1845, to centralize messages and hopefully focus efforts to fix the issue. Thanks! PS: For Ubuntu users with memory issues, v1.7.0 was modified to allow cuDNN 8, which was a pain. I am not an expert, so I am sure there must be a better way to run the cuDNN convolutions using less memory, but I am not an expert on it. I am very open to suggestions about the cudnn_conv implementation to minimize memory: Please, continue this discursion in #1864, to centralize messages and hopefully focus efforts to fix the issue. Thanks! |
Hello, |
same issue too
|
I had the same error. I compiled openpose on Ubuntu 20.04, installed cuda 11.1.1 with cudnn 8.0.5. I changed to Ubuntu 18.04 after i saw this message. I did exactly what you are saying, installed cuda 10.0 with cudnn 7.5.0 and everything worked perfectly. Thank you. I have GTX 1070 with Nvidia driver 440 on Ubuntu 18.04 |
It works for me to disable USE_CUDNN in cmake-gui ! My computer information: |
The same docker image works on P5000 GPU but fails on RTX4000 |
It works for me to disable USE_CUDNN with GPU: NVIDIA RTX3090 |
still not work. |
It works for me. |
I have succefully compile the openpose with CMake, but there is an error happened in Netcaffe.cpp
upImpl->upCaffeNet.reset(new caffe::Net{upImpl->mCaffeProto, caffe::TEST});
and the error shows Check failed: status == CUDNN_STATUS_SUCCESS (1 vs. 0) CUDNN_STATUS_NOT_INITIALIZED
CUDA v10.2
CUDNN 7.6.5
CMake 3.17
Visual Studio 2017
The text was updated successfully, but these errors were encountered: