-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[python] pip install fails starting with tensorrt 8.6.1 release #2933
Comments
A small side-request: could you also build wheels for python 3.11 (latest stable, in your scripts Many thanks! |
Hi @ddelange,
You aren't able to list the packages in your browser at this time on pypi.nvidia.com, so as an additional test you can try downloading the wheel file directly from one of the links in the output above. |
Hi @zeroepoch 👋 Thanks for the quick reply, sounds and looks like everything is as intended on your side. I'm on Will close as won't fix, thanks again! |
The answer only works if the issue is that you are installing a linux wheel on mac os. I am getting same error using nvidia/cuda:11.3.0-base-ubuntu20.04 I even made sure to try and install the python3 wheel for linux directly: |
@HarryCaveMan can you provide the commands you tried and the errors that were printed? We had some internal users report a similar issue when 8.6.1 was first posted, but I think it got resolved on the server side maybe since I haven't heard any more issues since then. One user with an old Ubuntu version had to first update |
I had to upgrade pip to be able to install the tensorrt package: |
Thanks @GoncaloR00 for the feedback. You're right it was |
interesting, getting a similar error now:
|
|
Hi @yunseung-dable 👋 Can you upload your error logs.txt to #3078 ? |
you can also try running TensorRT/python/packaging/frontend_sdist/setup.py Lines 17 to 40 in 5334f0d
|
I have the same problem here, my pip install tensorrt doesn't even begin to start, it just get frozen at beginning building wheels:
|
@couzhei, could you maybe try adding |
@couzhei In my case it was silently downloading ~2GB in wheel files, so it wasn't really frozen. Give @zeroepoch 's suggestion a go, you might discover the same! |
@zeroepoch, Thank you! I completely forgot about that option!! With the help of developer.nvidia.com, I managed to successfully add TensorRT to a functioning TensorFlow environment. Though I haven't noticed any performance improvement yet, I assume this because I am no longer seeing the "not finding TensorRT" warning when I import TensorFlow into my projects. @subjectnull, you're probably right. However, in my five years of using Python day-to-day, I've never encountered such behavior before. Whenever I want to make the installation "silent", I use the |
The pip installation is designed to be standalone. All you need is a driver install before doing pip to get a full working environment. This is course is assuming the goal is only running TensorRT Python bindings and not C++ development. |
I was initially having the same error message as @ddelange, and then I updated both |
After examining a different thread: github.com//issues/3060 it appears that PiPy, indicated by the following error message:
cannot host Windows wheels yet. |
@krishac1, |
@zeroepoch Thanks! I figured. |
we also saw this. turned out it was a 'broken' virtual environment where |
@ddelange I realized I had a faulty venv issue as well - you're right, |
Had the same error on Ubuntu 20.04 with Python 3.10 and pip 23.2.1. This does not occur with pip 23.0.1. |
@laclouis5, you can also |
edit: [Solved - See below] Anyone so kind to give a poor Windows user a hint? Python 3.11 and
will give me:
I also failed when trying to install an older version... Downgrading pip to version 21.3.1 didn't help either. I'm totally lost. ============= |
@zeroepoch it looks like the RuntimeError message raised by tensorrt_libs on official PyPI needs to additionally mention it might also be nice to mention the env var setup analogous to #3080 in that RuntimeError message and on the official PyPI readme |
@Samhayne, |
@ddelange, |
@ddelange, the fake packages recently published for the TRT 9.0 pre-release wheels now have |
@zeroepoch |
@joeyballentine I guess the thread in #3080 is a pretty good summary |
@joeyballentine, we do actually have some Windows wheels published, but they are currently pre-release. You can see one example component of the full package at https://pypi.nvidia.com/tensorrt-libs/. The next general release (supporting both LLM and non-LLM networks and the full scope of GPUs) will include Windows wheels not under a pre-release ( The reason we don't release the wheel files in the zip file is because they don't contain the libraries inside, which means they are not standalone. The release linked above is a full release (with libs), but TRT 9.x is specifically for LLM support and tested on mostly data center GPUs. In summary things will improve and become more seamless, but you'll need to wait for the next major TRT release. |
Description
Hi 👋
pip install is broken for latest tensorrt:
tensorrt_libs==8.6.1
from https://pypi.nvidia.comEnvironment
irrelevant
Relevant Files
irrelevant
Steps To Reproduce
Simply run a pip install in any venv:
Commands or scripts:
Have you tried the latest release?: 8.6.1 at time of writing
Can this model run on other frameworks? For example run ONNX model with ONNXRuntime (
polygraphy run <model.onnx> --onnxrt
): N/AThe text was updated successfully, but these errors were encountered: