Skip to content

Windows Nvidia TensorRT Support

Benjamin Paine edited this page Nov 8, 2023 · 1 revision

In order to use Nvidia TensorRT on Windows, some additional steps must be taken. This is temporary (hopefully) as TensorRT support for Windows is very new.

You will be asked to add a number of directories to your PATH. On windows, the easiest way to reach it is:

  1. Open the start menu and begin typing "Environment". You will see an option that says "Edit the system environment variables," click this.
  2. In the bottom-right-hand corner of the System Properties window, click "Environment Variables."
  3. Under your user, click the "Path" variable and then click "Edit".
  4. Add a new entry pointing to the requested path.

Windows Configuration for Enabling TensorRT

Before downloading anything, you will need to make an account with Nvidia and Join the Nvidia Developer Program.

Once that is complete, download the following packages and install them anywhere to your system.

  1. Install CUDA, add /bin to PATH
  2. Install CUDNN, add /lib to PATH
  3. Install TensorRT, add /lib to PATH. If you are creating your own environment, you should also use pip to install python/tensorrt-8.*-cp310-none-win_amd64.whl from this directory.
  4. If you are creating your own environment, now run pip install enfugue[tensorrt]
Clone this wiki locally