Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 22 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,24 +13,36 @@ A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
We publish nightly wheel packages on https://pypi.nvidia.com, while build against stable torch version on https://pypi.org and https://pypi.nvidia.com.
**Wheels are published for Python version: _3.10_, _3.12_**.

built-env | cuda 11.8 | cuda 12.4 | cuda12.6 | cuda 12.8
:---: | :---: | :---: | :---: | :---: |
torch 2.6 | nvfuser-cu118-torch26 | nvfuser-cu124-torch26 | nvfuser-cu126-torch26 | N/A |
torch nightly (pypi.nvidia.com) | nvfuser-cu118 | N/A | nvfuser-cu126 | nvfuser-cu128 |
built-env | cuda 11.8 | cuda12.6 | cuda 12.8
:---: | :---: | :---: | :---: |
torch 2.7 | nvfuser-cu118-torch27 | nvfuser-cu126-torch27 | nvfuser-cu128-torch27 |
torch nightly (pypi.nvidia.com) | nvfuser-cu118 | nvfuser-cu126 | nvfuser-cu128 |

Note that nvfuser built against stable torch version isn't compatible with nightly pytorch wheel, so ensure you pick the right version suiting your environment.

### nightly nvfuser pip wheel

You can instll a nightly nvfuser pip package built against torch nightly code base with `pip install --pre nvfuser-cu121 --extra-index-url https://pypi.nvidia.com`
### Nightly nvfuser pip wheel

As we build against nightly torch wheel and there's no compatibility promised on nightly wheels, we have explicitly marked the nightly torch wheel as an optinoal dependency. You can choose to install the torch wheel along with nvfuser package. e.g.
`pip install --pre "nvfuser-cu121[torch]" --extra-index-url https://pypi.nvidia.com`.
You can install a nightly nvfuser pip package built against torch nightly code base with
`pip install --pre nvfuser-cu128 --extra-index-url https://pypi.nvidia.com`

As we build against nightly torch wheel and there's no compatibility promised on nightly wheels,
we have explicitly marked the nightly torch wheel as an optional dependency.
You can choose to install the torch wheel along with nvfuser package,
e.g. `pip install --pre "nvfuser-cu128[torch]" --extra-index-url https://pypi.nvidia.com`.
Note that this may uninstall your local pytorch installation and install the compatible nightly pytorch.

### nvfuser pip wheel against pytorch stable release
### Nvfuser pip wheel against pytorch stable release

Nvfuser pip wheel built against stable torch releases is published on both https://pypi.org and https://pypi.nvidia.com.
Pick the right cuda toolkit version to match your torch installation. e.g. `pip install nvfuser-cu128-torch27`.

For old nvfuser builds against old version pytorch, e.g. `nvfuser-cuXXY-torchZW`,
there are packages available at [PyPI](https://pypi.org/search/?q=nvfuser).
We build and publish builds against the latest stable pytorch on https://pypi.org on 1st and 15th of every month regularly and
when major changes are added.

nvfuser pip wheel built against stable torch releases is published on both pypi.org and pypi.nvidia.com. Pick the right cuda toolkit version to match your torch installation. e.g. `pip install nvfuser-cu121-torch26`
We always recommend use of the latest nvfuser build with latest cuda and pytorch versions.

PyPI: [https://pypi.org/project/nvfuser/](https://pypi.org/search/?q=nvfuser)

Expand Down