Skip to content

Update information for ROCm 5.4 for MIGraphX and ROCm Builds #13813

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
faxu merged 12 commits into from
Jan 26, 2023
Merged

Update information for ROCm 5.4 for MIGraphX and ROCm Builds #13813

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
06bb522
Update information for ROCm 5.4 for MIGraphX and ROCm Builds
TedThemistokleous Dec 1, 2022
3bbe68f
Update based on PR comments
TedThemistokleous Dec 16, 2022
17e8c53
Remove additional Preview tags from Rocm + pytorch builds.
TedThemistokleous Jan 3, 2023
b86b621
Add hook for ROCm 5.4 with the latest pytorch which supports rocm
TedThemistokleous Jan 3, 2023
c23f9d1
Fix ROCM to be ROCm for consistency
TedThemistokleous Jan 3, 2023
d17c536
Fix links, remove depreciated ROCm entries and cleanup spacing
TedThemistokleous Jan 3, 2023
e5511e1
Consolodate MIGraphX page into official provider page
TedThemistokleous Jan 19, 2023
a6fb305
Remove dead link and TOC placeholder
TedThemistokleous Jan 19, 2023
d631e13
Fix broken link for MIGraphX EP after file consolidation
TedThemistokleous Jan 19, 2023
361a2cb
Update based on Faith Xu's comments
TedThemistokleous Jan 25, 2023
40df04b
Merge branch 'gh-pages' into update_migx_gh-pages
TedThemistokleous Jan 25, 2023
fc925bd
Move XNNPACK up next to ARM-NN, into the Other category
TedThemistokleous Jan 26, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/build/eps.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -634,8 +634,8 @@ See more information on the MIGraphX Execution Provider [here](../execution-prov
### Prerequisites
{: .no_toc }

* Install [ROCM](https://rocmdocs.amd.com/en/latest/Installation_Guide/Installation-Guide.html)
* The MIGraphX execution provider for ONNX Runtime is built and tested with ROCM3.3
* Install [ROCm](https://docs.amd.com/bundle/ROCm-Installation-Guide-v5.4/page/How_to_Install_ROCm.html#_How_to_Install)
* The MIGraphX execution provider for ONNX Runtime is built and tested with ROCM5.4
Comment thread
TedThemistokleous marked this conversation as resolved.
Outdated
Comment thread
TedThemistokleous marked this conversation as resolved.
Outdated
* Install [MIGraphX](https://github.com/ROCmSoftwarePlatform/AMDMIGraphX)
* The path to MIGraphX installation must be provided via the `--migraphx_home parameter`.

Expand All @@ -657,8 +657,8 @@ See more information on the ROCm Execution Provider [here](../execution-provider
### Prerequisites
{: .no_toc }

* Install [ROCm](https://docs.amd.com/bundle/ROCm-Installation-Guide-v5.2.3/page/How_to_Install_ROCm.html#_How_to_Install)
* The ROCm execution provider for ONNX Runtime is built and tested with ROCm5.2.3
* Install [ROCm](https://docs.amd.com/bundle/ROCm-Installation-Guide-v5.4/page/How_to_Install_ROCm.html#_How_to_Install)
* The ROCm execution provider for ONNX Runtime is built and tested with ROCm5.4

### Build Instructions
{: .no_toc }
Expand Down
77 changes: 77 additions & 0 deletions docs/execution-providers/MIGraphX-ExecutionProvider.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,77 @@
---

@faxu faxu Jan 18, 2023

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is already a page for this EP here: https://onnxruntime.ai/docs/execution-providers/community-maintained/MIGraphX-ExecutionProvider.html

Can/should it be consolidated?

@TedThemistokleous TedThemistokleous Jan 19, 2023

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added this to mirror what was done for the ROCm EP documentation. Should we be removing the other then is what you're saying?

@TedThemistokleous TedThemistokleous Jan 19, 2023

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consolidated info to this document page instead and removed the one under community-maintained.

title: AMD - MIGraphX
description: Instructions to execute ONNX Runtime with the AMD MIGraphX execution provider
parent: Execution Providers
nav_order: 10
redirect_from: /docs/reference/execution-providers/MIGraphX-ExecutionProvider
---

# ROCm Execution Provider
{: .no_toc }

The MIGraphX Execution Provider enables hardware accelerated computation on AMD ROCm-enabled GPUs.

## Contents
{: .no_toc }

* TOC placeholder
{:toc}

## Install

**NOTE** Please make sure to install the proper version of Pytorch specified here [PyTorch Version](../install/#training-install-table-for-all-languages).

For Nightly PyTorch builds please see [Pytorch home](https://pytorch.org/) and select ROCm as the Compute Platform.

Pre-built binaries of ONNX Runtime with MIGraphX EP are published for most language bindings. Please reference [Install ORT](../install).

## Requirements


|ONNX Runtime|MIGraphX|
|---|---|
|main|5.4|
|1.13|5.4|
|1.13|5.3|
|1.12|5.2.3|
|1.12|5.2|


## Build
For build instructions, please see the [BUILD page](../build/eps.md#amd-migraphx).

## Usage

### C/C++

```c++
Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions so;
int device_id = 0;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_MIGraphX(so, device_id));
```

The C API details are [here](../get-started/with-c.md).

### Python
Python APIs details are [here](https://onnxruntime.ai/docs/api/python/api_summary.html).

## Performance Tuning
For performance tuning, please see guidance on this page: [ONNX Runtime Perf Tuning](../performance/tune-performance.md)

## Samples

### Python

```python
import onnxruntime as ort

model_path = '<path to model>'

providers = [
'MIGraphXExecutionProvider',
'CPUExecutionProvider',
]

session = ort.InferenceSession(model_path, providers=providers)
```
8 changes: 7 additions & 1 deletion docs/execution-providers/ROCm-ExecutionProvider.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,14 +19,20 @@ The ROCm Execution Provider enables hardware accelerated computation on AMD ROCm

## Install

**NOTE** Please make sure to install the proper version of Pytorch specified here [PyTorch Version](../install/#training-install-table-for-all-languages).

For Nightly PyTorch builds please see [Pytorch home](https://pytorch.org/) and select ROCm as the Compute Platform.

Pre-built binaries of ONNX Runtime with ROCm EP are published for most language bindings. Please reference [Install ORT](../install).

## Requirements


|ONNX Runtime|ROCm|
|---|---|
|main|5.2.3|
|main|5.4|
|1.13|5.4|
|1.13|5.3|
Comment thread
PeixuanZuo marked this conversation as resolved.
Outdated
|1.12|5.2.3|
|1.12|5.2|

Expand Down
4 changes: 2 additions & 2 deletions docs/execution-providers/index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,8 @@ ONNX Runtime supports many different execution providers today. Some of the EPs
|Default CPU|[NVIDIA CUDA](../execution-providers/CUDA-ExecutionProvider.md)|[Intel OpenVINO](../execution-providers/OpenVINO-ExecutionProvider.md)|[Rockchip NPU](../execution-providers/community-maintained/RKNPU-ExecutionProvider.md) (*preview*)|
|[Intel DNNL](../execution-providers/oneDNN-ExecutionProvider.md)|[NVIDIA TensorRT](../execution-providers/TensorRT-ExecutionProvider.md)|[ARM Compute Library](../execution-providers/community-maintained/ACL-ExecutionProvider.md) (*preview*)|[Xilinx Vitis-AI](../execution-providers/community-maintained/Vitis-AI-ExecutionProvider.md) (*preview*)|
|[TVM](../execution-providers/community-maintained/TVM-ExecutionProvider.md) (*preview*)|[DirectML](../execution-providers/DirectML-ExecutionProvider.md)|[Android Neural Networks API](../execution-providers/NNAPI-ExecutionProvider.md)|[Huawei CANN](../execution-providers/community-maintained/CANN-ExecutionProvider.md) (*preview*)|
|[Intel OpenVINO](../execution-providers/OpenVINO-ExecutionProvider.md)|[AMD MIGraphX](../execution-providers/community-maintained/MIGraphX-ExecutionProvider.md) (*preview*)|[ARM-NN](../execution-providers/community-maintained/ArmNN-ExecutionProvider.md) (*preview*)|
||[AMD ROCm](../execution-providers/ROCm-ExecutionProvider.md) (*preview*)|[CoreML](../execution-providers/CoreML-ExecutionProvider.md) (*preview*)|
|[Intel OpenVINO](../execution-providers/OpenVINO-ExecutionProvider.md)|[AMD MIGraphX](../execution-providers/community-maintained/MIGraphX-ExecutionProvider.md) |[ARM-NN](../execution-providers/community-maintained/ArmNN-ExecutionProvider.md) (*preview*)|
Comment thread
TedThemistokleous marked this conversation as resolved.
Outdated
Comment thread
TedThemistokleous marked this conversation as resolved.
Outdated
||[AMD ROCm](../execution-providers/ROCm-ExecutionProvider.md) |[CoreML](../execution-providers/CoreML-ExecutionProvider.md) (*preview*)|
Comment thread
TedThemistokleous marked this conversation as resolved.
Outdated
||[TVM](../execution-providers/community-maintained/TVM-ExecutionProvider.md) (*preview*)|[TVM](../execution-providers/community-maintained/TVM-ExecutionProvider.md) (*preview*)|
||[Intel OpenVINO](../execution-providers/OpenVINO-ExecutionProvider.md)|[Qualcomm SNPE](../execution-providers/SNPE-ExecutionProvider.md)|
|[XNNPACK](../execution-providers/Xnnpack-ExecutionProvider.md)||[XNNPACK](../execution-providers/Xnnpack-ExecutionProvider.md)|
Expand Down
5 changes: 3 additions & 2 deletions docs/install/index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -251,5 +251,6 @@ The _location_ needs to be specified for any specific version other than the def
|[*Preview*] PyTorch 1.8.1 (ROCm 4.2)|[**onnxruntime_stable_torch181.rocm42**](https://onnxruntimepackages.z14.web.core.windows.net/onnxruntime_stable_torch181.rocm42.html)|[onnxruntime_nightly_torch181.rocm42](https://onnxruntimepackages.z14.web.core.windows.net/onnxruntime_nightly_torch181.rocm42.html)|
|[*Preview*] PyTorch 1.9 (ROCm 4.2)|[**onnxruntime_stable_torch190.rocm42**](https://onnxruntimepackages.z14.web.core.windows.net/onnxruntime_stable_torch190.rocm42.html)|[onnxruntime_nightly_torch190.rocm42](https://onnxruntimepackages.z14.web.core.windows.net/onnxruntime_nightly_torch190.rocm42.html)|
|[*Preview*] PyTorch 1.11 (ROCm 5.1.1)|[**onnxruntime_stable_torch1110.rocm511**](https://download.onnxruntime.ai/onnxruntime_stable_rocm511.html)|[onnxruntime_nightly_torch1110.rocm511](https://download.onnxruntime.ai/onnxruntime_nightly_rocm511.html)|
|[*Preview*] PyTorch 1.11 (ROCm 5.2)||[onnxruntime_nightly_torch1110.rocm52](https://download.onnxruntime.ai/onnxruntime_nightly_rocm511.html)|
|[*Preview*] PyTorch 1.12.1 (ROCm 5.2.3)||[onnxruntime_nightly_torch1121.rocm523](https://download.onnxruntime.ai/onnxruntime_nightly_rocm523.html)|
|PyTorch 1.11 (ROCm 5.2)||[onnxruntime_nightly_torch1110.rocm52](https://download.onnxruntime.ai/onnxruntime_nightly_rocm511.html)|
Comment thread
PeixuanZuo marked this conversation as resolved.
Outdated
|PyTorch 1.12.1 (ROCm 5.2.3)||[onnxruntime_nightly_torch1121.rocm523](https://download.onnxruntime.ai/onnxruntime_nightly_rocm523.html)|
|PyTorch 1.13 (ROCm 5.2.3)||[onnxruntime_nightly_torch1121.rocm523](https://download.onnxruntime.ai/onnxruntime_nightly_rocm523.html)|
Comment thread
TedThemistokleous marked this conversation as resolved.
Outdated