Add hipdnn and miopen-plugin to python packaging

[BrianHarrisonAMD]

Motivation

Add hipDNN & MIOpen plugin to the python wheel packaging.
The purpose of this change is to enable hipDNN integration with Pytorch.

Technical Details

• Added hipDNN + plugin project to the packaging script.
• Added hipdnn to _dist_info.py matching with other libraries
• Updated documentation to include details of hipDNN
• Updated build_python_packages.py to allow generic targets to be installed alongside device targets
  • For now this enables hipDNN to be installed alongside other library components.
  • Note: Once RFC0008 is implemented then hipDNN & the plugin should be moved to the host only locations along side the other library projects.

Test Plan

Run a test of the Release portable Linux packages workflow & Windows packages workflow:

Linux test wheels (run here unrelated jax break):

pip install \
  https://therock-dev-python.s3.amazonaws.com/v2/gfx94X-dcgpu/rocm-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425.tar.gz \
  https://therock-dev-python.s3.amazonaws.com/v2/gfx94X-dcgpu/rocm_sdk_core-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425-py3-none-linux_x86_64.whl \
  https://therock-dev-python.s3.amazonaws.com/v2/gfx94X-dcgpu/rocm_sdk_libraries_gfx94x_dcgpu-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425-py3-none-linux_x86_64.whl \
  https://therock-dev-python.s3.amazonaws.com/v2/gfx94X-dcgpu/rocm_sdk_devel-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425-py3-none-linux_x86_64.whl

Windows test wheels (run here):

pip install ^
  https://therock-dev-python.s3.amazonaws.com/v2-staging/gfx110X-all/rocm-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425.tar.gz ^
  https://therock-dev-python.s3.amazonaws.com/v2-staging/gfx110X-all/rocm_sdk_core-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425-py3-none-win_amd64.whl ^
  https://therock-dev-python.s3.amazonaws.com/v2-staging/gfx110X-all/rocm_sdk_libraries_gfx110x_all-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425-py3-none-win_amd64.whl ^
  https://therock-dev-python.s3.amazonaws.com/v2-staging/gfx110X-all/rocm_sdk_devel-7.12.0.dev0%2Be7125827ee12837fefbd91de4b3d1a8b9f0b2425-py3-none-win_amd64.whl

Test Result

Wheel builds are successful with the hipDNN artifacts included.
Additional artifacts from hipDNN are present, and installed correctly.

[BrianHarrisonAMD]

The bundling works, but it showed a couple issues we need to address:

• hipDNN is installing into _rocm_sdk_core right now, and should be _rocm_sdk_libraries
• MIOpen plugin is installed into _rocm_sdk_core, and as a result fails to find the libMIOpen.so (this is due to MIOpen being mixed host & device)

We will need to do some changes to resolve the plugin loading issue, and will follow-up with additional PRs to enable this once it's ready.

[BrianHarrisonAMD]

Attempting to move hipDNN into the libraries install location for now until RFC0008 is implemented.
Re-opening to verify testing and packaging.

[adickin-amd]

Looks good to me. Can even build hipdnn against the windows wheels!

[BrianHarrisonAMD]

Testing was successful with the latest, but seems like some unrelated breaks in other components.
Updating to see if these are resolved in latest.

[adickin-amd]

New changes look good to me!

[mousdahl-amd]

With an update to hipDNN in rocm-libraries, we've got a good signal for rocm wheels tests! Once we land this in rocm-libraries, we're just a submodule bump away from being able to land this PR, I think.

https://github.com/ROCm/TheRock/actions/runs/21755726106

[mousdahl-amd]

I accidentally pushed some submodule bumps when I merged main in, so I've created a new PR that's not ruined forever. #3461

[mousdahl-amd]

Closing as superceded by #3461