Rebuild for pytorch 2.10 + python 3.14 + CUDA 13.0#44
Conversation
|
Hi! This is the friendly automated conda-forge-linting service. I just wanted to let you know that I linted all conda-recipes in your PR ( |
|
A few jobs did not start; the server is very congested at the moment. Please wait with restarting those until the build out for pytorch is mostly through (this feedstock will likely see new migrators for python 3.14 and CUDA 13.0 anyway due to that merge, one could even decide to wait for those; in any case, let's get the current pytorch builds out the door first) |
|
Ah sure, just saw that got merged. We can wait until the weekend to rerun with py314. |
CUDA 13.0 requires architecture `sm_75` or higher, and renamed `sm_101` to `sm_110`. To build for these, maintainers will need to modify their existing list of specified architectures (e.g. `CMAKE_CUDA_ARCHITECTURES`, `TORCH_CUDA_ARCH_LIST`, etc.) for their package. Since CUDA 12.8, the conda-forge nvcc package now sets `CUDAARCHS` and in its activation script to a string containing all of the supported real architectures plus the virtual architecture of the latest. Recipes for packages who use these variables to control their build but do not want to build for all supported architectures will need to override these variables in their build script. ref: https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#new-features > [[!IMPORTANT]] > Remember to update any CUDA 11/12 specific selector syntax in the recipe to include > CUDA 13. For example `# [(cuda_compiler_version or "None").startswith("12")]` > might be replaced with `# [cuda_compiler_version != "None"]`.
|
@h-vetinari, I'll go with your plan at conda-forge/tensorflow-feedstock#470 (comment) to cherry-pick in #45 and #46 into this PR to conserve CI resources. Assuming that it's ok to push a commit since the tensorflow builds are almost done now. |
…6.01.30.18.13.32 Other tools: - conda-build 25.9.0 - rattler-build 0.55.1 - rattler-build-conda-compat 1.4.6
|
The way I suggest to do this: cherry-pick all the migrator commits, but leave out the rerender commits from the bot. Then do a single rerender commit for all three migrations (which will conveniently also have your authorship so it can run on cirun) |
|
Oh nice. I realized after rerendering that there are separate CUDA 12.9 and 13.0 builds now, and across 2 platform (linux-64 & linux-aarch64) multiplied by 5 python versions, that totals up to 20 builds... Thinking if we should drop the CUDA 12.9 builds here, or some of the older python versions? |
|
It's OK... mostly. We don't really have a choice but to support CUDA 12 & 13 for a while, not least since CUDA 13 dropped a bunch of GPU architectures. CUDA 13 is still just rolling out. The answer is mostly: skip stuff (e.g. everything but a single python version) during development/debugging, and then build out the full matrix only once before the merge. |
Well, flash-attn is for compute capability 8.0+ (Ampere or above), and CUDA 13.0 is compatible to 7.5+ (Turing) if I'm not mistaken. So we could realistically drop CUDA 12.9, assuming people update their drivers. Cutting 10 builds of 8 hours each is a lot of savings. |
well... 😅 If people only updated their OSes, and their drivers, and their libraries, and their python version, life as a distributor would certainly be a heck of a lot easier 😆 In practice, removing support for anything not already dead as a doornail always leads to lots of acrimonious discussion, because no-one likes having something taken away. And in any case, CUDA 12 is faaaaar from that still. For context, we dropped CUDA 11.8 only ~8 months ago. |
|
2/3 GPU jobs for pytorch just finished (and the remaining one should be done soon), so please feel free to go ahead here. There are many other feedstocks in the queue though, so if you happen to not see this (it's the weekend...), I might trigger other builds in the meantime. |
…6.01.31.15.29.35 Other tools: - conda-build 25.9.0 - rattler-build 0.55.1 - rattler-build-conda-compat 1.4.6
|
Cool, I'll trigger 4 builds (Python 3.14 only) as a test for now. Make sure that the combination of Pytorch 2.10 on CUDA12.9/13.0 works for both linux-64/linux-aarch64. |
d00d3aa to
c2be05a
Compare
|
Hi! This is the friendly automated conda-forge-linting service. I just wanted to let you know that I linted all conda-recipes in your PR ( I do have some suggestions for making it better though... For recipe/meta.yaml:
This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/21554512251. Examine the logs at this URL for more detail. |
|
One of the agents lost its connection. You can either cancel & restart, push another commit, or just live with testing 3 builds (which I think is fine too). If you want to push a change, you could add sm_110 (renamed from sm_101) for CUDA 13, for example - - TORCH_CUDA_ARCH_LIST=8.0;8.6;8.9;9.0;10.0;12.0+PTX
+ - TORCH_CUDA_ARCH_LIST=8.0;8.6;8.9;9.0;10.0;12.0+PTX # [(cuda_compiler_version or "").startswith("12")]
+ - TORCH_CUDA_ARCH_LIST=8.0;8.6;8.9;9.0;10.0;11.0;12.0+PTX # [(cuda_compiler_version or "").startswith("13")] |
I was reminded of issues with GCC 14 + CUDA 13 on aarch for pytorch, so I restarted the failed job, which was just that combination |
|
OK this all looks fine now. :) |
This reverts commit d8d5751.
… conda-smithy 3.54.2 and conda-forge-pinning 2026.02.01.23.20.06 Other tools: - conda-build 25.9.0 - rattler-build 0.55.1 - rattler-build-conda-compat 1.4.6
|
Please wait with merging until the linux portion of https://github.com/conda-forge/onnxruntime-feedstock/actions/runs/21577043973 has run through - after that you're good to go! |
|
sm_110 seems to be just for the Jetson Thor chips according to https://developer.nvidia.com/cuda/gpus? Will probably skip that unless someone actually needs it for robotics or something. |
|
Alright, let's get this one built! |
This PR has been triggered in an effort to update pytorch210.
Notes and instructions for merging this PR:
Please note that if you close this PR we presume that the feedstock has been rebuilt, so if you are going to perform the rebuild yourself don't close this PR until the your rebuild has been merged.
If this PR was opened in error or needs to be updated please add the
bot-rerunlabel to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase@conda-forge-admin, please rerun botin a PR comment to have theconda-forge-adminadd it for you.This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/21440468042 - please use this URL for debugging.