build(cuda): Add CUDA_VERSION build arg to adapters dockerfile#16234
build(cuda): Add CUDA_VERSION build arg to adapters dockerfile#16234bdice wants to merge 2 commits intofacebookincubator:mainfrom
Conversation
✅ Deploy Preview for meta-velox canceled.
|
| COPY scripts/setup-centos-adapters.sh / | ||
|
|
||
| ARG CUDA_VERSION | ||
| ENV CUDA_VERSION=${CUDA_VERSION:-12.9} |
There was a problem hiding this comment.
This environment variable is read by bash /setup-centos-adapters.sh install_cuda in the next step.
karthikeyann
left a comment
There was a problem hiding this comment.
Looks good to me.
@czentgr to review this PR since it adds a new ARG to docker image.
|
@peterenescu has imported this pull request. If you are a Meta employee, you can view this in D92988821. |
|
@jainxrohit merged this pull request in 9ea2545. |
|
@bdice Folks looks like the docker publish scripts arent working : https://github.com/facebookincubator/velox/actions/runs/21961775674/job/63448645977 so your cuda version will not be updated. |
|
@kgpai could you elaborate, what is the issue with the script? |
|
Looks like this: Nothing I changed here is arm64-specific. Do the images build successfully without this change? It’s not a network error or something temporary? |
|
@kgpai Triaged the issue. It comes from which is velox/scripts/docker/centos-multi.dockerfile Line 167 in 6dbd604 This seems to be unrelated to this line change, only connection is this PR changes the same file Fix could be either or Or Suggested alternative fix in issue #16386 |
|
To add to @karthikeyann's analysis -- the Dockerfile warning is the trigger, but the reason it breaks the build is a bug in the "Export digests" step of Fixing the Dockerfile warning resolves the immediate issue, but the jq filter should also be hardened so that any future buildx metadata key (e.g., 'def skip: ["ubuntu", "fedora"];
. | to_entries[] | select(.value | has("image.name")) |
.key | split("-")[0] |
if . as $name | skip | index($name) != null then empty else . end' |
|
Cool Thank you @bdice & @karthikeyann ; Not sure when these warnings started appearing in the digest , but as suggested it makes sense to use ld.conf and also fix the jq script. |
…16387) Summary: Fixes issues discussed in #16234. The "Export digests" jq filter processes all top-level bake metadata keys, including non-image keys like `buildx.build.warnings`. The merge job then fails trying to create a manifest for them. Filter to only entries with `image.name` (real image targets), and fix the undefined `$LD_LIBRARY_PATH` that triggers the warning. Analysis: #16234 (comment) and #16234 (comment) I implemented the proposal in #16386 with `ldconfig`. Closes #16386. Pull Request resolved: #16387 Reviewed By: kagamiori Differential Revision: D93810988 Pulled By: kgpai fbshipit-source-id: b8d5d94c5677340aca851153eceb55834dc7cf10
…ookincubator#16234) Summary: We would like to make it easier to configure the CUDA version used in building Velox containers. This PR adds a `CUDA_VERSION` build arg to the adapters stage in `centos-multi.dockerfile` which allows overriding the CUDA version at build time. As before, it defaults to 12.9. This mirrors the approach in prestodb/presto#27074. Pull Request resolved: facebookincubator#16234 Reviewed By: kevinwilfong Differential Revision: D92988821 Pulled By: jainxrohit fbshipit-source-id: f9756fb577bbb8aa4b7d4b775b2cb1c806aa97ac
Summary
We would like to make it easier to configure the CUDA version used in building Velox containers.
This PR adds a
CUDA_VERSIONbuild arg to the adapters stage incentos-multi.dockerfilewhich allows overriding the CUDA version at build time. As before, it defaults to 12.9.This mirrors the approach in prestodb/presto#27074.