[CI/Build] Add Dockerfile.cuda for NVIDIA GPU users [Skip-CI]

[loveysuby]

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Add Dockerfile.cuda for NVIDIA GPU users to build custom Docker images.

This addresses review feedback on PR #1386 that Dockerfile.ci is not suitable for end users:

• Installs unnecessary dev packages (.[dev])
• Has empty ENTRYPOINT requiring explicit vllm serve --omni
• Named/intended for CI-only use

The new Dockerfile follows the same structure as Dockerfile.rocm. (#280)

Build with a specific vLLM base image version (e.g. v0.14.0 - default: v0.19.0):

DOCKER_BUILDKIT=1 docker build -f docker/Dockerfile.cuda \
  --build-arg BASE_IMAGE=vllm/vllm-openai:v0.19.0 \
  -t vllm-omni-cuda .

Test Plan

Verified Dockerfile syntax with docker build --check across all official vLLM release versions:

cd vllm-omni/
curl -s "https://hub.docker.com/v2/repositories/vllm/vllm-openai/tags?page_size=100" \
  | jq -r '.results[].name' \
  | grep -E '^v[0-9]+\.[0-9]+\.[0-9]+$' \
  | sort -Vr \
  | while read version; do
      DOCKER_BUILDKIT=1 docker build --check -f docker/Dockerfile.cuda --build-arg BASE_IMAGE=vllm/vllm-openai:$version . || break
    done

Test Result

[+] Building 3.3s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.15.1                                                                                                                                         3.3s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.1s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.15.0                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.1s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.14.1                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.2s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.14.0                                                                                                                                         1.2s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.1s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.13.0                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.2s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.12.0                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.2s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.11.2                                                                                                                                         1.2s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.1s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.11.1                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.2s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.11.0                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

[+] Building 1.2s (3/3) FINISHED                                                                                                                                                            docker:desktop-linux
 => [internal] load build definition from Dockerfile.cuda                                                                                                                                                   0.0s
 => => transferring dockerfile: 809B                                                                                                                                                                        0.0s
 => [internal] load metadata for docker.io/vllm/vllm-openai:v0.10.2                                                                                                                                         1.1s
 => [internal] load .dockerignore                                                                                                                                                                           0.0s
 => => transferring context: 2B                                                                                                                                                                             0.0s
Check complete, no warnings found.

---

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan. Please providing the test scripts & test commands. Please state the reasons if your codes don't require additional test scripts. For test file guidelines, please check the test style doc
• The test results. Please pasting the results comparison before and after, or e2e results.
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model. Please run mkdocs serve to sync the documentation editions to ./docs.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 986f39bf65

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

[chatgpt-codex-connector]

Remove inherited CMD from vllm-openai stage

The vllm-openai stage is built FROM final, so it inherits CMD ["/bin/bash"] from this stage; with ENTRYPOINT ["vllm", "serve", "--omni"], Docker will run vllm serve --omni /bin/bash by default, which passes /bin/bash as an extra argument and can break container startup unless users override the command. This affects the default build target because vllm-openai is the last stage in this Dockerfile.

Useful? React with 👍 / 👎.

[loveysuby]

Updated to use empty entrypoint for consistency with Dockerfile.rocm.

I was wondering if it might be helpful to use ENTRYPOINT ["vllm", "serve", "--omni"] as a common pattern for both Dockerfiles.rocm & .cuda.

[hsliuustc0106]

@vllm-omni-reviewer

[lishunyang12]

Left a couple comments — mainly the missing system deps (sox etc) which both existing Dockerfiles install.

[tzhouam]

@ywang96 Can we use the dockerfile that updates the docker in https://hub.docker.com/r/vllm/vllm-omni/tags

[loveysuby]

@lishunyang12 @tzhouam Thanks for the review! All suggestions addressed in 4800362.
This PR supports #1386 (docs about usage of Dockerfile.cuda) — I'll update that docs once this pr looks RTM comments.

@tzhouam @ywang96 About the Docker Hub question — my initial plan was to keep this for end-user custom builds (as in #1386), but I'm open to using it for the official hub.docker.com/r/vllm/vllm-omni/tags builds too if that would be helpful. Would that direction make sense?

[Gaohan123]

@tzhouam @ywang96 PTAL again

[tzhouam]

please update this to v0.17.0 or v0.18.0(will release soon)

[loveysuby]

Thanks, revised in 9bcf730 !

[lishunyang12]

Thanks for addressing those. Will take another look.

[lishunyang12]

Looks good. System deps are there now, nice and minimal.

[Gaohan123]

As vLLM-Omni just updates to 0.19.0rc1, which matchs vLLM 0.19.0. Please modify it. Thanks

[loveysuby]

Thanks, updated 0.19.0 in b2e8284

[tzhouam]

LGTM, please fix the vllm version