Create UBI based vLLM docker build instructions by ghandoura · Pull Request #713 · vllm-project/vllm-gaudi

ghandoura · 2025-12-12T11:34:17Z

Minor change in the docker file to build from root directory.

Copilot

Pull request overview

This PR adds documentation and build instructions for a UBI (Red Hat Universal Base Image) based vLLM Docker container. The changes enable users to build vLLM with Intel® Gaudi® support on RHEL-based systems in addition to the existing Ubuntu-based option.

Key Changes:

Updated installation documentation to reference both Ubuntu and UBI-based Dockerfiles
Added comprehensive UBI Dockerfile build instructions with configurable build arguments
Corrected COPY paths in the UBI Dockerfile to build from repository root

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File	Description
docs/getting_started/installation.md	Added new section documenting UBI-based Dockerfile build process with build arguments and usage examples
.cd/Dockerfile.rhel.ubi.vllm	Updated COPY paths to use `.cd/` prefix for building from repository root directory

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

mhelf-intel · 2025-12-15T10:59:56Z

My suggestions are in this PR: ghandoura#1

github-actions · 2025-12-15T14:50:13Z

🚧 CI Blocked

The main CI workflow was not started for the following reason:

Your branch is behind the base branch. Please merge or rebase to get the latest changes.

Minor change in the docker file to build from root directory. Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com>

Signed-off-by: mhelf-intel <monika.helfer@intel.com>

ghandoura · 2025-12-15T15:02:29Z

@PatrykWo document updates done

github-actions · 2025-12-15T15:04:07Z

🚧 CI Blocked

The main CI workflow was not started for the following reason:

Your branch is behind the base branch. Please merge or rebase to get the latest changes.

adobrzyn · 2026-02-04T10:41:27Z

@PatrykWo - please verify if this is still needed and merge if it is

Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com>

Minor change in the docker file to build from root directory. --------- Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com> Signed-off-by: Rohit kumar Singh <rksingh@habana.ai>

Minor change in the docker file to build from root directory. --------- Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com>

Minor change in the docker file to build from root directory. --------- Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com> (cherry picked from commit 40a425f)

Minor change in the docker file to build from root directory. --------- Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com> (cherry picked from commit 40a425f) Signed-off-by: PatrykWo <patryk.wolsza@intel.com>

…0.15.1 (#1049) ## Summary This PR cherry-picks all RHEL/UBI Dockerfile changes merged to `main` after `releases/v0.15.1` into the v0.15.1 release branch. ## Cherry-picked PRs | PR | Commit | Description | |----|--------|-------------| | [#923](#923) | `6d15fdc` | [GAUDISW-244821] Modify UBI docker to support both internal and external builds | | [#811](#811) | `a0a0d36` | Fix reported version of vllm | | [#713](#713) | `40a425f` | Create UBI based vLLM docker build instructions | | [#974](#974) | `6db03ad` | [GADC-941] Add libfdt-devel (new habanalabs-thunk dependency) to UBI Dockerfile | | [#971](#971) | `a3855ac` | [GAUDISW-246357] UBI images improvements | | [#1008](#1008) | `b3b2fb3` | Fix Dockerfile for RHEL 9.6 build by updating package installation order | ## Key changes in `.cd/Dockerfile.rhel.ubi.vllm` - Added new build args: `OS_VERSION`, `OS_STRING`, `PT_MODULES_REPO_NAME`, `PT_PACKAGE_NAME_NON_DEFAULT_PYTHON_SUBSTRING`, `PYPI_INDEX_URL`, `HABANA_RPM_REPO_PATH` - Support `SYNAPSE_REVISION=latest` (auto-detects newest available revision) - Detected Synapse revision stored in `/etc/habanalabs/synapse_revision` for use across stages - `dnf install` uses `--allowerasing` throughout; `openssl-fips-provider-so` removal has `|| true` to support RHEL 9.4 - Added packages: `libomp`, `libjpeg-turbo-devel` (replaces `libjpeg-devel`), `libfdt-devel` - `pip` calls use `--no-cache-dir` - vLLM install: replaced `use_existing_torch.py` with `pip install -r <(sed '/^torch/d' requirements/build.txt)` - `pip check` added after installation - Final stage renamed to `AS vllm-openai` - `OS_STRING` is now parametric (supports both RHEL 9.4 and 9.6) --------- Signed-off-by: Michal Muszynski <mmuszynski@habana.ai> Signed-off-by: PatrykWo <patryk.wolsza@intel.com> Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Signed-off-by: Michal Muszynski <michal.muszynski@intel.com> Co-authored-by: Michal Muszynski <141021743+mmuszynskihabana@users.noreply.github.com> Co-authored-by: Adam Ghandoura <adam.ghandoura@intel.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Iryna Boiko <iboiko@habana.ai> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: Michał Kuligowski <michal.kuligowski@intel.com> Co-authored-by: Agata Dobrzyniewicz <160237065+adobrzyn@users.noreply.github.com>

…0.15.1 (#1049) This PR cherry-picks all RHEL/UBI Dockerfile changes merged to `main` after `releases/v0.15.1` into the v0.15.1 release branch. | PR | Commit | Description | |----|--------|-------------| | [#923](#923) | `6d15fdc` | [GAUDISW-244821] Modify UBI docker to support both internal and external builds | | [#811](#811) | `a0a0d36` | Fix reported version of vllm | | [#713](#713) | `40a425f` | Create UBI based vLLM docker build instructions | | [#974](#974) | `6db03ad` | [GADC-941] Add libfdt-devel (new habanalabs-thunk dependency) to UBI Dockerfile | | [#971](#971) | `a3855ac` | [GAUDISW-246357] UBI images improvements | | [#1008](#1008) | `b3b2fb3` | Fix Dockerfile for RHEL 9.6 build by updating package installation order | - Added new build args: `OS_VERSION`, `OS_STRING`, `PT_MODULES_REPO_NAME`, `PT_PACKAGE_NAME_NON_DEFAULT_PYTHON_SUBSTRING`, `PYPI_INDEX_URL`, `HABANA_RPM_REPO_PATH` - Support `SYNAPSE_REVISION=latest` (auto-detects newest available revision) - Detected Synapse revision stored in `/etc/habanalabs/synapse_revision` for use across stages - `dnf install` uses `--allowerasing` throughout; `openssl-fips-provider-so` removal has `|| true` to support RHEL 9.4 - Added packages: `libomp`, `libjpeg-turbo-devel` (replaces `libjpeg-devel`), `libfdt-devel` - `pip` calls use `--no-cache-dir` - vLLM install: replaced `use_existing_torch.py` with `pip install -r <(sed '/^torch/d' requirements/build.txt)` - `pip check` added after installation - Final stage renamed to `AS vllm-openai` - `OS_STRING` is now parametric (supports both RHEL 9.4 and 9.6) --------- Signed-off-by: Michal Muszynski <mmuszynski@habana.ai> Signed-off-by: PatrykWo <patryk.wolsza@intel.com> Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Signed-off-by: Michal Muszynski <michal.muszynski@intel.com> Co-authored-by: Michal Muszynski <141021743+mmuszynskihabana@users.noreply.github.com> Co-authored-by: Adam Ghandoura <adam.ghandoura@intel.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Iryna Boiko <iboiko@habana.ai> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: Michał Kuligowski <michal.kuligowski@intel.com> Co-authored-by: Agata Dobrzyniewicz <160237065+adobrzyn@users.noreply.github.com>

Minor change in the docker file to build from root directory. --------- Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com> Signed-off-by: mhelf-intel <monika.helfer@intel.com> Co-authored-by: aghandoura <adam.ghandoura@gmail.com> Co-authored-by: mhelf-intel <monika.helfer@intel.com>

ghandoura requested a review from kzawora-intel as a code owner December 12, 2025 11:34

Copilot AI review requested due to automatic review settings December 12, 2025 11:34

ghandoura requested review from adobrzyn, afierka-intel, iboiko-habana, kamil-kaczor, ksmusz, mgawarkiewicz-intel, michalkuligowski and xuechendi as code owners December 12, 2025 11:34

Copilot AI reviewed Dec 12, 2025

View reviewed changes

Comment thread docs/getting_started/installation.md Outdated

ghandoura changed the title ~~Create UBI base vLLM docker build instuctions~~ Create UBI base vLLM docker build instructions Dec 12, 2025

ghandoura changed the title ~~Create UBI base vLLM docker build instructions~~ Create UBI based vLLM docker build instructions Dec 12, 2025

github-actions Bot mentioned this pull request Dec 12, 2025

🚦 Team Review Dashboard #701

Open

PatrykWo requested a review from mhelf-intel December 12, 2025 12:33

PatrykWo assigned PatrykWo and mhelf-intel and unassigned PatrykWo Dec 12, 2025

PatrykWo added documentation Improvements or additions to documentation skip-gaudi-tests labels Dec 12, 2025

aghandoura and others added 2 commits December 15, 2025 15:59

Create UBI base vLLM docker build instuctions

770dbf2

Minor change in the docker file to build from root directory. Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com>

Documentation review

86b293e

Signed-off-by: mhelf-intel <monika.helfer@intel.com>

ghandoura force-pushed the ubi_docs branch from 77eeaac to 86b293e Compare December 15, 2025 15:01

Merge branch 'main' into ubi_docs

98646ed

Merge branch 'main' into ubi_docs

a73a2a9

Signed-off-by: Adam Ghandoura <adam.ghandoura@intel.com>

PatrykWo approved these changes Feb 6, 2026

View reviewed changes

Merge branch 'main' into ubi_docs

ea34f87

iboiko-habana approved these changes Feb 13, 2026

View reviewed changes

iboiko-habana merged commit 40a425f into vllm-project:main Feb 13, 2026
14 checks passed

PatrykWo mentioned this pull request Feb 26, 2026

[Cherry-pick] Backport RHEL/UBI Dockerfile improvements to releases/v0.15.1 #1049

Merged

PatrykWo mentioned this pull request Feb 26, 2026

Fix RHEL Dockerfile build order and remove obsolete TencentOS Dockerfile #1056

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Create UBI based vLLM docker build instructions#713

Create UBI based vLLM docker build instructions#713
iboiko-habana merged 5 commits into
vllm-project:mainfrom
ghandoura:ubi_docs

ghandoura commented Dec 12, 2025

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

mhelf-intel commented Dec 15, 2025

Uh oh!

github-actions Bot commented Dec 15, 2025

Uh oh!

ghandoura commented Dec 15, 2025

Uh oh!

github-actions Bot commented Dec 15, 2025

Uh oh!

adobrzyn commented Feb 4, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Conversation

ghandoura commented Dec 12, 2025

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

mhelf-intel commented Dec 15, 2025

Uh oh!

github-actions Bot commented Dec 15, 2025

🚧 CI Blocked

Uh oh!

ghandoura commented Dec 15, 2025

Uh oh!

github-actions Bot commented Dec 15, 2025

🚧 CI Blocked

Uh oh!

adobrzyn commented Feb 4, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants