Skip to content

[GAUDISW-246357] UBI images improvements #971

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
afierka-intel merged 10 commits into from
Feb 19, 2026
Merged

[GAUDISW-246357] UBI images improvements #971

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
c5a5085
ubi: add pip check and support synapse revision latest
ghandoura Feb 13, 2026
453108f
ubi image: add comment about image lable
ghandoura Feb 13, 2026
41a2cb3
remove crb repo and add allow-erasing
ghandoura Feb 13, 2026
9c472de
Merge branch 'main' into ubi_improvements
michalkuligowski Feb 16, 2026
0d2080b
Merge branch 'main' into ubi_improvements
adobrzyn Feb 17, 2026
310ece6
more fixes
ghandoura Feb 18, 2026
bf22daf
add crb back because of libftd-devel
ghandoura Feb 18, 2026
f3ebd9b
rename last layer
ghandoura Feb 18, 2026
8b7fbb6
fix typo
ghandoura Feb 18, 2026
2c82e75
Merge branch 'main' into ubi_improvements
PatrykWo Feb 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
65 changes: 41 additions & 24 deletions .cd/Dockerfile.rhel.ubi.vllm
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@
# Global build arguments - declared before first FROM to be available in all stages
ARG ARTIFACTORY_URL="vault.habana.ai"
ARG SYNAPSE_VERSION=1.23.0
# Use an exact revision (e.g. 695) or "latest" to auto-detect the newest available revision.
# If you do not want metadata to show "latest", pass an exact SYNAPSE_REVISION.
ARG SYNAPSE_REVISION=695
ARG BASE_NAME=rhel9.6
ARG OS_VERSION=9.6
Expand Down Expand Up @@ -35,7 +37,9 @@ ARG PYPI_INDEX_URL
ARG HABANA_RPM_REPO_PATH
ARG TORCH_TYPE

# Labels for RHEL certification
# Labels for RHEL certification.
# Note: when SYNAPSE_REVISION=latest, this metadata intentionally records "latest"
# (the requested input), not the detected numeric revision.
LABEL vendor="Habanalabs Ltd." \
release="${SYNAPSE_VERSION}-${SYNAPSE_REVISION}"

Expand All @@ -53,11 +57,12 @@ ENV TORCH_TYPE=${TORCH_TYPE} \
COPY LICENSE /licenses/

# System setup - Remove FIPS provider and add EPEL
RUN dnf install -y python3-dnf-plugin-versionlock && \
RUN dnf -y update && \
dnf install -y --allowerasing python3-dnf-plugin-versionlock && \
dnf versionlock add redhat-release* && \
# '|| true' is added to support RHEL 9.4 in which openssl-fips-provider-so is not installed
rpm -e --nodeps openssl-fips-provider-so || true && \
dnf install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-9.noarch.rpm && \
dnf install -y --allowerasing https://dl.fedoraproject.org/pub/epel/epel-release-latest-9.noarch.rpm && \
dnf clean all

# Add CentOS repositories for additional packages
Expand All @@ -66,10 +71,10 @@ RUN printf "[BaseOS]\\nname=CentOS Linux 9 - BaseOS\\nbaseurl=https://mirror.str
printf "[CRB]\\nname=CentOS Linux 9 - CRB\\nbaseurl=https://mirror.stream.centos.org/9-stream/CRB/x86_64/os\\ngpgkey=https://www.centos.org/keys/RPM-GPG-KEY-CentOS-Official-SHA256\\ngpgcheck=1\\n" > /etc/yum.repos.d/CentOS-Linux-CRB.repo

# Install system dependencies
RUN dnf install -y \
RUN dnf install -y --allowerasing \
wget git jq libomp \
# Image processing dependencies (needed for pillow-simd -> habana-media-loader)
zlib-devel libjpeg-devel \
zlib-devel libjpeg-turbo-devel \
# habanalabs-thunk dependency
libfdt-devel \
# Python development
Expand All @@ -85,8 +90,8 @@ RUN alternatives --install /usr/bin/python3 python3 /usr/bin/python3.12 2 && \
ln -s /usr/bin/python3 /usr/bin/python

# Install base Python packages
RUN pip install setuptools==79.0.1 wheel setuptools_scm && \
pip install --upgrade Jinja2 protobuf urllib3 requests
RUN pip install --no-cache-dir setuptools==79.0.1 wheel setuptools_scm && \
pip install --no-cache-dir --upgrade Jinja2 protobuf urllib3 requests

# Setup Habana repository and install Habana packages
RUN printf "[habanalabs]\\nname=Habana RH9 Linux repo\\nbaseurl=https://${ARTIFACTORY_URL}/artifactory/${HABANA_RPM_REPO_PATH}\\ngpgkey=https://${ARTIFACTORY_URL}/artifactory/${HABANA_RPM_REPO_PATH}/repodata/repomd.xml.key\\ngpgcheck=1\\n" > /etc/yum.repos.d/habanalabs.repo && \
Expand All @@ -98,17 +103,30 @@ RUN printf "[habanalabs]\\nname=Habana RH9 Linux repo\\nbaseurl=https://${ARTIFA
rpm --import "${_GPG_TEMP}/habana_pubkey" && \
rm -rf "${_GPG_TEMP}" && \
dnf makecache && \
if [ "${SYNAPSE_REVISION}" = "latest" ]; then \
dnf install -y \
habanalabs-rdma-core-"$SYNAPSE_VERSION"* \
habanalabs-thunk-"$SYNAPSE_VERSION"* \
habanalabs-firmware-tools-"$SYNAPSE_VERSION"* \
habanalabs-graph-"$SYNAPSE_VERSION"*; \
else \
dnf install -y \
habanalabs-rdma-core-"$SYNAPSE_VERSION"-"$SYNAPSE_REVISION"* \
habanalabs-thunk-"$SYNAPSE_VERSION"-"$SYNAPSE_REVISION"* \
habanalabs-firmware-tools-"$SYNAPSE_VERSION"-"$SYNAPSE_REVISION"* \
habanalabs-graph-"$SYNAPSE_VERSION"-"$SYNAPSE_REVISION"* && \
habanalabs-graph-"$SYNAPSE_VERSION"-"$SYNAPSE_REVISION"*; \
fi && \
DETECTED_SYNAPSE_REVISION=$(rpm -q --qf '%{RELEASE}\n' habanalabs-rdma-core | head -n1 | sed 's/\..*$//') && \
mkdir -p /etc/habanalabs && \
echo "${DETECTED_SYNAPSE_REVISION}" > /etc/habanalabs/synapse_revision && \
echo "Detected Synapse revision: ${DETECTED_SYNAPSE_REVISION}" && \
Comment thread
ghandoura marked this conversation as resolved.
dnf clean all && \
chmod +t /var/log/habana_logs && \
rm -f /etc/yum.repos.d/habanalabs.repo

# Install Habana media loader and configure Python path
RUN pip install habana-media-loader=="${SYNAPSE_VERSION}"."${SYNAPSE_REVISION}" --extra-index-url ${PYPI_INDEX_URL} && \
RUN SYNAPSE_REVISION_RUNTIME=$(cat /etc/habanalabs/synapse_revision) && \
pip install --no-cache-dir habana-media-loader=="${SYNAPSE_VERSION}"."${SYNAPSE_REVISION_RUNTIME}" --extra-index-url ${PYPI_INDEX_URL} && \
echo "/usr/lib/habanalabs" > $(python3 -c "import sysconfig; print(sysconfig.get_path('platlib'))")/habanalabs-graph.pth

# ============================================================================
Expand All @@ -131,27 +149,25 @@ ARG TORCH_TYPE
ENV OS_STRING="${OS_STRING}"

# Use installer script from Habana to install Pytorch
RUN PT_PACKAGE_NAME="pytorch_modules${PT_PACKAGE_NAME_NON_DEFAULT_PYTHON_SUBSTRING}-v${PT_VERSION}_${SYNAPSE_VERSION}_${SYNAPSE_REVISION}.tgz" && \
PT_ARTIFACT_PATH="https://${ARTIFACTORY_URL}/artifactory/${PT_MODULES_REPO_NAME}/${SYNAPSE_VERSION}/${SYNAPSE_REVISION}/pytorch/${OS_STRING}" && \
RUN SYNAPSE_REVISION_RUNTIME=$(cat /etc/habanalabs/synapse_revision) && \
PT_PACKAGE_NAME="pytorch_modules${PT_PACKAGE_NAME_NON_DEFAULT_PYTHON_SUBSTRING}-v${PT_VERSION}_${SYNAPSE_VERSION}_${SYNAPSE_REVISION_RUNTIME}.tgz" && \
PT_ARTIFACT_PATH="https://${ARTIFACTORY_URL}/artifactory/${PT_MODULES_REPO_NAME}/${SYNAPSE_VERSION}/${SYNAPSE_REVISION_RUNTIME}/pytorch/${OS_STRING}" && \
TMP_PATH=$(mktemp --directory) && \
wget --no-verbose "${PT_ARTIFACT_PATH}/${PT_PACKAGE_NAME}" && \
tar -zxf "${PT_PACKAGE_NAME}" -C "${TMP_PATH}" && \
cd "${TMP_PATH}" && \
export SKIP_INSTALL_DEPENDENCIES=1 && \
PYTHON_INDEX_URL="--extra-index-url ${PYPI_INDEX_URL}" ./install.sh $SYNAPSE_VERSION $SYNAPSE_REVISION $TORCH_TYPE && \
PYTHON_INDEX_URL="--extra-index-url ${PYPI_INDEX_URL}" ./install.sh $SYNAPSE_VERSION $SYNAPSE_REVISION_RUNTIME $TORCH_TYPE && \
cd / && \
rm -rf "${TMP_PATH}" "${PT_PACKAGE_NAME}"

# System update
RUN dnf -y update --nobest --allowerasing --skip-broken && \
rm -rf "${TMP_PATH}" "${PT_PACKAGE_NAME}" && \
dnf clean all

WORKDIR /workspace

# ============================================================================
# Stage 3: vllm-final - Install vLLM and configure runtime
# ============================================================================
FROM gaudi-pytorch
FROM gaudi-pytorch AS vllm-openai

# Re-declare global ARGs needed in this stage
ARG VLLM_GAUDI_COMMIT
Expand All @@ -165,10 +181,9 @@ ENV BASE_NAME=${BASE_NAME} \
VLLM_PATH2=/workspace/vllm-gaudi

# Install additional system dependencies
RUN dnf update -y --nobest && \
dnf install -y gettext jq git --allowerasing && \
ln -sf /usr/bin/python3 /usr/bin/python && \
dnf clean all
RUN dnf install -y gettext jq git --allowerasing && \
dnf clean all && \
ln -sf /usr/bin/python3 /usr/bin/python

WORKDIR /root

Expand All @@ -190,11 +205,12 @@ RUN set -e && \
git remote add upstream https://github.com/vllm-project/vllm.git && \
git fetch upstream --tags && \
git checkout ${VLLM_PROJECT_COMMIT} && \
pip install -r <(sed '/^torch/d' requirements/build.txt) && \
VLLM_TARGET_DEVICE=empty pip install --no-build-isolation . && \
pip install --no-cache-dir -r <(sed '/^torch/d' requirements/build.txt) && \
VLLM_TARGET_DEVICE=empty pip install --no-cache-dir --no-build-isolation . && \
cd $VLLM_PATH2 && \
git checkout ${VLLM_GAUDI_COMMIT} && \
VLLM_TARGET_DEVICE=hpu pip install -v . --no-build-isolation
VLLM_TARGET_DEVICE=hpu pip install --no-cache-dir -v . --no-build-isolation && \
pip check

# The scripts below are used for benchmarks testing and autocalc:
# RUN pip3 install -v -e $VLLM_PATH/tests/vllm_test_utils
Expand Down Expand Up @@ -222,3 +238,4 @@ COPY LICENSE /licenses/vllm.md

USER 2000
ENTRYPOINT ["python3", "-m", "vllm.entrypoints.openai.api_server"]