Skip to content

[CI][ROCm] Ship RIXL with vllm/vllm-openai-rocm #41634

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tjtanaa merged 5 commits into from
May 8, 2026
Merged

[CI][ROCm] Ship RIXL with vllm/vllm-openai-rocm #41634

Changes from 2 commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
3a2a4e2
fix: install RIXL wheel in final stage of Dockerfile.rocm
simondanielsson May 4, 2026
cd4a320
fix: add --no-install-recommends and mvoe install before COPYs
simondanielsson May 4, 2026
8d9b6ec
docs: update nixl documentation with path to correct image
simondanielsson May 4, 2026
c94ffdf
fix: remove redundant RDMA runtime deps and move RIXL installation to…
simondanielsson May 5, 2026
6b3a617
Merge branch 'main' into ci/rixl-final-image
mergify[bot] May 8, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions docker/Dockerfile.rocm
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -512,11 +512,27 @@ ARG BASE_IMAGE
ARG NIC_BACKEND
ARG AINIC_VERSION

# RIXL/NixlConnector runtime dependencies (RDMA userspace libraries)
Comment thread
simondanielsson marked this conversation as resolved.
Outdated
RUN apt-get update -q && apt-get install -q -y --no-install-recommends \
librdmacm1 \
libibverbs1 \
ibverbs-providers \
ibverbs-utils \
&& rm -rf /var/lib/apt/lists/*

# Install RIXL wheel
Comment thread
simondanielsson marked this conversation as resolved.
Outdated
RUN --mount=type=bind,from=build_rixl,src=/app/install,target=/rixl_install \
uv pip install --system /rixl_install/*.whl

# Copy over the benchmark scripts as well
COPY --from=export_vllm /benchmarks ${COMMON_WORKDIR}/vllm/benchmarks
COPY --from=export_vllm /examples ${COMMON_WORKDIR}/vllm/examples
COPY --from=export_vllm /docker ${COMMON_WORKDIR}/vllm/docker

# Use legacy IPC mode for HSA to avoid GPU memory pinning issues with UCX rocm_ipc
# See: https://github.com/ROCm/rocm-libraries/issues/6266
ENV HSA_ENABLE_IPC_MODE_LEGACY=1

ENV TOKENIZERS_PARALLELISM=false

# ENV that can improve safe tensor loading, and end-to-end time
Expand Down
Loading