-
Notifications
You must be signed in to change notification settings - Fork 1k
[Doc] Update docs and dockerfiles for rebase of vllm v0.18.0 #2038
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
c1f8001
87dc09d
912d151
4459719
ca162b5
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -76,7 +76,7 @@ ENV UV_EXTRA_INDEX_URL=${PIP_EXTRA_INDEX_URL} | |
| ENV UV_INDEX_STRATEGY="unsafe-best-match" | ||
| ENV UV_LINK_MODE="copy" | ||
|
|
||
| ARG VLLM_VERSION=v0.17.0 | ||
| ARG VLLM_VERSION=v0.18.0 | ||
| RUN git clone -b ${VLLM_VERSION} https://github.com/vllm-project/vllm | ||
|
Comment on lines
+79
to
80
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Changing Useful? React with 👍 / 👎. |
||
| WORKDIR /workspace/vllm | ||
|
|
||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -30,7 +30,7 @@ vLLM-Omni is a Python library that supports the following GPU variants. The libr | |
|
|
||
| ### Pre-built wheels | ||
|
|
||
| Note: Pre-built wheels are currently only available for vLLM-Omni 0.11.0rc1, 0.12.0rc1, 0.14.0rc1, 0.14.0, 0.16.0. For the latest version, please [build from source](https://docs.vllm.ai/projects/vllm-omni/en/latest/getting_started/installation/gpu/#build-wheel-from-source). | ||
| Note: Pre-built wheels are currently available for vLLM-Omni 0.11.0rc1, 0.12.0rc1, 0.14.0rc1, 0.14.0, 0.16.0, and 0.18.0. If you need a newer unreleased revision, please [build from source](https://docs.vllm.ai/projects/vllm-omni/en/latest/getting_started/installation/gpu/#build-wheel-from-source). | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
This diff updates the GPU install/deploy docs to Useful? React with 👍 / 👎. |
||
|
|
||
| === "NVIDIA CUDA" | ||
|
|
||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Using
vllm/vllm-openai-rocm:v0.18.0as the default base image makes the ROCm Dockerfile unbuildable. Docker Hub's current tag list forvllm/vllm-openai-rocmincludesv0.17.1,v0.17.0, etc., but nov0.18.0, sodocker build -f docker/Dockerfile.rocmnow fails immediately on the initialFROMunless callers overrideBASE_IMAGE.Useful? React with 👍 / 👎.