-
Notifications
You must be signed in to change notification settings - Fork 1.2k
[Bugfix] Adding mooncake library path to fix error: server failed to start with mooncake connector
#6955
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bugfix] Adding mooncake library path to fix error: server failed to start with mooncake connector
#6955
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -47,6 +47,9 @@ RUN apt-get update -y && \ | |
| rm -rf /var/cache/apt/* && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # To keep mooncake can be found | ||
| ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. While adding A more robust way to append to |
||
|
|
||
| # Install vLLM | ||
| ARG VLLM_REPO=https://github.com/vllm-project/vllm.git | ||
| ARG VLLM_TAG=v0.16.0 | ||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -48,6 +48,9 @@ RUN yum update -y && \ | |
| rm -fr /vllm-workspace/Mooncake/build && \ | ||
| rm -rf /var/cache/yum/* | ||
|
|
||
| # To keep mooncake can be found | ||
| ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. While adding A more robust way to append to |
||
|
|
||
| # Install vLLM | ||
| ARG VLLM_REPO=https://github.com/vllm-project/vllm.git | ||
| ARG VLLM_TAG=v0.16.0 | ||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -48,6 +48,9 @@ RUN yum update -y && \ | |
| rm -fr /vllm-workspace/Mooncake/build && \ | ||
| rm -rf /var/cache/yum/* | ||
|
|
||
| # To keep mooncake can be found | ||
| ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. While adding A more robust way to append to |
||
|
|
||
| # Install vLLM | ||
| ARG VLLM_REPO=https://github.com/vllm-project/vllm.git | ||
| ARG VLLM_TAG=v0.16.0 | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
While adding
/usr/local/libtoLD_LIBRARY_PATHis the correct approach, the current implementation can result in a leading colon (:) ifLD_LIBRARY_PATHis not already set. A leading colon inLD_LIBRARY_PATHcauses the dynamic linker to search the current working directory, which can be a security risk and may lead to unexpected behavior.A more robust way to append to
LD_LIBRARY_PATHis to use shell parameter expansion to conditionally add the separator. This avoids the leading colon when the variable is initially empty.