-
Notifications
You must be signed in to change notification settings - Fork 690
build: fixes to enable vLLM slim runtime image #1058
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
29 commits
Select commit
Hold shift + click to select a range
d925032
Add mising dependencies into slim runtime container
nv-tusharma b6faf9c
Remove extra whitespace
nv-tusharma 68b0ef5
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma c60cb15
Move etcd command after the etcd folder is copied over
nv-tusharma 3dc9580
Change ucx directory to align with recent changes
nv-tusharma c5f5813
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma 6b30373
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma 0a690ea
Remove --no-index as argument isn't required for installing nixl
nv-tusharma 211dd20
Install common dependencies as part of requirements.txt
nv-tusharma 0fe5b94
Add common requirements to vllm container
nv-tusharma 4774c07
Revert "Add common requirements to vllm container"
nv-tusharma 89d9533
Install common dependencies seperately from dynamo & vllm installation
nv-tusharma 0c8dfc0
nit: remove requirements.txt installation from dynamo install step
nv-tusharma f883885
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma 17d9555
Copy ucx plugin into final runtime image
nv-tusharma cd509c5
Install build-essential to unblock disagg deployments
nv-tusharma e426ab9
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma b898f30
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma 4384dfa
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma 9a3cec3
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma f9ed4f8
Remove ref to ucx_path and add nixl plugins to LD_LIBRARY_PATH in rt …
nv-tusharma 846ee1a
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma e4a3406
Add NIXL plugins to ldconfig instead of setting LD_LIBRARY_PATH
nv-tusharma f6f09ef
Re-add VIRTUAL_ENV to path
nv-tusharma 0b11d64
Copy NIXL wheel + point LD_LIBRARY_PATH to C++ bindings instead of py…
nv-tusharma 2c6333c
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma 77cc9ff
nit: minor suggestions to improve vllm dockerfiles
nv-tusharma 9cdc46b
nit: minor dockerfile syntax fix
nv-tusharma 5bd4957
Merge branch 'main' into tusharma/slim-runtime-vllm-build
nv-tusharma File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.