Skip to content

[LLM] Bump to nixl==0.4.1 #55671

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kouroshHakha merged 11 commits into from
Aug 20, 2025
Merged

[LLM] Bump to nixl==0.4.1 #55671

Show file tree
Hide file tree
Changes from 7 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
27394e3
on mac
lk-chen Aug 15, 2025
7e248db
Merge branch 'master' into ci_compile_x_platform
lk-chen Aug 15, 2025
aaad1d1
adapt master
lk-chen Aug 15, 2025
3683856
s/uv/uv_file
lk-chen Aug 15, 2025
f9851b9
nixl 041
lk-chen Aug 15, 2025
b2a3165
s/uv/uv_file
lk-chen Aug 15, 2025
55b27a5
Merge branch 'ci_compile_x_platform' into bump_nixl_041
lk-chen Aug 15, 2025
b5109d5
s/2_28/linux
lk-chen Aug 18, 2025
6cb4032
Merge branch 'master' into ci_compile_x_platform
lk-chen Aug 18, 2025
3f43983
Merge branch 'ci_compile_x_platform' into bump_nixl_041
lk-chen Aug 19, 2025
64fc537
Merge branch 'master' into bump_nixl_041
lk-chen Aug 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 25 additions & 0 deletions BUILD.bazel
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,6 +87,31 @@ config_setting(
flag_values = {":jemalloc_flag": "true"},
)

config_setting(
name = "linux_x86_64",
constraint_values = [
"@platforms//os:linux",
"@platforms//cpu:x86_64",
],
)

config_setting(
name = "darwin_aarch64",
constraint_values = [
"@platforms//os:osx",
"@platforms//cpu:aarch64",
],
)

alias(
name = "uv_file",
actual = select({
"//:linux_x86_64": "@uv_x86_64-linux//:file",
"//:darwin_aarch64": "@uv_aarch64-darwin//:file",
"//conditions:default": "@uv_x86_64-linux//:file",
}),
Comment on lines +108 to +112

@gemini-code-assist gemini-code-assist Bot Aug 15, 2025

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The use of //conditions:default to fall back to the linux_x86_64 binary might cause confusing runtime errors on unsupported platforms (e.g., linux_aarch64). When an unsupported platform is used, it will attempt to use the x86_64 binary and fail. It would be more robust to have the build fail explicitly during the analysis phase for unsupported platforms. Consider removing the default case, which will cause Bazel to error out if no condition matches, providing a clearer error to the user.

    actual = select({
        "//:linux_x86_64": "@uv_x86_64-linux//:file",
        "//:darwin_aarch64": "@uv_aarch64-darwin//:file",
    }),

@elliot-barn elliot-barn Aug 18, 2025

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree we can scrap the default and error out if an supported platform is used

@elliot-barn elliot-barn Aug 18, 2025

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we do check and throw an error for unsupported platforms in raydepsets but I don't see the point in using a default here?

)

# bazel run :refresh_compile_commands for compile_commands generation for clangd
# https://github.com/hedronvision/bazel-compile-commands-extractor?tab=readme-ov-file#vscode - directions for clangd config
refresh_compile_commands(
Expand Down
15 changes: 14 additions & 1 deletion WORKSPACE
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -117,7 +117,7 @@ filegroup(
)

http_archive(
name = "uv_x86_64",
name = "uv_x86_64-linux",
build_file_content = """
filegroup(
name = "file",
Expand All @@ -129,6 +129,19 @@ filegroup(
urls = ["https://github.com/astral-sh/uv/releases/download/0.8.10/uv-x86_64-unknown-linux-gnu.tar.gz"],
)

http_archive(
name = "uv_aarch64-darwin",
build_file_content = """
filegroup(
name = "file",
srcs = glob(["**"]),
visibility = ["//visibility:public"],
)
""",
sha256 = "5200278ae00b5c0822a7db7a99376b2167e8e9391b29c3de22f9e4fdebc9c0e8",
urls = ["https://github.com/astral-sh/uv/releases/download/0.8.10/uv-aarch64-apple-darwin.tar.gz"],
)

http_archive(
name = "com_github_storypku_bazel_iwyu",
sha256 = "aa78c331a2cb139f73f7d74eeb4d5ab29794af82023ef5d6d5194f76b7d37449",
Expand Down
4 changes: 2 additions & 2 deletions ci/compile_llm_requirements.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,8 +13,8 @@ mkdir -p /tmp/ray-deps

# Remove the GPU constraints
cp python/requirements_compiled.txt /tmp/ray-deps/requirements_compiled.txt
sed -i '/^--extra-index-url /d' /tmp/ray-deps/requirements_compiled.txt
sed -i '/^--find-links /d' /tmp/ray-deps/requirements_compiled.txt
sed -e '/^--extra-index-url /d' -e '/^--find-links /d' /tmp/ray-deps/requirements_compiled.txt > /tmp/ray-deps/requirements_compiled.txt.tmp
mv /tmp/ray-deps/requirements_compiled.txt.tmp /tmp/ray-deps/requirements_compiled.txt
Comment on lines 15 to +17

@gemini-code-assist gemini-code-assist Bot Aug 15, 2025

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

These three lines can be simplified into a single sed command that reads from the source file and writes to the destination file. This avoids an intermediate copy and a temporary file, making the script cleaner and more efficient.

Suggested change
cp python/requirements_compiled.txt /tmp/ray-deps/requirements_compiled.txt
sed -i '/^--extra-index-url /d' /tmp/ray-deps/requirements_compiled.txt
sed -i '/^--find-links /d' /tmp/ray-deps/requirements_compiled.txt
sed -e '/^--extra-index-url /d' -e '/^--find-links /d' /tmp/ray-deps/requirements_compiled.txt > /tmp/ray-deps/requirements_compiled.txt.tmp
mv /tmp/ray-deps/requirements_compiled.txt.tmp /tmp/ray-deps/requirements_compiled.txt
sed -e '/^--extra-index-url /d' -e '/^--find-links /d' python/requirements_compiled.txt > /tmp/ray-deps/requirements_compiled.txt

Comment on lines +16 to +17

@aslonnie aslonnie Aug 16, 2025

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this change?


bazel run //ci/raydepsets:raydepsets -- build ci/raydepsets/rayllm.depsets.yaml

Expand Down
2 changes: 1 addition & 1 deletion ci/raydepsets/BUILD.bazel
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ py_library(
srcs = [
"cli.py",
],
data = ["@uv_x86_64//:file"],
data = ["//:uv_file"],
deps = [
":workspace",
ci_require("bazel-runfiles"),
Expand Down
13 changes: 8 additions & 5 deletions ci/raydepsets/cli.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -274,8 +274,11 @@ def _override_uv_flags(flags: List[str], args: List[str]) -> List[str]:
def _uv_binary():
r = runfiles.Create()
system = platform.system()
if system != "Linux" or platform.processor() != "x86_64":
raise RuntimeError(
f"Unsupported platform/processor: {system}/{platform.processor()}"
)
return r.Rlocation("uv_x86_64/uv-x86_64-unknown-linux-gnu/uv")
processor = platform.processor()

if system == "Linux" and processor == "x86_64":
return r.Rlocation("uv_x86_64-linux/uv-x86_64-unknown-linux-gnu/uv")
elif system == "Darwin" and (processor == "arm" or processor == "aarch64"):
return r.Rlocation("uv_aarch64-darwin/uv-aarch64-apple-darwin/uv")
else:
raise RuntimeError(f"Unsupported platform/processor: {system}/{processor}")
1 change: 1 addition & 0 deletions ci/raydepsets/rayllm.depsets.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ build_arg_sets:
- --extra-index-url https://download.pytorch.org/whl/${CUDA_CODE}
append_flags:
- --python-version=3.11
- --python-platform=x86_64-manylinux_2_28

@aslonnie aslonnie Aug 16, 2025

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we use manylinux2014, not 2_28

build_arg_sets:
- cpu
- cu121
Expand Down
4 changes: 2 additions & 2 deletions docker/ray-llm/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ sudo apt-get install -y kmod pkg-config librdmacm-dev cmake
--no-questions
)

UCX_VERSION="1.18.1"
UCX_VERSION="1.19.0"
(
echo "Installing UCX ${UCX_VERSION}"
cd "${TEMP_DIR}"
Expand Down Expand Up @@ -109,7 +109,7 @@ UCX_VERSION="1.18.1"
)

# Keep in sync with llm-requirements.txt
NIXL_VERSION="0.3.1"
NIXL_VERSION="0.4.1"
(
echo "Installing NIXL ${NIXL_VERSION}"
# NIXL needs meson pybind11 ninja, but should have been included in requirements_*.txt
Expand Down
2 changes: 1 addition & 1 deletion python/requirements/llm/llm-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@ hf_transfer
transformers<4.54.0 # Due to https://github.com/vllm-project/vllm-ascend/issues/2046

# nixl version Needs to be in sync with the one in ray-llm/Dockerfile
nixl==0.3.1
nixl==0.4.1
2 changes: 1 addition & 1 deletion python/requirements_compiled_ray_py311_cpu.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cpu --python-version=3.11 -c python/requirements_compiled_ray_test_py311_cpu.txt python/requirements.txt -o python/requirements_compiled_ray_py311_cpu.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cpu --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c python/requirements_compiled_ray_test_py311_cpu.txt python/requirements.txt -o python/requirements_compiled_ray_py311_cpu.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cpu

Expand Down
2 changes: 1 addition & 1 deletion python/requirements_compiled_ray_py311_cu121.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu121 --python-version=3.11 -c python/requirements_compiled_ray_test_py311_cu121.txt python/requirements.txt -o python/requirements_compiled_ray_py311_cu121.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu121 --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c python/requirements_compiled_ray_test_py311_cu121.txt python/requirements.txt -o python/requirements_compiled_ray_py311_cu121.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cu121

Expand Down
2 changes: 1 addition & 1 deletion python/requirements_compiled_ray_py311_cu128.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu128 --python-version=3.11 -c python/requirements_compiled_ray_test_py311_cu128.txt python/requirements.txt -o python/requirements_compiled_ray_py311_cu128.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu128 --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c python/requirements_compiled_ray_test_py311_cu128.txt python/requirements.txt -o python/requirements_compiled_ray_py311_cu128.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cu128

Expand Down
2 changes: 1 addition & 1 deletion python/requirements_compiled_ray_test_py311_cpu.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cpu --python-version=3.11 -c /tmp/ray-deps/requirements_compiled.txt python/requirements.txt python/requirements/cloud-requirements.txt python/requirements/base-test-requirements.txt -o python/requirements_compiled_ray_test_py311_cpu.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cpu --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c /tmp/ray-deps/requirements_compiled.txt python/requirements.txt python/requirements/cloud-requirements.txt python/requirements/base-test-requirements.txt -o python/requirements_compiled_ray_test_py311_cpu.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cpu

Expand Down
2 changes: 1 addition & 1 deletion python/requirements_compiled_ray_test_py311_cu121.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu121 --python-version=3.11 -c /tmp/ray-deps/requirements_compiled.txt python/requirements.txt python/requirements/cloud-requirements.txt python/requirements/base-test-requirements.txt -o python/requirements_compiled_ray_test_py311_cu121.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu121 --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c /tmp/ray-deps/requirements_compiled.txt python/requirements.txt python/requirements/cloud-requirements.txt python/requirements/base-test-requirements.txt -o python/requirements_compiled_ray_test_py311_cu121.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cu121

Expand Down
2 changes: 1 addition & 1 deletion python/requirements_compiled_ray_test_py311_cu128.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu128 --python-version=3.11 -c /tmp/ray-deps/requirements_compiled.txt python/requirements.txt python/requirements/cloud-requirements.txt python/requirements/base-test-requirements.txt -o python/requirements_compiled_ray_test_py311_cu128.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu128 --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c /tmp/ray-deps/requirements_compiled.txt python/requirements.txt python/requirements/cloud-requirements.txt python/requirements/base-test-requirements.txt -o python/requirements_compiled_ray_test_py311_cu128.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cu128

Expand Down
16 changes: 10 additions & 6 deletions python/requirements_compiled_rayllm_py311_cpu.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cpu --python-version=3.11 -c python/requirements_compiled_rayllm_test_py311_cpu.txt python/requirements.txt python/requirements/llm/llm-requirements.txt -o python/requirements_compiled_rayllm_py311_cpu.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cpu --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c python/requirements_compiled_rayllm_test_py311_cpu.txt python/requirements.txt python/requirements/llm/llm-requirements.txt -o python/requirements_compiled_rayllm_py311_cpu.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cpu

Expand Down Expand Up @@ -1672,11 +1672,15 @@ ninja==1.11.1.3 \
# -r python/requirements/llm/llm-requirements.txt
# vllm
# xgrammar
nixl==0.3.1 \
--hash=sha256:20428ad2668062a79045fae83cc5cba1f4019d4a2c7053cc8549c3a1533f8a75 \
--hash=sha256:70b8932b50ccf1a13ac8fa2e10a4b78290baae9f963bfecfa67684104331a94b \
--hash=sha256:8c144839484b3076f0b34ad8ceaeaff05c23399cf57ca85f2a94b44e1475a39b \
--hash=sha256:ff59996ad05a7e4ba6c8beba0f1d8ac2f9e53df696a15af0d3340028e2f16081
nixl==0.4.1 \
--hash=sha256:10c7b4a44f89c3fbff3e20cb84973be95f8df36ee336fb108275ed1839fec1f1 \
--hash=sha256:510cc9e824ad53cac71ce55ff41160f2a9e1507ceb52eb871b775fe1e42beb87 \
--hash=sha256:8a3d83b28c16b795bdc281f1489b9d247f6e6088ad96ca96406072a36d6354b7 \
--hash=sha256:9381fd3986d227c7ccb2607c03bbea559ec80f951e2ea47c1fbf381e4cd97164 \
--hash=sha256:9ab7e580e9962ebdcda8c17f8548858d3fdb648621367d8e717ca317b534b778 \
--hash=sha256:db144821de7912cb2502052b3070a1ac276b8b019470e6efdfce9c237ffe130d \
--hash=sha256:e33102b85b3f95a8c95e59b59b29aabd03d47b5bce619de506b9bb83739cf60d \
--hash=sha256:f16092dd445542e82e3db3553f6c7697ec5a2e837f19d416401283ae245826f9
# via
# -c python/requirements_compiled_rayllm_test_py311_cpu.txt
# -r python/requirements/llm/llm-requirements.txt
Expand Down
16 changes: 10 additions & 6 deletions python/requirements_compiled_rayllm_py311_cu121.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu121 --python-version=3.11 -c python/requirements_compiled_rayllm_test_py311_cu121.txt python/requirements.txt python/requirements/llm/llm-requirements.txt -o python/requirements_compiled_rayllm_py311_cu121.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu121 --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c python/requirements_compiled_rayllm_test_py311_cu121.txt python/requirements.txt python/requirements/llm/llm-requirements.txt -o python/requirements_compiled_rayllm_py311_cu121.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cu121

Expand Down Expand Up @@ -1672,11 +1672,15 @@ ninja==1.11.1.3 \
# -r python/requirements/llm/llm-requirements.txt
# vllm
# xgrammar
nixl==0.3.1 \
--hash=sha256:20428ad2668062a79045fae83cc5cba1f4019d4a2c7053cc8549c3a1533f8a75 \
--hash=sha256:70b8932b50ccf1a13ac8fa2e10a4b78290baae9f963bfecfa67684104331a94b \
--hash=sha256:8c144839484b3076f0b34ad8ceaeaff05c23399cf57ca85f2a94b44e1475a39b \
--hash=sha256:ff59996ad05a7e4ba6c8beba0f1d8ac2f9e53df696a15af0d3340028e2f16081
nixl==0.4.1 \
--hash=sha256:10c7b4a44f89c3fbff3e20cb84973be95f8df36ee336fb108275ed1839fec1f1 \
--hash=sha256:510cc9e824ad53cac71ce55ff41160f2a9e1507ceb52eb871b775fe1e42beb87 \
--hash=sha256:8a3d83b28c16b795bdc281f1489b9d247f6e6088ad96ca96406072a36d6354b7 \
--hash=sha256:9381fd3986d227c7ccb2607c03bbea559ec80f951e2ea47c1fbf381e4cd97164 \
--hash=sha256:9ab7e580e9962ebdcda8c17f8548858d3fdb648621367d8e717ca317b534b778 \
--hash=sha256:db144821de7912cb2502052b3070a1ac276b8b019470e6efdfce9c237ffe130d \
--hash=sha256:e33102b85b3f95a8c95e59b59b29aabd03d47b5bce619de506b9bb83739cf60d \
--hash=sha256:f16092dd445542e82e3db3553f6c7697ec5a2e837f19d416401283ae245826f9
# via
# -c python/requirements_compiled_rayllm_test_py311_cu121.txt
# -r python/requirements/llm/llm-requirements.txt
Expand Down
16 changes: 10 additions & 6 deletions python/requirements_compiled_rayllm_py311_cu128.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# This file was autogenerated by uv via the following command:
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu128 --python-version=3.11 -c python/requirements_compiled_rayllm_test_py311_cu128.txt python/requirements.txt python/requirements/llm/llm-requirements.txt -o python/requirements_compiled_rayllm_py311_cu128.txt
# uv pip compile --generate-hashes --strip-extras --unsafe-package ray --unsafe-package setuptools --index-url https://pypi.org/simple --index-strategy unsafe-best-match --no-strip-markers --emit-index-url --emit-find-links --extra-index-url https://download.pytorch.org/whl/cu128 --python-version=3.11 --python-platform=x86_64-manylinux_2_28 -c python/requirements_compiled_rayllm_test_py311_cu128.txt python/requirements.txt python/requirements/llm/llm-requirements.txt -o python/requirements_compiled_rayllm_py311_cu128.txt
--index-url https://pypi.org/simple
--extra-index-url https://download.pytorch.org/whl/cu128

Expand Down Expand Up @@ -1636,11 +1636,15 @@ ninja==1.11.1.4 \
# -r python/requirements/llm/llm-requirements.txt
# vllm
# xgrammar
nixl==0.3.1 \
--hash=sha256:20428ad2668062a79045fae83cc5cba1f4019d4a2c7053cc8549c3a1533f8a75 \
--hash=sha256:70b8932b50ccf1a13ac8fa2e10a4b78290baae9f963bfecfa67684104331a94b \
--hash=sha256:8c144839484b3076f0b34ad8ceaeaff05c23399cf57ca85f2a94b44e1475a39b \
--hash=sha256:ff59996ad05a7e4ba6c8beba0f1d8ac2f9e53df696a15af0d3340028e2f16081
nixl==0.4.1 \
--hash=sha256:10c7b4a44f89c3fbff3e20cb84973be95f8df36ee336fb108275ed1839fec1f1 \
--hash=sha256:510cc9e824ad53cac71ce55ff41160f2a9e1507ceb52eb871b775fe1e42beb87 \
--hash=sha256:8a3d83b28c16b795bdc281f1489b9d247f6e6088ad96ca96406072a36d6354b7 \
--hash=sha256:9381fd3986d227c7ccb2607c03bbea559ec80f951e2ea47c1fbf381e4cd97164 \
--hash=sha256:9ab7e580e9962ebdcda8c17f8548858d3fdb648621367d8e717ca317b534b778 \
--hash=sha256:db144821de7912cb2502052b3070a1ac276b8b019470e6efdfce9c237ffe130d \
--hash=sha256:e33102b85b3f95a8c95e59b59b29aabd03d47b5bce619de506b9bb83739cf60d \
--hash=sha256:f16092dd445542e82e3db3553f6c7697ec5a2e837f19d416401283ae245826f9
# via
# -c python/requirements_compiled_rayllm_test_py311_cu128.txt
# -r python/requirements/llm/llm-requirements.txt
Expand Down
Loading