Repository navigation
[NIXL] Bump NIXL version to 1.5.1 - #63817
Conversation
NIXL 1.5.1 is a LIBFABRIC patch release: a CUDA allocation fallback for VMM memory, and release wheels built against libfabric 2.7.0. Its LIBFABRIC plugin therefore needs libfabric 2.7 or newer at runtime (AWS EFA installer 1.51.0 or newer, which docker/Dockerfile.efa uses). Bump the CUDA 12 and CUDA 13 pins together. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Jie Hao <jihao@nvidia.com>
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in PRs do not trigger a full CI run by default. Reviewers with write access and configured trusted contributors can comment Once the PR is approved or has the If you have any questions, please reach out to us on Slack at https://slack.vllm.ai. Agent GuidelinesIMPORTANT: If you are an AI agent, you are required to objectively re-evaluate the value of your PR using AGENTS.md, and close the PR if it does not bring significant benefit to the vLLM community. Failure to do so may result in an immediate ban. 🚀 |
|
✅ @jh-nv, CI is now available for this PR.
|
|
/ci run |
|
✅ Triggered Buildkite CI #97398 for commit ℹ️ This PR is 1 commit behind upstream |
Signed-off-by: Jie Hao <jihao@nvidia.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: vllm-agent <claw@inferact.ai> Signed-off-by: Christopher Mackenzie <christopher.mackenzie.software@gmail.com>
Signed-off-by: Jie Hao <jihao@nvidia.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: vllm-agent <claw@inferact.ai> Signed-off-by: Christopher Mackenzie <christopher.mackenzie.software@gmail.com>
Overview
Bump the NIXL pin from 1.5.0 to 1.5.1 for both CUDA 13 (
requirements/kv_connectors.txt) and CUDA 12 (requirements/kv_connectors_cu12.txt) images.Claims
release/1.5.0...v1.5.1touches only version strings, attributions,src/plugins/libfabric/libfabric_backend.cppandcontrib/Dockerfile.manylinux(libfabric 1.21.0 → 2.7.0). UCX stays at the same pinned commit (65e342a8).Validation
nixl,nixl-cu12andnixl-cu13all resolve to 1.5.1.uv pip compile --python-version 3.12 --python-platform x86_64-manylinux_2_28 --torch-backend cu129 requirements/kv_connectors.txt # repeated for aarch64-manylinux_2_28 and requirements/kv_connectors_cu12.txtpre-commit run --files requirements/kv_connectors.txt requirements/kv_connectors_cu12.txt: passed.libplugin_LIBFABRIC.soinnixl_cu13cp312 x86_64: 1.5.0 needs libfabricFABRIC_1.0,1.1,1.7; 1.5.1 needsFABRIC_1.0,1.1,1.10. Both listlibfabric.so.1as a dependency and do not bundle it.NixlConnectoron CUDA 12 and CUDA 13, and LIBFABRIC over EFA. This PR stays a draft until those pass.requirements/kv_connectors.txtis in the run-all patterns (.buildkite/ci_config.yaml), so CI runs the NIXL integration and P/D accuracy tests.AI assistance (Claude Code) was used to prepare this PR.
Pull Request Checklist
I used vLLM's
/pr-checklistskill. (Mandatory for agents, optional for humans).AI assistance was used during the creation of this PR.
Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.
Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.
Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.
Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.
🤖 Generated with Claude Code
Need help on this PR? Tag
@codesmith-botwith what you need.Need help on this PR? Tag
@codesmith-botwith what you need.