Skip to content

[None][feat] Add NIXL-LIBFABRIC support #9225

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
bo-nv merged 10 commits into from
Dec 4, 2025
+8 −7
Merged

[None][feat] Add NIXL-LIBFABRIC support #9225

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
3c6b0aa
[None][feat] Add NIXL-LIBFABRIC
zackyoray Nov 16, 2025
2a7840b
[None][feat] Build NIXL in release type
zackyoray Nov 20, 2025
3aa411e
Update jenkins/current_image_tags.properties
zackyoray Nov 23, 2025
1447b24
Update jenkins/current_image_tags.properties again
zackyoray Nov 25, 2025
e3aa32a
Merge branch 'main' into yorayz/nixl_libfabric
zackyoray Nov 27, 2025
e5193bb
Merge branch 'main' into yorayz/nixl_libfabric
zackyoray Nov 30, 2025
61ee9bb
Merge branch 'main' into yorayz/nixl_libfabric
zackyoray Dec 1, 2025
cca75fa
Update jenkins/current_image_tags.properties agian
zackyoray Dec 1, 2025
013b0c5
Update again jenkins/current_image_tags.properties
zackyoray Dec 2, 2025
a856485
retag current_image_tags.properties
zackyoray Dec 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions cpp/tensorrt_llm/executor/cache_transmission/nixl_utils/transferAgent.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -348,11 +348,11 @@ NixlTransferAgent::NixlTransferAgent(BaseAgentConfig const& config)

std::string nixlBackend = common::getEnvNixlBackend();
// List of supported backends - extend this list as new backends are added
static const std::set<std::string> kSUPPORTED_BACKENDS = {"UCX"};
static const std::set<std::string> kSUPPORTED_BACKENDS = {"UCX", "LIBFABRIC"};

if (kSUPPORTED_BACKENDS.find(nixlBackend) == kSUPPORTED_BACKENDS.end())
{
TLLM_LOG_ERROR("Unsupported NIXL backend: %s, fallback to UCX", nixlBackend.c_str());
TLLM_LOG_WARNING("Unsupported NIXL backend: %s, fallback to UCX", nixlBackend.c_str());
nixlBackend = "UCX";
}

Expand Down
3 changes: 2 additions & 1 deletion docker/common/install_nixl.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,8 @@ meson setup builddir \
-Dcudapath_lib="$CUDA_PATH/lib64" \
-Dcudapath_inc="$CUDA_PATH/include" \
-Dgds_path="$GDS_PATH" \
-Dinstall_headers=true
-Dinstall_headers=true \
--buildtype=release

cd builddir && ninja install
cd ../..
Expand Down
8 changes: 4 additions & 4 deletions jenkins/current_image_tags.properties
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
# images are adopted from PostMerge pipelines, the abbreviated commit hash is used instead.
IMAGE_NAME=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm

LLM_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:pytorch-25.10-py3-x86_64-ubuntu24.04-trt10.13.3.9-skip-tritondevel-202511281406-9077
LLM_SBSA_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:pytorch-25.10-py3-aarch64-ubuntu24.04-trt10.13.3.9-skip-tritondevel-202511281406-9077
LLM_ROCKYLINUX8_PY310_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:cuda-13.0.2-devel-rocky8-x86_64-rocky8-py310-trt10.13.3.9-skip-tritondevel-202511281406-9077
LLM_ROCKYLINUX8_PY312_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:cuda-13.0.2-devel-rocky8-x86_64-rocky8-py312-trt10.13.3.9-skip-tritondevel-202511281406-9077
LLM_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:pytorch-25.10-py3-x86_64-ubuntu24.04-trt10.13.3.9-skip-tritondevel-202512041415-9225
LLM_SBSA_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:pytorch-25.10-py3-aarch64-ubuntu24.04-trt10.13.3.9-skip-tritondevel-202512041415-9225
LLM_ROCKYLINUX8_PY310_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:cuda-13.0.2-devel-rocky8-x86_64-rocky8-py310-trt10.13.3.9-skip-tritondevel-202512041415-9225
LLM_ROCKYLINUX8_PY312_DOCKER_IMAGE=urm.nvidia.com/sw-tensorrt-docker/tensorrt-llm:cuda-13.0.2-devel-rocky8-x86_64-rocky8-py312-trt10.13.3.9-skip-tritondevel-202512041415-9225