Skip to content

feat(client): backport TensorRT-LLM support to release/0.5.1 - #622

Merged
nv-nmailhot merged 3 commits into
release/0.5.1from
zheluo/backport-trtllm-protobuf-0.5.1
Aug 13, 2026
Merged

feat(client): backport TensorRT-LLM support to release/0.5.1#622
nv-nmailhot merged 3 commits into
release/0.5.1from
zheluo/backport-trtllm-protobuf-0.5.1

Conversation

@zhengluo-nv

Copy link
Copy Markdown
Contributor

Summary

Backport the following merged changes to release/0.5.1:

The commits are cherry-picked in dependency order with -x provenance. The adapter conflict resolution preserves the release branch's newer source-peer cleanup behavior while adding exact tensor-catalog matching and the dynamic NIXL import path. Its test was adapted to the release branch's already-removed InstantTensor strategy.

Impact

This brings the native TensorRT-LLM integration and example to the 0.5.1 release line and allows the Python client to run with protobuf 5 or 6.

Validation

  • 64 passed — focused TensorRT-LLM, NIXL, transfer-safety, RDMA peer-release, and protobuf tests with protobuf 5.29.6
  • 32 passed — core TensorRT-LLM/NIXL/protobuf tests with protobuf 6.33.6
  • git diff --check
  • All three backport commits have valid GPG signatures and matching DCO sign-offs

@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 12, 2026 23:41 Inactive
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 12, 2026 23:41 Inactive
@zhengluo-nv zhengluo-nv changed the title [release/0.5.1] Backport native TensorRT-LLM adapter and protobuf 6 support feat(client): backport TensorRT-LLM support to release/0.5.1 Aug 12, 2026
@github-actions github-actions Bot added the feat label Aug 12, 2026
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:03 Inactive
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:03 Inactive
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:12 Inactive
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:12 Inactive
@zhengluo-nv
zhengluo-nv marked this pull request as ready for review August 13, 2026 00:13
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:46 Inactive
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:46 Inactive
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
(cherry picked from commit 0392394)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
(cherry picked from commit 3542dda)
Use the release accelerator compatibility API and backport the NIXL exact-match API introduced by commit 406eaa1.

Signed-off-by: Zheng Luo <zheluo@nvidia.com>
@zhengluo-nv
zhengluo-nv force-pushed the zheluo/backport-trtllm-protobuf-0.5.1 branch from be27f3a to ee062c2 Compare August 13, 2026 00:52
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:52 Inactive
@copy-pr-bot
copy-pr-bot Bot temporarily deployed to automated-release August 13, 2026 00:52 Inactive
@codecov

codecov Bot commented Aug 13, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@zhengluo-nv zhengluo-nv self-assigned this Aug 13, 2026
@nv-nmailhot
nv-nmailhot merged commit 798ca9d into release/0.5.1 Aug 13, 2026
74 of 77 checks passed
@nv-nmailhot
nv-nmailhot deleted the zheluo/backport-trtllm-protobuf-0.5.1 branch August 13, 2026 17:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants