chore: bump trtllm to v1.3.0rc23 by dynamo-ops · Pull Request #12532 · ai-dynamo/dynamo

dynamo-ops · 2026-08-01T10:52:17Z

Automated dependency upgrade — trtllm v1.3.0rc23

Post-merge CI did not pass (conclusion: failure). Investigate before merging.

Framework: trtllm
Target version: v1.3.0rc23
Branch: deps/upgrade-trtllm-v1.3.0rc23
Validating run: https://github.com/ai-dynamo/dynamo/actions/runs/30695984913

closes: OPS-8014

Summary by CodeRabbit

New Features
- Updated the TensorRT-LLM integration to release 1.3.0rc23 across supported architectures.
Documentation
- Refreshed compatibility tables, release metadata, and machine-readable release information.
Chores
- Updated runtime image references, dependency pins, SBOM records, and associated integrity metadata.

Signed-off-by: dynamo-ops <170655669+dynamo-ops@users.noreply.github.com>

copy-pr-bot · 2026-08-01T10:52:20Z

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

datadog-official · 2026-08-01T10:52:23Z

⚠️ Warnings

🚦 2 Pipeline jobs failed

PR | backend-status-check

PR | sglang-runtime / Test cuda13.0, amd64

See error
GPU memory limit exceeded while running tests, leading to execution failure.

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: c25db7c | Docs | Datadog PR Page | Give us feedback!}

Re-captures the baseline SBOM against tensorrt-llm/release:1.3.0rc23 (digest release@316b840a) for both linux/amd64 and linux/arm64 and updates context.yaml to the new stem. Signed-off-by: Anant Sharma <anants@nvidia.com>

nv-anants · 2026-08-04T15:34:19Z

/ok to test 2f7b61f

github-actions · 2026-08-04T15:37:06Z

🌿 Fern Docs Preview: https://nvidia-preview-019fd343-bdf3-714a-97ea-8079349cfbd8.docs.buildwithfern.com/dynamo/dev

Removes the rc22 manifest entries and SBOM files now that rc23 is the tracked baseline. Signed-off-by: Anant Sharma <anants@nvidia.com>

nv-anants · 2026-08-04T16:41:39Z

/ok to test 9a74624

devin-ai-integration

Devin Review found 1 potential issue.

coderabbitai · 2026-08-04T16:58:53Z

Walkthrough

The pull request updates TensorRT-LLM references from 1.3.0rc22 to 1.3.0rc23 across container metadata, SBOM records, the optional dependency, and release documentation.

Changes

TensorRT-LLM release alignment

Layer / File(s)	Summary
Update release references `container/compliance/base_sboms/manifest.json`, `container/context.yaml`, `pyproject.toml`, `docs/fern/...`	Runtime images, architecture-specific SBOM records, dependency metadata, and release documentation now reference `1.3.0rc23`. The SBOM manifest includes updated digests, filenames, and generation timestamp.

Estimated code review effort: 2 (Simple) | ~10 minutes

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name	Status	Explanation	Resolution
Description check	⚠️ Warning	The description explains the upgrade and CI failure but omits the required template sections and uses an invalid issue reference format.	Add the Overview, Details, reviewer-start, and Related Issues sections, and use a valid issue reference such as Closes `#XXXX` or confirm that no issue is linked.

✅ Passed checks (4 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly and concisely identifies the TensorRT-LLM dependency upgrade to v1.3.0rc23.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{Comment @coderabbitai help to get the list of available commands.}

coderabbitai

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents

Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@pyproject.toml`:
- Line 51: Constrain the `tensorrt-llm==1.3.0rc23` dependency in the `trtllm`
extra to the supported Python versions and platforms, or document the required
NVIDIA package index and supported targets for `ai-dynamo[trtllm]`; ensure
unsupported environments such as CPython 3.11 do not attempt to resolve it.

🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

Push a commit to this branch (recommended)
Create a new PR with the fixes

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: c6512051-ea69-4527-a6d6-74506db0dcfe

📥 Commits

Reviewing files that changed from the base of the PR and between 7b099b1 and 9a74624.

📒 Files selected for processing (9)

container/compliance/base_sboms/manifest.json
container/compliance/base_sboms/release@316b840a-amd64.cdx.json
container/compliance/base_sboms/release@316b840a-arm64.cdx.json
container/context.yaml
docs/fern/assets/releases.json
docs/fern/components/releases.data.ts
docs/fern/pages/reference/general/compatibility.mdx
docs/fern/pages/reference/general/releases-machine-readable.mdx
pyproject.toml

nv-anants · 2026-08-04T17:35:01Z

/ok to test 446d086

- Merge latest main (includes vllm-openai-xpu SBOM entry and other changes) - Resolve manifest.json conflict: keep rc23 trtllm entries, drop rc22 - Add nixl[cu13]==1.3.1 to trtllm extra in pyproject.toml per review Signed-off-by: Anant Sharma <anants@nvidia.com>

Previous merge commit re-sorted entries alphabetically as a side effect of the conflict resolution script. This restores main's original ordering so the diff against main only shows the rc22->rc23 swap. Signed-off-by: Anant Sharma <anants@nvidia.com>

Addresses review comment from dagil-nvidia. Also reverts the incorrect nixl[cu13] addition to pyproject.toml trtllm extra. Signed-off-by: Anant Sharma <anants@nvidia.com>

nv-anants · 2026-08-05T18:48:35Z

/ok to test c25db7c

dyn-3691-extract-shared-target-pid-cuda-customstorage-operation-layer * 'main' of https://github.com/ai-dynamo/dynamo: (65 commits) fix(frontend): emit SGLang stream role once (#12741) docs(fern): promote v1.3.1 to current release (#12752) fix(docs): remove duplicate unscoped community-rail CSS rules (#12615) feat(operator): migrate CRD storage to v1beta1 (#11904) fix: synchronize self-benchmark capacity across DP ranks (#12021) chore(deps): bump dynamo-tokenizers to 1.8.0 (#12707) fix(frontend): preserve split UTF-8 characters (#12688) docs: align Kubernetes build selector with CLI (#12729) fix(frontend): preserve completion backend error status (#12706) fix(operator): replace snapshot pods after GMS restart (#11286) refactor(media): rename installer module, drop --packages per review fix(media): harden installer against three pre-redesign review findings fix(media): verify installs in a fresh interpreter; teach --pip-args= form test(serve): install test-time decoders at the validated bounds feat(media): explicit installer for additional media decoders docs(spica): correct kv_load_ratio support guidance (#12714) feat(operator): add experimental grove.forceScalingGroup for single-node components (#11772) fix(vllm): declare entry-stage engine_input_source in GLM-Image NIXL config (#12709) chore: bump trtllm to v1.3.0rc23 (#12532) perf: remove trtllm postprocessing workers from the args as post processing workers are not effective in dynamo (#12592) ... Signed-off-by: Hannah Zhang <hannahz@nvidia.com>

chore: bump trtllm to v1.3.0rc23

557743b

Signed-off-by: dynamo-ops <170655669+dynamo-ops@users.noreply.github.com>

dynamo-ops added backend::trtllm Relates to the trtllm backend dep-upgrade Automated dependency upgrade labels Aug 1, 2026

pull-request-size Bot added the size/S label Aug 1, 2026

github-actions Bot added chore documentation Improvements or additions to documentation container labels Aug 1, 2026

ci: re-capture trtllm baseline SBOM for v1.3.0rc23

2f7b61f

Re-captures the baseline SBOM against tensorrt-llm/release:1.3.0rc23 (digest release@316b840a) for both linux/amd64 and linux/arm64 and updates context.yaml to the new stem. Signed-off-by: Anant Sharma <anants@nvidia.com>

pull-request-size Bot added size/XXL and removed size/S labels Aug 4, 2026

nv-anants added 2 commits August 4, 2026 09:41

ci: drop trtllm baseline SBOM for v1.3.0rc22

88e2dfc

Removes the rc22 manifest entries and SBOM files now that rc23 is the tracked baseline. Signed-off-by: Anant Sharma <anants@nvidia.com>

Merge branch 'main' into deps/upgrade-trtllm-v1.3.0rc23

9a74624

nv-anants marked this pull request as ready for review August 4, 2026 16:47

nv-anants requested review from a team as code owners August 4, 2026 16:47

devin-ai-integration Bot reviewed Aug 4, 2026

View reviewed changes

Comment thread pyproject.toml

coderabbitai Bot reviewed Aug 4, 2026

View reviewed changes

Comment thread pyproject.toml

Merge branch 'main' into deps/upgrade-trtllm-v1.3.0rc23

446d086

tanmayv25 approved these changes Aug 4, 2026

View reviewed changes

nv-anants enabled auto-merge (squash) August 5, 2026 14:51

dagil-nvidia requested changes Aug 5, 2026

View reviewed changes

Comment thread docs/fern/components/releases.data.ts Outdated

nv-anants added 2 commits August 5, 2026 11:26

fix: bump nixlTrtllm to 1.3.1 in releases.data.ts

c25db7c

Addresses review comment from dagil-nvidia. Also reverts the incorrect nixl[cu13] addition to pyproject.toml trtllm extra. Signed-off-by: Anant Sharma <anants@nvidia.com>

dagil-nvidia approved these changes Aug 5, 2026

View reviewed changes

nv-anants merged commit 86fbcc0 into main Aug 5, 2026
186 of 188 checks passed

nv-anants deleted the deps/upgrade-trtllm-v1.3.0rc23 branch August 5, 2026 20:51

Navigation Menu

Uh oh!

chore: bump trtllm to v1.3.0rc23 - #12532

chore: bump trtllm to v1.3.0rc23#12532
nv-anants merged 8 commits into
mainfrom
deps/upgrade-trtllm-v1.3.0rc23

dynamo-ops commented Aug 1, 2026 •

edited by coderabbitai Bot

Loading

Uh oh!

copy-pr-bot Bot commented Aug 1, 2026

Uh oh!

datadog-official Bot commented Aug 1, 2026 •

edited

Loading

Uh oh!

nv-anants commented Aug 4, 2026

Uh oh!

github-actions Bot commented Aug 4, 2026 •

edited

Loading

Uh oh!

nv-anants commented Aug 4, 2026

Uh oh!

devin-ai-integration Bot left a comment

Uh oh!

Uh oh!

coderabbitai Bot commented Aug 4, 2026

❌ Failed checks (1 warning)

Uh oh!

coderabbitai Bot left a comment

Uh oh!

Uh oh!

nv-anants commented Aug 4, 2026

Uh oh!

Uh oh!

nv-anants commented Aug 5, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

dynamo-ops commented Aug 1, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Automated dependency upgrade — trtllm v1.3.0rc23

Summary by CodeRabbit

Uh oh!

copy-pr-bot Bot commented Aug 1, 2026

Uh oh!

datadog-official Bot commented Aug 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚠️ Warnings

Uh oh!

nv-anants commented Aug 4, 2026

Uh oh!

github-actions Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nv-anants commented Aug 4, 2026

Uh oh!

devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

coderabbitai Bot commented Aug 4, 2026

Walkthrough

Changes

❌ Failed checks (1 warning)

Uh oh!

coderabbitai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

nv-anants commented Aug 4, 2026

Uh oh!

Uh oh!

nv-anants commented Aug 5, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

dynamo-ops commented Aug 1, 2026 •

edited by coderabbitai Bot

Loading

datadog-official Bot commented Aug 1, 2026 •

edited

Loading

github-actions Bot commented Aug 4, 2026 •

edited

Loading