Skip to content

Add TensorRT-LLM audio and V2V guide - #307

Merged
qmiao-hub merged 1 commit into
NVIDIA:mainfrom
ishovkun:docs/cosmos3-trt-audio-v2v
Aug 14, 2026
Merged

Add TensorRT-LLM audio and V2V guide#307
qmiao-hub merged 1 commit into
NVIDIA:mainfrom
ishovkun:docs/cosmos3-trt-audio-v2v

Conversation

@ishovkun

@ishovkun ishovkun commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Summary

  • extend the existing TensorRT-LLM audiovisual notebook with Nano and Super text-to-video and image-to-video audio examples
  • add Nano and Super video-to-video examples using the merged multipart input_reference API
  • document the ffmpeg requirement for MP4 encoding and synchronized audio muxing
  • update the shared setup, audiovisual quickstart, and root example index

TensorRT-LLM runtime support is available through NVIDIA/TensorRT-LLM#14827 (audio) and NVIDIA/TensorRT-LLM#16155 (V2V).

Validation

  • validated notebook JSON, unique cell IDs, and empty execution outputs
  • compiled all notebook code cells and README Python examples
  • generated every Nano and Super payload and validated referenced assets
  • validated audio JSON and image/video multipart curl construction with mocked server responses
  • git diff --check

Full GPU inference was not run as part of this documentation-only change.

Signed-off-by: Igor Shovkun <ishovkun@nvidia.com>

@ConstBob ConstBob left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Checked docs/notebook consistency for the new audio and V2V paths, verified referenced assets exist. Validated Nano/Super payload generation plus JSON/multipart request construction (enable_audio, input_reference, V2V conditioning fields). Notebook JSON/cell IDs and example snippets look clean. Approve.

@MaciejBalaNV MaciejBalaNV left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@MaciejBalaNV
MaciejBalaNV requested a review from qmiao-hub August 11, 2026 09:55
@qmiao-hub
qmiao-hub merged commit 11e6818 into NVIDIA:main Aug 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants