Skip to content

Conversation

@yczhang-nv
Copy link
Contributor

Description

Update the message type supported in AIQChatRequest to support image and audio input. Users can create chat requests like this:

# Example with image
image_content = ImageContent(image_url=ImageUrl(url="http://example.com/image.jpg"))
request = AIQChatRequest.from_content([image_content])

# Example with audio
audio_content = AudioContent(input_audio=InputAudio(data="base64_encoded_audio_data"))
request = AIQChatRequest.from_content([audio_content])

Reused the content types defined in the file.

Closes AIQ-1062

By Submitting this PR I confirm:

  • I am familiar with the Contributing Guidelines.
  • We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
    • Any contribution which contains commits that are not Signed-Off will not be accepted.
  • When the PR is ready for review, new or existing tests cover these changes.
  • When the PR is ready for review, the documentation is up to date with these changes.

@yczhang-nv yczhang-nv added improvement Improvement to existing functionality non-breaking Non-breaking change labels Apr 30, 2025
@yczhang-nv yczhang-nv self-assigned this Apr 30, 2025
@yczhang-nv yczhang-nv merged commit d084a5e into NVIDIA:develop May 1, 2025
10 checks passed
@yczhang-nv yczhang-nv deleted the yuchen-update-chat-object-to-fully-openai-api-compatible branch May 1, 2025 17:30
yczhang-nv added a commit to yczhang-nv/NeMo-Agent-Toolkit that referenced this pull request May 8, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <[email protected]>

* fix doc

Signed-off-by: Yuchen Zhang <[email protected]>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <[email protected]>

* update uv.lock

Signed-off-by: Yuchen Zhang <[email protected]>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <[email protected]>

* resolve comments

Signed-off-by: Yuchen Zhang <[email protected]>

* fix comments

Signed-off-by: Yuchen Zhang <[email protected]>

* add support of ImageContext and AudioContext to AIQChatRequest

Signed-off-by: Yuchen Zhang <[email protected]>

---------

Signed-off-by: Yuchen Zhang <[email protected]>
Signed-off-by: Yuchen Zhang <[email protected]>
yczhang-nv added a commit to yczhang-nv/NeMo-Agent-Toolkit that referenced this pull request May 9, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <[email protected]>

* fix doc

Signed-off-by: Yuchen Zhang <[email protected]>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <[email protected]>

* update uv.lock

Signed-off-by: Yuchen Zhang <[email protected]>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <[email protected]>

* resolve comments

Signed-off-by: Yuchen Zhang <[email protected]>

* fix comments

Signed-off-by: Yuchen Zhang <[email protected]>

* add support of ImageContext and AudioContext to AIQChatRequest

Signed-off-by: Yuchen Zhang <[email protected]>

---------

Signed-off-by: Yuchen Zhang <[email protected]>
ericevans-nv pushed a commit to ericevans-nv/agent-iq that referenced this pull request Jun 3, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <[email protected]>

* fix doc

Signed-off-by: Yuchen Zhang <[email protected]>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <[email protected]>

* update uv.lock

Signed-off-by: Yuchen Zhang <[email protected]>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <[email protected]>

* resolve comments

Signed-off-by: Yuchen Zhang <[email protected]>

* fix comments

Signed-off-by: Yuchen Zhang <[email protected]>

* add support of ImageContext and AudioContext to AIQChatRequest

Signed-off-by: Yuchen Zhang <[email protected]>

---------

Signed-off-by: Yuchen Zhang <[email protected]>
Signed-off-by: Eric Evans <[email protected]>
ericevans-nv pushed a commit to ericevans-nv/agent-iq that referenced this pull request Jun 3, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <[email protected]>

* fix doc

Signed-off-by: Yuchen Zhang <[email protected]>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <[email protected]>

* update uv.lock

Signed-off-by: Yuchen Zhang <[email protected]>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <[email protected]>

* resolve comments

Signed-off-by: Yuchen Zhang <[email protected]>

* fix comments

Signed-off-by: Yuchen Zhang <[email protected]>

* add support of ImageContext and AudioContext to AIQChatRequest

Signed-off-by: Yuchen Zhang <[email protected]>

---------

Signed-off-by: Yuchen Zhang <[email protected]>
Signed-off-by: Eric Evans <[email protected]>
AnuradhaKaruppiah pushed a commit to AnuradhaKaruppiah/oss-agentiq that referenced this pull request Aug 4, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <[email protected]>

* fix doc

Signed-off-by: Yuchen Zhang <[email protected]>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <[email protected]>

* update uv.lock

Signed-off-by: Yuchen Zhang <[email protected]>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <[email protected]>

* resolve comments

Signed-off-by: Yuchen Zhang <[email protected]>

* fix comments

Signed-off-by: Yuchen Zhang <[email protected]>

* add support of ImageContext and AudioContext to AIQChatRequest

Signed-off-by: Yuchen Zhang <[email protected]>

---------

Signed-off-by: Yuchen Zhang <[email protected]>
scheckerNV pushed a commit to scheckerNV/aiq-factory-reset that referenced this pull request Aug 22, 2025
* support python 3.11

Signed-off-by: Yuchen Zhang <[email protected]>

* fix doc

Signed-off-by: Yuchen Zhang <[email protected]>

* update pyproject.toml

Signed-off-by: Yuchen Zhang <[email protected]>

* update uv.lock

Signed-off-by: Yuchen Zhang <[email protected]>

* update README to specify Python version requirements

Signed-off-by: Yuchen Zhang <[email protected]>

* resolve comments

Signed-off-by: Yuchen Zhang <[email protected]>

* fix comments

Signed-off-by: Yuchen Zhang <[email protected]>

* add support of ImageContext and AudioContext to AIQChatRequest

Signed-off-by: Yuchen Zhang <[email protected]>

---------

Signed-off-by: Yuchen Zhang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improvement to existing functionality non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants