[Frontend] Supports resubmitting output items with missing fields in Responses API - #41355
Merged
Conversation
chaunceyjiang
requested review from
DarkLight1337,
aarnphm and
russellb
as code owners
April 30, 2026 08:54
Contributor
There was a problem hiding this comment.
Code Review
This pull request refactors the input parsing logic in vllm/entrypoints/openai/responses/protocol.py to support reasoning items and assistant messages, including automatic ID generation and default status assignment. Feedback was provided to add a type check for the content field in assistant messages to prevent potential TypeError exceptions when processing malformed input.
4 tasks
…Responses API Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…Responses API Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
chaunceyjiang
force-pushed
the
validation
branch
from
April 30, 2026 09:45
9e949d2 to
94e1537
Compare
sfeng33
approved these changes
May 6, 2026
sfeng33
left a comment
Collaborator
There was a problem hiding this comment.
Thanks, since ResponseInputOutputItem has 50+ possible types in its union, I think this is the ideal fix that is minimal and correct.
chaojun-zhang
pushed a commit
to chaojun-zhang/vllm
that referenced
this pull request
May 6, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Copilot AI
pushed a commit
to hongbolv/vllm
that referenced
this pull request
May 7, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Co-authored-by: hongbolv <33214277+hongbolv@users.noreply.github.com>
ikaadil
pushed a commit
to ikaadil/vllm
that referenced
this pull request
May 7, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
libinta
pushed a commit
to libinta/vllm
that referenced
this pull request
May 8, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Signed-off-by: Libin Tang <libin.tang@intel.com>
weifang231
pushed a commit
to weifang231/eb-vllm
that referenced
this pull request
May 13, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
mfylcek
pushed a commit
to mfylcek/vllm
that referenced
this pull request
May 19, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
jhu960213
pushed a commit
to jhu960213/vllm
that referenced
this pull request
May 20, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
mvanhorn
pushed a commit
to mvanhorn/vllm
that referenced
this pull request
Jun 4, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Signed-off-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
plasticchris
pushed a commit
to plasticchris/vllm
that referenced
this pull request
Jul 20, 2026
…Responses API (vllm-project#41355) Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Add a unified
input_item_parsingmodel validator toResponsesRequestthat pre-processes input items before Pydanticvalidates the
ResponseInputOutputItemunion.When clients resubmit output items (e.g., reasoning blocks or
assistant messages) as input for subsequent turns, they may omit
fields such as
id,status, orannotations. The OpenAI SDKTypedDict / BaseModel types require these fields, so Pydantic
cannot match the bare dicts and throws verbose union-validation
errors.
Test Plan
this pr
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.