Skip to content

[Frontend] Standardize use of create_error_response#32319

Merged
DarkLight1337 merged 2 commits intovllm-project:mainfrom
DarkLight1337:consolidate-err-handl
Jan 14, 2026
Merged

[Frontend] Standardize use of create_error_response#32319
DarkLight1337 merged 2 commits intovllm-project:mainfrom
DarkLight1337:consolidate-err-handl

Conversation

@DarkLight1337
Copy link
Copy Markdown
Member

@DarkLight1337 DarkLight1337 commented Jan 14, 2026

Purpose

Follow-up to #31987, ensure that the error message is sanitized properly.

Test Plan

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@DarkLight1337 DarkLight1337 added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 14, 2026
@mergify mergify bot added the frontend label Jan 14, 2026
@DarkLight1337 DarkLight1337 added this to the v0.14.0 milestone Jan 14, 2026
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request effectively standardizes error handling by consistently using the create_error_response function and sanitizing error messages across numerous API endpoints. This is a significant improvement for code consistency and security. The centralization of exception handling for specific errors like OverflowError and NotImplementedError within create_error_response is a clean and robust approach. The changes in this PR are correct and well-executed. To fully complete this standardization effort, you might consider updating a few more locations in a follow-up, such as create_transcriptions, create_translations, and create_messages in vllm/entrypoints/openai/api_server.py, and detokenize in vllm/entrypoints/serve/tokenize/api_router.py, which still use the older error handling pattern. Overall, this is a valuable refactoring.

Copy link
Copy Markdown

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment @cursor review or bugbot run to trigger another review on this PR

Copy link
Copy Markdown
Collaborator

@chaunceyjiang chaunceyjiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks~

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@DarkLight1337 DarkLight1337 enabled auto-merge (squash) January 14, 2026 09:39
@DarkLight1337 DarkLight1337 merged commit 3f28174 into vllm-project:main Jan 14, 2026
49 checks passed
@DarkLight1337 DarkLight1337 deleted the consolidate-err-handl branch January 14, 2026 11:22
sammysun0711 pushed a commit to sammysun0711/vllm that referenced this pull request Jan 16, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
DarkLight1337 added a commit that referenced this pull request Jan 16, 2026
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
akh64bit pushed a commit to akh64bit/vllm that referenced this pull request Jan 16, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
dsuhinin pushed a commit to dsuhinin/vllm that referenced this pull request Jan 21, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
greg1232 pushed a commit to supermassive-intelligence/vllm-fork that referenced this pull request Jan 27, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
danichan-mkm pushed a commit to danichan-mkm/vllm that referenced this pull request Feb 11, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
ItzDEXX pushed a commit to ItzDEXX/vllm that referenced this pull request Feb 19, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
dtrifiro pushed a commit to dtrifiro/vllm that referenced this pull request Mar 9, 2026
…2319)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
dtrifiro added a commit to dtrifiro/vllm that referenced this pull request Mar 9, 2026
Fix:
GHSA-4r2x-xpjr-7cvv

- [Frontend] Improve error message (vllm-project#31987)
- [Frontend] Standardize use of `create_error_response` (vllm-project#32319)
- [Misc] Bump opencv-python dependecy version to 4.13 (vllm-project#32668)

https://issues.redhat.com/browse/INFERENG-4411
Shafi-Hussain pushed a commit to odh-on-pz/vllm-cpu that referenced this pull request Mar 17, 2026
Fix:
GHSA-4r2x-xpjr-7cvv

- [Frontend] Improve error message (vllm-project/vllm#31987)
- [Frontend] Standardize use of `create_error_response` (vllm-project/vllm#32319)
- [Misc] Bump opencv-python dependecy version to 4.13 (vllm-project/vllm#32668)

https://issues.redhat.com/browse/INFERENG-4411
https://issues.redhat.com/browse/RHOAIENG-48365
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

frontend ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants