Skip to content

[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest#32905

Merged
noooop merged 20 commits intovllm-project:mainfrom
noooop:clean_pooling_entrypoints3
Jan 23, 2026
Merged

[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest#32905
noooop merged 20 commits intovllm-project:mainfrom
noooop:clean_pooling_entrypoints3

Conversation

@noooop
Copy link
Copy Markdown
Collaborator

@noooop noooop commented Jan 23, 2026

Purpose

Split out the following RequestMixin

  • EncodingRequestMixin
  • EmbedRequestMixin
  • ClassifyRequestMixin

address #31784 (comment)

Test Plan

tests/entrypoints/pooling/

Test Result

pass


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@mergify
Copy link
Copy Markdown

mergify bot commented Jan 23, 2026

Documentation preview: https://vllm--32905.org.readthedocs.build/en/32905/

@mergify mergify bot added documentation Improvements or additions to documentation frontend labels Jan 23, 2026
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request effectively refactors the pooling entrypoint request schemas by introducing EncodingRequestMixin, EmbedRequestMixin, and ClassifyRequestMixin. This change centralizes common parameters, reduces code duplication, and improves maintainability across EmbeddingRequest, ClassificationRequest, and PoolingRequest protocols. The refactoring is well-executed and consistently applied. My review includes a couple of minor fixes for documentation snippet tags to ensure the documentation builds correctly.

noooop and others added 12 commits January 23, 2026 12:00
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@noooop noooop marked this pull request as ready for review January 23, 2026 07:55
@noooop
Copy link
Copy Markdown
Collaborator Author

noooop commented Jan 23, 2026

@DarkLight1337

Ready for review

Copy link
Copy Markdown
Member

@DarkLight1337 DarkLight1337 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@noooop noooop enabled auto-merge (squash) January 23, 2026 08:33
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 23, 2026
@noooop noooop disabled auto-merge January 23, 2026 08:33
@noooop noooop removed the ready ONLY add when PR is ready to merge/full CI is needed label Jan 23, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@noooop noooop enabled auto-merge (squash) January 23, 2026 09:42
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 23, 2026
Comment on lines 199 to 201
```python
--8<-- "vllm/entrypoints/openai/protocol.py:completion-sampling-params"
--8<-- "vllm/entrypoints/openai/completion/protocol.py:completion-sampling-params"
```
Copy link
Copy Markdown
Collaborator Author

@noooop noooop Jan 23, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @chaunceyjiang

Fixed some API documentation; there might still be some that need to be fixed.

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@noooop noooop merged commit 05f3d71 into vllm-project:main Jan 23, 2026
48 checks passed
@noooop noooop deleted the clean_pooling_entrypoints3 branch January 23, 2026 12:24
cwazai pushed a commit to cwazai/vllm that referenced this pull request Jan 25, 2026
…mbedRequest & ClassifyRequest (vllm-project#32905)

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: 陈建华 <1647430658@qq.com>
lapy pushed a commit to lapy/vllm that referenced this pull request Jan 27, 2026
…mbedRequest & ClassifyRequest (vllm-project#32905)

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
ItzDEXX pushed a commit to ItzDEXX/vllm that referenced this pull request Feb 19, 2026
…mbedRequest & ClassifyRequest (vllm-project#32905)

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation frontend ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants