Skip to content

[Model] rename use_pad_token to use_sep_token#31784

Merged
DarkLight1337 merged 6 commits intovllm-project:mainfrom
noooop:use_sep_token
Jan 6, 2026
Merged

[Model] rename use_pad_token to use_sep_token#31784
DarkLight1337 merged 6 commits intovllm-project:mainfrom
noooop:use_sep_token

Conversation

@noooop
Copy link
Copy Markdown
Collaborator

@noooop noooop commented Jan 6, 2026

Purpose

use_pad_token is for internal use only; modifying it will have minimal impact on users.

Test Plan

models/language/pooling/
models/language/pooling_mteb_test/

Test Result

pass


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

noooop added 2 commits January 6, 2026 14:41
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@mergify
Copy link
Copy Markdown

mergify bot commented Jan 6, 2026

Documentation preview: https://vllm--31784.org.readthedocs.build/en/31784/

@mergify mergify bot added documentation Improvements or additions to documentation frontend labels Jan 6, 2026
@noooop noooop marked this pull request as draft January 6, 2026 06:59
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request primarily refactors use_pad_token to the more semantically correct use_sep_token across the codebase, which improves clarity. The change includes backward compatibility to avoid breaking existing configurations. Additionally, the MTEB embedding tolerance is increased to address test flakiness. The changes are logical and well-implemented, but I found one critical issue in an example script that needs to be addressed.

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
@noooop noooop marked this pull request as ready for review January 6, 2026 08:48
@noooop noooop added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 6, 2026
@noooop noooop requested a review from DarkLight1337 January 6, 2026 08:49
@noooop noooop removed the ready ONLY add when PR is ready to merge/full CI is needed label Jan 6, 2026
@noooop noooop added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 6, 2026
@DarkLight1337 DarkLight1337 enabled auto-merge (squash) January 6, 2026 13:52
@DarkLight1337 DarkLight1337 merged commit 96860af into vllm-project:main Jan 6, 2026
59 of 60 checks passed
Anexdeus pushed a commit to Anexdeus/vllm that referenced this pull request Jan 6, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: Anexdeus <5142168@mail.ru>
@noooop noooop deleted the use_sep_token branch January 6, 2026 16:18
LucasWilkinson pushed a commit to neuralmagic/vllm that referenced this pull request Jan 6, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
yugong333 pushed a commit to yugong333/vllm that referenced this pull request Jan 9, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
akh64bit pushed a commit to akh64bit/vllm that referenced this pull request Jan 16, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
dsuhinin pushed a commit to dsuhinin/vllm that referenced this pull request Jan 21, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
classifier_from_tokens=json.loads(args.classifier_from_tokens),
method=args.method,
use_pad_token=args.use_pad_token,
use_sep_token=args.use_sep_token,
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the name in add_argument is still use-pad-token

ItzDEXX pushed a commit to ItzDEXX/vllm that referenced this pull request Feb 19, 2026
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation frontend ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants