Skip to content
Merged
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions vllm/tokenizers/mistral.py
Original file line number Diff line number Diff line change
Expand Up @@ -309,6 +309,9 @@ def _get_special_tokens(self, all_special_ids: list[int]) -> list[str]:
for i in all_special_ids
]

def num_special_tokens_to_add(self) -> int:
Comment thread
DarkLight1337 marked this conversation as resolved.
return len(self.encode(""))

# the following attributes are set to fit vLLM's design and are used
# by the structured output backends.
@property
Expand Down