Skip to content

Fix offline test for Transformers v5#33682

Merged
DarkLight1337 merged 3 commits intovllm-project:mainfrom
hmellor:offline-test-v5
Feb 3, 2026
Merged

Fix offline test for Transformers v5#33682
DarkLight1337 merged 3 commits intovllm-project:mainfrom
hmellor:offline-test-v5

Conversation

@hmellor
Copy link
Member

@hmellor hmellor commented Feb 3, 2026

As described in https://github.com/huggingface/transformers/blob/main/MIGRATION_GUIDE_V5.md#remote-code-incompatibility, tokenization_utils and tokenization_utils_fast have been removed and are aliased for backward compatibility.

The re-import logic in the offline tests is incompatible with these aliases so we ensure that they are deleted during reloading so that they will be re-aliased on next import.

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to fix an offline test for Transformers v5 by preventing the reloading of modules that have become aliases. The approach is correct, but the implementation for detecting these aliased modules could be more robust. I've identified a potential bug in the detection logic that could lead to false positives and have suggested a more precise implementation.

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@DarkLight1337 DarkLight1337 enabled auto-merge (squash) February 3, 2026 11:27
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Feb 3, 2026
@DarkLight1337 DarkLight1337 merged commit f6af346 into vllm-project:main Feb 3, 2026
14 checks passed
@hmellor hmellor deleted the offline-test-v5 branch February 3, 2026 12:18
Hivenet-Igor pushed a commit to Hivenet-Igor/vllm that referenced this pull request Feb 3, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Igor Carrara <igor.carrara@hivenet.com>
PiratePai pushed a commit to PiratePai/epd_shm that referenced this pull request Feb 3, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Pai <416932041@qq.com>
PiratePai pushed a commit to PiratePai/epd_shm that referenced this pull request Feb 3, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Pai <416932041@qq.com>
gameofdimension pushed a commit to gameofdimension/vllm that referenced this pull request Feb 5, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: felix01.yu <felix01.yu@vipshop.com>
ItzDEXX pushed a commit to ItzDEXX/vllm that referenced this pull request Feb 19, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants