Skip to content

Fix weight mapping test for Transfomers v5#33162

Merged
DarkLight1337 merged 2 commits intovllm-project:mainfrom
hmellor:fix-mapping-test
Jan 27, 2026
Merged

Fix weight mapping test for Transfomers v5#33162
DarkLight1337 merged 2 commits intovllm-project:mainfrom
hmellor:fix-mapping-test

Conversation

@hmellor
Copy link
Member

@hmellor hmellor commented Jan 27, 2026

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

The pull request effectively addresses compatibility issues with Transformers v5 by making the access to tie_word_embeddings more robust across the codebase. The use of getattr with a default value prevents potential AttributeError exceptions for models where this attribute might be missing. The temporary fix in the test utility create_dummy_model for tied weights on meta device is a pragmatic solution to ensure tests pass while awaiting an upstream fix. Overall, these changes improve the stability and resilience of the system against variations in model configurations.

@mergify mergify bot added the multi-modality Related to multi-modality (#4194) label Jan 27, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@DarkLight1337 DarkLight1337 enabled auto-merge (squash) January 27, 2026 10:37
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 27, 2026
@DarkLight1337 DarkLight1337 merged commit 14385c8 into vllm-project:main Jan 27, 2026
55 checks passed
@hmellor hmellor deleted the fix-mapping-test branch January 27, 2026 16:29
VedantMadane pushed a commit to VedantMadane/vllm that referenced this pull request Jan 28, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Vedant Madane <6527493+VedantMadane@users.noreply.github.com>
apd10 pushed a commit to apd10/vllm that referenced this pull request Jan 31, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
ItzDEXX pushed a commit to ItzDEXX/vllm that referenced this pull request Feb 19, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

multi-modality Related to multi-modality (#4194) ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants