Skip to content

Fix RoPE failures in Transformers nightly#29700

Merged
DarkLight1337 merged 2 commits intovllm-project:mainfrom
hmellor:fix-rope-import
Nov 30, 2025
Merged

Fix RoPE failures in Transformers nightly#29700
DarkLight1337 merged 2 commits intovllm-project:mainfrom
hmellor:fix-rope-import

Conversation

@hmellor
Copy link
Member

@hmellor hmellor commented Nov 28, 2025

RoPE config went through a secondary refactor in huggingface/transformers#42255 which:

  • Deletes standardize_rope_params and rope_config_validation
  • Adds a mixin which is inherited by PreTrainedConfig which does RoPE config patching and validation automatically

Therefore, for Transformers v5 compatibility, this PR:

  • Removes any imports of these deleted methods
  • Removes manual RoPE config patching for Tranformers v5 in patch_rope_parameters as it's now handled inside PreTrainedConfig

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@chatgpt-codex-connector
Copy link

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request correctly addresses the breaking changes related to RoPE configuration in Transformers v5. The removal of manual patching for transformers>=5.0.0 and the deletion of calls to the now-removed rope_config_validation function align with the library's new automatic handling of RoPE parameters. The changes are clean, well-targeted, and ensure compatibility with upcoming Transformers releases.

@DarkLight1337 DarkLight1337 enabled auto-merge (squash) November 30, 2025 12:21
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Nov 30, 2025
@DarkLight1337 DarkLight1337 merged commit cd719de into vllm-project:main Nov 30, 2025
47 checks passed
@hmellor hmellor deleted the fix-rope-import branch November 30, 2025 15:03
kitaekatt pushed a commit to kitaekatt/vllm that referenced this pull request Dec 1, 2025
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
amd-hhashemi pushed a commit to amd-hhashemi/vllm that referenced this pull request Dec 2, 2025
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
dsuhinin pushed a commit to dsuhinin/vllm that referenced this pull request Jan 21, 2026
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants