Skip to content

Fix Mistral yarn warning in Transformers v5 #37292

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
hmellor merged 5 commits into from
Apr 7, 2026
+6 −0
Merged

Fix Mistral yarn warning in Transformers v5 #37292

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
57baa0f
Fix Mistral yarn warning in Transformers v5
hmellor Mar 17, 2026
141cb50
Update vllm/transformers_utils/configs/mistral.py
hmellor Mar 18, 2026
cde94b3
Guard it so v4 still works
hmellor Mar 18, 2026
a06e253
Update vllm/transformers_utils/configs/mistral.py
hmellor Apr 7, 2026
fabbf67
Merge branch 'main' into fix-mistral-warning
hmellor Apr 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions vllm/transformers_utils/configs/mistral.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,9 @@
# SPDX-FileCopyrightText: Copyright contributors to the vLLM project
from typing import Any

from packaging.version import Version
from transformers import PretrainedConfig, WhisperConfig
from transformers import __version__ as TRANSFORMERS_VERSION

from vllm.logger import init_logger

Expand Down Expand Up @@ -134,6 +136,10 @@ def _remap_mistral_yarn_args(config: dict) -> dict:
# Cast to remove Transformers > v5 type warnings
config["rope_parameters"][new_name] = cast(yarn_config.pop(old_name))

# Ignore apply_yarn_scaling in Transformers > v5 RoPE validation to remove warnings
if Version(TRANSFORMERS_VERSION) >= Version("5.3.0.dev0"):
config["ignore_keys_at_rope_validation"] = {"apply_yarn_scaling"}

assert len(yarn_config) == 0, f"Unparsed yarn config: {yarn_config}"

return config
Expand Down
Loading