Skip to content

fix: add Qwen3.5 version gate in loader dispatch #4335

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
danielhanchen merged 5 commits into from
Mar 17, 2026
Merged

fix: add Qwen3.5 version gate in loader dispatch #4335

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
d2dba32
fix: add Qwen3.5 version gate in loader dispatch (#4188)
danielhanchen Mar 16, 2026
86ff821
fix: update FORCE_FLOAT32 comment for qwen3_5
danielhanchen Mar 17, 2026
62a7497
fix: move qwen3_5 version check before dispatch chain
danielhanchen Mar 17, 2026
ca326bf
fix: qwen3_5 requires transformers >= 5.2.0, not 5.0.0
danielhanchen Mar 17, 2026
261d7cd
fix: move qwen3_5 version check into AutoConfig error handler
danielhanchen Mar 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 15 additions & 1 deletion unsloth/models/loader.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -106,7 +106,7 @@
"gemma3text", # Gemma3TextModel (EmbeddingGemma, standalone text-only Gemma3)
"gemma3n",
"gpt_oss",
"qwen3_5", # Qwen3.5 RMSNorm uses (1+w) pattern like Gemma3, overflows float16
"qwen3_5", # Qwen3.5 GDN layers produce NaN grad norms in float16 training
]

global DISABLE_COMPILE_MODEL_NAMES
Expand Down Expand Up @@ -442,6 +442,13 @@ def from_pretrained(
except Exception as error:
autoconfig_error = str(error)
if "architecture" in autoconfig_error:
if "qwen3_5" in autoconfig_error:
raise ImportError(
f"Unsloth: Your transformers version of {transformers_version} does not support Qwen3.5.\n"
f"The minimum required version is 5.2.0.\n"
f'Try `pip install --upgrade "transformers>=5.2.0"`\n'
f"to obtain the latest transformers build, then restart this session."
)
raise ValueError(
f"`{model_name}` is not supported yet in `transformers=={transformers_version}`.\n"
f"Please update transformers via `pip install --upgrade transformers` and try again."
Expand Down Expand Up @@ -1051,6 +1058,13 @@ def from_pretrained(
except Exception as error:
autoconfig_error = str(error)
if "architecture" in autoconfig_error:
if "qwen3_5" in autoconfig_error:
raise ImportError(
f"Unsloth: Your transformers version of {transformers_version} does not support Qwen3.5.\n"
f"The minimum required version is 5.2.0.\n"
f'Try `pip install --upgrade "transformers>=5.2.0"`\n'
f"to obtain the latest transformers build, then restart this session."
)
raise ValueError(
f"`{model_name}` is not supported yet in `transformers=={transformers_version}`.\n"
f"Please update transformers via `pip install --upgrade transformers` and try again."
Expand Down
Loading