Skip to content

[FIX_FOR_VLLM_CUSTOM=b06813e87207e15b133e903d641e03f237d85b17] Fix gdn_linear_attn import path after upstream mamba refactor#1496

Merged
adobrzyn merged 1 commit into
vllm-project:mainfrom
pawel-olejniczak:fix/gdn-linear-attn-import-path
May 27, 2026
Merged

[FIX_FOR_VLLM_CUSTOM=b06813e87207e15b133e903d641e03f237d85b17] Fix gdn_linear_attn import path after upstream mamba refactor#1496
adobrzyn merged 1 commit into
vllm-project:mainfrom
pawel-olejniczak:fix/gdn-linear-attn-import-path

Conversation

@pawel-olejniczak
Copy link
Copy Markdown
Collaborator

@pawel-olejniczak pawel-olejniczak commented May 25, 2026

Root cause

Upstream vLLM PR vllm-project/vllm#41126 (commit 7e1b45a092) refactored
vllm.model_executor.layers.mamba.gdn_linear_attn.GatedDeltaNetAttention
into a gdn/ subpackage: vllm.model_executor.layers.mamba.gdn.qwen_gdn_linear_attn.QwenGatedDeltaNetAttention.

This broke vllm_gaudi/models/qwen3_5.py which imported from the old path.

Fix

Updated 6 lines in vllm_gaudi/models/qwen3_5.py:

  • Changed import path from gdn_linear_attn to gdn.qwen_gdn_linear_attn
  • Updated class reference from GatedDeltaNetAttention to QwenGatedDeltaNetAttention

Upstream compatibility

Pinned to vLLM SHA: b06813e87207e15b133e903d641e03f237d85b17

…n_linear_attn import path after upstream mamba refactor

Root cause: upstream vLLM PR #41126 (7e1b45a092) refactored
gdn_linear_attn.GatedDeltaNetAttention into a gdn/ subpackage:
  vllm.model_executor.layers.mamba.gdn.qwen_gdn_linear_attn.QwenGatedDeltaNetAttention

Fix: Update import paths and class references in qwen3_5.py to match
the new upstream module structure. Replace GatedDeltaNetAttention with
QwenGatedDeltaNetAttention in the monkey-patch targets.

Signed-off-by: Paweł Olejniczak <pawelx.olejniczak@intel.com>
@pawel-olejniczak pawel-olejniczak force-pushed the fix/gdn-linear-attn-import-path branch from ba51ad7 to 838e3d2 Compare May 25, 2026 13:06
@github-actions
Copy link
Copy Markdown

✅ CI Passed

All checks passed successfully against the following vllm commit:
b06813e87207e15b133e903d641e03f237d85b17

@adobrzyn adobrzyn merged commit bf8dfdf into vllm-project:main May 27, 2026
3 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants