Skip to content

[BugFix] Fix AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale'#30399

Merged
vllm-bot merged 1 commit intovllm-project:mainfrom
neuralmagic:lwilkinson/fix-blackwell-moe
Dec 10, 2025
Merged

[BugFix] Fix AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale'#30399
vllm-bot merged 1 commit intovllm-project:mainfrom
neuralmagic:lwilkinson/fix-blackwell-moe

Conversation

@LucasWilkinson
Copy link
Copy Markdown
Collaborator

@LucasWilkinson LucasWilkinson commented Dec 10, 2025

#30267 introduced a

AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale'

failure in tests/quantization/test_blackwell_moe.py::test_deepseek_fp8_block_moe_deep_gemm in Blackwell Quantized MoE Test)

FIX #28480 (comment)

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
@chatgpt-codex-connector
Copy link
Copy Markdown

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.

@mgoin mgoin added bug Something isn't working ready ONLY add when PR is ready to merge/full CI is needed deepseek Related to DeepSeek models labels Dec 10, 2025
Copy link
Copy Markdown
Member

@yewentao256 yewentao256 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for the work!

@ElizaWszola
Copy link
Copy Markdown
Contributor

LGTM, also fixes the same problem with QKVParallelLinear attributes when running some models with deepgemm

@vllm-bot vllm-bot merged commit aacf0ab into vllm-project:main Dec 10, 2025
19 of 25 checks passed
@zhewenl
Copy link
Copy Markdown
Collaborator

zhewenl commented Dec 10, 2025

@LucasWilkinson noob q, why #30267 broke this?

Majid-Taheri pushed a commit to Majid-Taheri/vllm that referenced this pull request Dec 23, 2025
… no attribute 'weight_scale'` (vllm-project#30399)

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Ubuntu <mjtaheri68@gmail.com>
dsuhinin pushed a commit to dsuhinin/vllm that referenced this pull request Jan 21, 2026
… no attribute 'weight_scale'` (vllm-project#30399)

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working deepseek Related to DeepSeek models ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants