Skip to content

Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1#13023

Merged
simon-mo merged 2 commits intovllm-project:mainfrom
SzymonOzog:fix_gguf_tp
Feb 11, 2025
Merged

Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1#13023
simon-mo merged 2 commits intovllm-project:mainfrom
SzymonOzog:fix_gguf_tp

Commits

Commits on Feb 10, 2025