Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1#13023
Merged
simon-mo merged 2 commits intovllm-project:mainfrom Feb 11, 2025
Merged
Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1#13023simon-mo merged 2 commits intovllm-project:mainfrom
simon-mo merged 2 commits intovllm-project:mainfrom