Skip to content

[bitsandbytes]: support read bnb pre-quantized model#5753

Merged
mgoin merged 2 commits into
vllm-project:mainfrom
bytedance-iaas:nf5
Jul 23, 2024
Merged

[bitsandbytes]: support read bnb pre-quantized model#5753
mgoin merged 2 commits into
vllm-project:mainfrom
bytedance-iaas:nf5

Commits

Commits on Jul 23, 2024