Add GPTQ support#916

Merged

WoosukKwon merged 27 commits into

vllm-project:mainfrom

chu-tianxiang:gptq_hf

Dec 15, 2023

Commits on Sep 18, 2023

Add gptq implementation compatible with awq interface
chu-tianxiang
committed

Commits on Sep 25, 2023

Commits on Sep 27, 2023

Commits on Oct 8, 2023

Merge main branch
chu-tianxiang
committed

Commits on Oct 9, 2023

Add mistral model
chu-tianxiang
committed

Commits on Oct 11, 2023

Fix bug in gpt layer
chu-tianxiang
committed

Commits on Oct 24, 2023

Commits on Nov 2, 2023

Use exllama v2 kernels for better performance
chu-tianxiang
committed

Commits on Nov 14, 2023

Commits on Dec 1, 2023

Commits on Dec 2, 2023

move post init to first forward pass to make code cleaner
chu-tianxiang
committed

Commits on Dec 3, 2023

merge main
chu-tianxiang
committed

Commits on Dec 10, 2023

Commits on Dec 11, 2023

Fix typo
chu-tianxiang
committed

Commits on Dec 15, 2023