Importance Matrix calculation for AWQ as well?

[sorasoras]

ggerganov/llama.cpp#4856
ggerganov/llama.cpp#4861

There might be some interesting idea you can use to improve AutoAWQ
It does looks pretty promising
or combine them to generate a quantization.

[casper-hansen]

Hi @sorasoras, I appreciate the excitement over the new llama.cpp K-bit quants that are slowly rolling in. At the current stage of AutoAWQ, I cannot take on these large things on my own. Although I wish I had the time (and compute+$), I do not. So the priority is to make AutoAWQ smooth to work with and to provide quantization of newer models as they come out.

[casper-hansen]

Closing this for now as it's not a planned update. However, I am open for all PRs that can use importance matrices to improve AWQ!