This repository was archived by the owner on Jun 24, 2024. It is now read-only.
This repository was archived by the owner on Jun 24, 2024. It is now read-only.
Support new quantization formats for quantizer #209
Description
At present, the quantizer only supports q4_0 and q4_1 output. We should support all the formats that GGML supports for quantization at the time this issue is written.
(Note: the formats can change or be removed, so always check what the currently supported formats are)