Webspher often produces hallucinations

[dfengpo]

How to solve the problem of hallucinations caused by using wispher.net? The model I am using is large-v3. Converting the same file multiple times can also cause hallucinations.

[bobqianic]

Converting the same file multiple times can also cause hallucinations.

Since conversion doesn't require quantization, the weight should remain the same.

The model I am using is large-v3.

Try large-v2

[dfengpo]

Converting the same file multiple times can also cause hallucinations.

Since conversion doesn't require quantization, the weight should remain the same.

The model I am using is large-v3.

Try large-v2

Quantification is to reduce hardware and improve running speed. I heard that the distillation model is faster. May I know if it is supported？

[hlevring]

#1424