Chinese Characters Corruption After Space in Output of qwen2.5-vl-7b-instruct@8bit Model

[panlilu]

Description:

When running the qwen2.5-vl-7b-instruct@8bit model on lm-studio, there is an issue with Chinese character corruption, especially after a space. The issue occurs occasionally in the output, where Chinese characters after spaces are corrupted, resulting in some characters being displayed incorrectly.

Steps to Reproduce:
1. Run the qwen2.5-vl-7b-instruct@8bit model in lm-studio.
2. Provide input with Chinese text, for example: “喜剧 动画 冒险”.
3. In the output, some characters appear as corrupted, e.g., 喜剧 �画 �险.

Expected Behavior:
The model should handle Chinese characters correctly without any corruption, even after spaces.

Actual Behavior:
Some Chinese characters, especially those after spaces, are corrupted in the output.

Screenshot:

Environment Information:
• Model version: qwen2.5-vl-7b-instruct@8bit
• System: lm-studio
• OS version: Sequoia 15.1.1
• Installation Type : Mac Silicon
• Mac Details : M4 pro; 24GB

Additional Information:
Let me know if more logs or information are needed. Thanks for your support!

[downerxl]

Same question in qwen2.5-vl-7b-instruct@f16

[datouxia]

me too, With "mlx-community/Qwen2.5-VL-72B-Instruct-4bit" this model.