Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问,转换模型前的用于量化的校准样本作用 #218

Open
ldptest opened this issue Mar 11, 2025 · 1 comment
Open

请问,转换模型前的用于量化的校准样本作用 #218

ldptest opened this issue Mar 11, 2025 · 1 comment

Comments

@ldptest
Copy link

ldptest commented Mar 11, 2025

我在学习模型转换,deepseek-r1:1.5的demo中有个python文件,generate_data_quant.py
input_text = 里面有段文字,都是没答案的选择题
注释上写:请根据模型特点与使用长焦准备用于量化的校准样本
请问这些样本的作用?没答案如何校准?

@waydong
Copy link
Collaborator

waydong commented Mar 11, 2025

你好,原理是通过浮点模型生成答案来校正量化模型。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants