Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

After updating the version, I attempted to train qwen2_vl but encountered issues with slower training speed and decreased accuracy. I have not been able to identify the cause. #7150

Open
1 task done
xueaa opened this issue Mar 4, 2025 · 4 comments
Labels
enhancement New feature or request pending This problem is yet to be addressed

Comments

@xueaa
Copy link

xueaa commented Mar 4, 2025

Reminder

  • I have read the above rules and searched the existing issues.

Description

After updating the version, I attempted to train qwen2_vl but encountered issues with slower training speed and decreased accuracy. I have not been able to identify the cause.

Pull Request

No response

@xueaa xueaa added enhancement New feature or request pending This problem is yet to be addressed labels Mar 4, 2025
@xueaa
Copy link
Author

xueaa commented Mar 4, 2025

When using the previous model for inference, I also encountered a significant drop in accuracy. I tried both the past version and the updated version, and the accuracy difference is more than 20%. Why do different versions cause such issues? Has anyone experienced similar situations?

@xueaa
Copy link
Author

xueaa commented Mar 4, 2025

Image
This is the current accuracy, but after switching to the previous version of LLaMA-Factory, the accuracy improved by about 20%. Why is there such a significant difference in performance even in deployment?

@hiyouga
Copy link
Owner

hiyouga commented Mar 4, 2025

Is this commit the cause of this phenomenon? bc298c6

@xueaa
Copy link
Author

xueaa commented Mar 4, 2025

这是造成这种现象的原因吗?BC298C6

Thank you for your response. I can adjust this and try, but I believe it's not related to this issue. The reason is that some bounding boxes (bbox) are correct, while others are incorrect, even though the input images are of the same size. This suggests that the problem might not be caused by the version conflicts we discussed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request pending This problem is yet to be addressed
Projects
None yet
Development

No branches or pull requests

2 participants