Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

在多卡中开启图模式没有单卡推理速度快 #109

Open
lylala8 opened this issue Nov 18, 2024 · 2 comments
Open

在多卡中开启图模式没有单卡推理速度快 #109

lylala8 opened this issue Nov 18, 2024 · 2 comments

Comments

@lylala8
Copy link

lylala8 commented Nov 18, 2024

设备：910b
单卡速度很快，2个卡速度慢了将近一倍，都是图模式下，请问如何排查问题
@lylala8
Copy link
Author

lylala8 commented Nov 18, 2024

lmdeploy和dlinfer-ascend都已经更新到最新

@jinminxi104
Copy link
Collaborator

感谢对我们的项目的关心。
多卡慢的情况我们正在修复中，希望在0.1.4中能够修复。初步判断是通信方面的使用需要优化。

设备：910b 单卡速度很快，2个卡速度慢了将近一倍，都是图模式下，请问如何排查问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jinminxi104 @lylala8