Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

咨询下主页上的测试数据使用的芯片算力是多少T的? #213

Open
pxrgod opened this issue Mar 6, 2025 · 9 comments
Open

Comments

@pxrgod
Copy link

pxrgod commented Mar 6, 2025

如上。

@waydong
Copy link
Collaborator

waydong commented Mar 7, 2025

你好,6TOPS@int8

@pxrgod
Copy link
Author

pxrgod commented Mar 7, 2025

你好,6TOPS@int8

请问下驱动版本是多少?我们使用最新的0.9.8测试,好像达不到这个数据

@waydong
Copy link
Collaborator

waydong commented Mar 7, 2025

你好,6TOPS@int8

请问下驱动版本是多少?我们使用最新的0.9.8测试,好像达不到这个数据

确认是否已使用scripts目录下定频脚本定频了。

@pxrgod
Copy link
Author

pxrgod commented Mar 7, 2025

你好,6TOPS@int8

请问下驱动版本是多少?我们使用最新的0.9.8测试,好像达不到这个数据

确认是否已使用scripts目录下定频脚本定频了。

执行了,我使用的DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588进行验证,下面是这个数据

Stage Total Time (ms) Tokens Time per Token (ms) Tokens per Second

Prefill 387.98 39 9.95 100.52
Generate 24719.56 255 102.77 9.73

@waydong
Copy link
Collaborator

waydong commented Mar 7, 2025

你好,6TOPS@int8

请问下驱动版本是多少?我们使用最新的0.9.8测试,好像达不到这个数据

确认是否已使用scripts目录下定频脚本定频了。

执行了,我使用的DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588进行验证,下面是这个数据

Stage Total Time (ms) Tokens Time per Token (ms) Tokens per Second

Prefill 387.98 39 9.95 100.52

Generate 24719.56 255 102.77 9.73

安卓系统还是linux呢

@pxrgod
Copy link
Author

pxrgod commented Mar 7, 2025

你好,6TOPS@int8

请问下驱动版本是多少?我们使用最新的0.9.8测试,好像达不到这个数据

确认是否已使用scripts目录下定频脚本定频了。

执行了,我使用的DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588进行验证,下面是这个数据

Stage Total Time (ms) Tokens Time per Token (ms) Tokens per Second

Prefill 387.98 39 9.95 100.52

Generate 24719.56 255 102.77 9.73

安卓系统还是linux呢

linux

@waydong
Copy link
Collaborator

waydong commented Mar 7, 2025

运行界面截图看看

@pxrgod
Copy link
Author

pxrgod commented Mar 7, 2025

运行界面截图看看

Image

Image

@wohaiaini
Copy link

wohaiaini commented Mar 7, 2025

我用的 rk3576+0.9.7+1.1.0 性能数据比这个好

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants