Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

测试结果指标数值相同 #141

Open
LHB-kk opened this issue Sep 29, 2024 · 2 comments
Open

测试结果指标数值相同 #141

LHB-kk opened this issue Sep 29, 2024 · 2 comments
Assignees

Comments

@LHB-kk
Copy link

LHB-kk commented Sep 29, 2024

测试时,为什么平均延迟和平均生成第一个token的时间是一样的?
image

@LillyZhouXiHa
Copy link

同问,求问是什么原因

@lxline
Copy link
Collaborator

lxline commented Oct 25, 2024

请问您是在非 Steam 模式下的压测吗?

在非 Stream 模式返回的情况下,客户端收到第一个 Token 的延迟 == 整个 Response 的延迟。因此计算结果是相等的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants