Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use mapped model name to test #1370

Merged
merged 1 commit into from
Apr 27, 2024
Merged

Conversation

tylinux
Copy link
Contributor

@tylinux tylinux commented Apr 25, 2024

描述:渠道测试会使用第一个模型名来发起请求,如果使用模型重定向来保证各个渠道对外提供的模型名称一致,而第一个模型的名称又不是该渠道真正可用的模型名时可能会报错。

如下图,使用模型重定向将 Nvidia API 的 meta/llama3-70b-instruct 映射为 llama-3-70b-instruct,测试时会使用 llama-3-70b-instruct 作为模型名称,期望是使用meta/llama3-70b-instruct
image
我已确认该 PR 已自测通过,相关截图如下:

[SYS] 2024/04/25 - 13:29:16 | {"messages":[{"role":"user","content":"hi"}],"model":"meta/llama3-70b-instruct","max_tokens":2} 
[SYS] 2024/04/25 - 13:29:17 | testing channel #2, response: 
{"id":"chatcmpl-2175002b-36fa-43bc-aafc-809e3f84c498","object":"chat.completion","created":1714022957,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"message":{"role":"assistant","content":"Hi!"},"logprobs":{"content":[{"logprob":0.0},{"logprob":0.0}]}}],"usage":{"prompt_tokens":11,"total_tokens":13,"completion_tokens":2}} 

@songquanpeng
Copy link
Owner

周末处理~

@songquanpeng songquanpeng merged commit 1bd14af into songquanpeng:main Apr 27, 2024
@songquanpeng
Copy link
Owner

Thx~

mxdlzg pushed a commit to mxdlzg/one-api that referenced this pull request Apr 29, 2024
SheldonLiu0412 pushed a commit to SheldonLiu0412/one-api that referenced this pull request Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants