Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

为什么通过命令启动重排序模型，会多出一个reasoning_content=False参数 #2999

Open
xiaowang-xuexiji opened this issue Mar 5, 2025 · 3 comments
Open

为什么通过命令启动重排序模型，会多出一个reasoning_content=False参数 #2999

xiaowang-xuexiji opened this issue Mar 5, 2025 · 3 comments
Labels
gpu
Milestone
v1.x

Comments

@xiaowang-xuexiji
Copy link

启动命令是
xinference launch --model-name bge-reranker-v2-m3 --model-type rerank --gpu-idx 1
报错信息为

Image
相关日志信息

Image
@XprobeBot XprobeBot added the gpu label Mar 5, 2025
@XprobeBot XprobeBot added this to the v1.x milestone Mar 5, 2025
@handalele
Copy link

Image
同样的

@qinxuye
Copy link
Contributor

qinxuye commented Mar 6, 2025

@amumu96 Please help to address this issue.

@amumu96
Copy link
Contributor

amumu96 commented Mar 7, 2025 •
edited
Loading

@xiaowang-xuexiji Can you post your version of Xinference?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
gpu
Projects
None yet
Milestone
v1.x
Development

No branches or pull requests
5 participants
@qinxuye @xiaowang-xuexiji @handalele @XprobeBot @amumu96