We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cuda: 12.4, vllm 0.7.3, python 3.11.11, ubuntu 22.04.5
1.3.1
xinference-local --host 0.0.0.0 --port 9997 --auth-config auth_config.json
It seems that no reason_parser has been registered for QwQ, causing a startup error.
When the 'Parsing Reasoning Content' switch is turned on, QwQ-32B can start normally using vllm.
The text was updated successfully, but these errors were encountered:
This is a known issue and will be fixed soon. @amumu96
Sorry, something went wrong.
Successfully merging a pull request may close this issue.
System Info / 系統信息
cuda: 12.4, vllm 0.7.3, python 3.11.11, ubuntu 22.04.5
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
1.3.1
The command used to start Xinference / 用以启动 xinference 的命令
xinference-local --host 0.0.0.0 --port 9997 --auth-config auth_config.json
Reproduction / 复现过程
It seems that no reason_parser has been registered for QwQ, causing a startup error.
Expected behavior / 期待表现
When the 'Parsing Reasoning Content' switch is turned on, QwQ-32B can start normally using vllm.
The text was updated successfully, but these errors were encountered: