You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1、选择 Running Models,在 qwen2.5-instruct 模型上点击 Launch WEB UI,然后输入消息,点击 submit 。
2、网页出现,could not parse server SyntaxError Unexpected token 'l', "Internal S" is not valid json 错误。
3、xinference 容器日志出现 pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set arbitrary_types_allowed=True in the model_config to ignore this error or implement __get_pydantic_core_schema__ on your type to fully support it. 错误。
Expected behavior / 期待表现
怎么避免这种错误,正常使用 qwen 模型。
The text was updated successfully, but these errors were encountered:
System Info / 系統信息
Redhat Linux 8.4 x64 系统,docker-ce-26.1.3, 使用 CPU。
模型 qwen1.5-chart, qwen2.5-instruct
参数:llama.cpp, ggufv2, 0_5, q4_k_m, N GPU Layers
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
xprobe/xinference:v1.1.1-cpu
xprobe/xinference:v1.2.0-cpu
The command used to start Xinference / 用以启动 xinference 的命令
docker run --name xinference -d
-p 9997:9997
-e XINFERENCE_MODEL_SRC=modelscope
-e XINFERENCE_HOME=/root/.xinference
-v /home/opt/models/xinference:/root/.xinference
xprobe/xinference:v1.1.1-cpu
xinference-local -H 0.0.0.0 --log-level debug
Reproduction / 复现过程
1、选择 Running Models,在 qwen2.5-instruct 模型上点击 Launch WEB UI,然后输入消息,点击 submit 。
2、网页出现,could not parse server SyntaxError Unexpected token 'l', "Internal S" is not valid json 错误。
3、xinference 容器日志出现 pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set
arbitrary_types_allowed=True
in the model_config to ignore this error or implement__get_pydantic_core_schema__
on your type to fully support it. 错误。Expected behavior / 期待表现
怎么避免这种错误,正常使用 qwen 模型。
The text was updated successfully, but these errors were encountered: