Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

169 Open 1,596 Closed
169 Open 1,596 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

无论是否开启Parsing Reasoning Content，模型的思考过程都以逗号开头
#3026 opened Mar 10, 2025 by frankSARU v1.x
1
qwen2-vl 和qwen2.5-vl都没有vllm引擎选项
#3025 opened Mar 10, 2025 by pyaaaa
3 tasks
v1.x
Can't launch QwQ-32B with 'Parsing Reasoning Content' switch on. gpu
#3023 opened Mar 10, 2025 by tacnaci
1 of 3 tasks
v1.x
1
1
model auto load when requested via api feature
#3022 opened Mar 9, 2025 by mamema v1.x
1
自定义模型无法删除 gpu
#3021 opened Mar 9, 2025 by zjxxsr
1 of 3 tasks
v1.x
1
SGLang 后端启动 llama-3.3-instruct awq 失败，返回与 Qwen2_5_VLConfig 相关的错误 gpu
#3020 opened Mar 9, 2025 by gaoyifan
1 of 3 tasks
v1.x
3
自定义模型没有设置【解析推理内容】项 gpu
#3019 opened Mar 9, 2025 by htl258
3 tasks
v1.x
docker启动xinference之后，在ui界面运行本地下载好的模型报错
#3017 opened Mar 9, 2025 by leoneyar v1.x
2
Fail to launch SenseVoiceSmall model by CPU. gpu
#3016 opened Mar 8, 2025 by FalconIA
1 of 3 tasks
v1.x
1
请问在哪里查看启动模型时可传入的全部参数
#3011 opened Mar 7, 2025 by ZimaBlueee v1.x
1
continous batching support otherimage-generation model?
#3009 opened Mar 7, 2025 by chenslcool v1.x
1
使用pip install "xinference[all]"安装后启动模型报错
#3004 opened Mar 5, 2025 by zscxc
1 of 3 tasks
v1.x
2
启动qwen2.5-vl时报错 gpu
#3002 opened Mar 5, 2025 by hackerhaiJu
1 of 3 tasks
v1.x
1
用mlx-vlm启动的qwen2.5-vl-instruct模型输出内容不完整，同样的模型用lm-studio启动输出没问题，lm-studio也是用的mlx引擎
#3001 opened Mar 5, 2025 by mrhuangyong
1 of 3 tasks
v1.x
4
set the option trust_remote_code=True to remove this error.
#3000 opened Mar 5, 2025 by guxingxiayu v1.x
1
为什么通过命令启动重排序模型，会多出一个reasoning_content=False参数 gpu
#2999 opened Mar 5, 2025 by xiaowang-xuexiji v1.x
3
vLLM不支持enable_prefix_cache参数 good first issue Good for newcomers gpu
#2998 opened Mar 5, 2025 by xyk0930
1 of 3 tasks
v1.x
4
xinference无法通过公网ip进行访问
#2996 opened Mar 4, 2025 by Ask-sola
1 of 3 tasks
v1.x
模型部署后出现异常，无法下线也无法调用
#2995 opened Mar 4, 2025 by micohuang
1 of 3 tasks
v1.x
1
申请支持baichuan-inc/Baichuan-M1-14B-Instruct feature
#2994 opened Mar 4, 2025 by moshilangzi v1.x
1
[UI] gpu index display was wrong gpu
#2988 opened Mar 4, 2025 by lordk911
1 of 3 tasks
v1.x
1
0.0.0.0:9997/docs打不开 gpu
#2987 opened Mar 4, 2025 by Silenceang
1 of 3 tasks
v1.x
1
启动reranker模型失败 good first issue Good for newcomers
#2985 opened Mar 4, 2025 by TZJ12
1 of 3 tasks
v1.x
1
request_limits 这个参数怎么理解
#2983 opened Mar 4, 2025 by gxx-ljy v1.x
1
fishspeech-v1.5添加音色支持 feature
#2981 opened Mar 3, 2025 by ai408 v1.x
2
ProTip! Updated in the last three days: updated:>2025-03-06.