Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT: qwen2 audio #2271

Merged
merged 7 commits into from
Sep 14, 2024
Merged

FEAT: qwen2 audio #2271

merged 7 commits into from
Sep 14, 2024

Conversation

codingl2k1
Copy link
Contributor

@codingl2k1 codingl2k1 commented Sep 10, 2024 •
edited
Loading

  • Requires: pip install git+https://github.com/huggingface/transformers
  • Not work on MPS.
RuntimeError: Placeholder storage has not been allocated on MPS device!

@XprobeBot XprobeBot added this to the v0.15 milestone Sep 10, 2024
@qinxuye
Copy link
Contributor

qinxuye commented Sep 13, 2024

Could you fix the CI?

@codingl2k1 codingl2k1 marked this pull request as ready for review September 13, 2024 10:30
@codingl2k1
Copy link
Contributor Author

Could you fix the CI?

Fixed but not tested, as the MPS backend is not supported.

qinxuye
qinxuye approved these changes Sep 14, 2024
View reviewed changes
Copy link
Contributor

@qinxuye qinxuye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested. LGTM

@qinxuye qinxuye merged commit 961d355 into xorbitsai:main Sep 14, 2024
10 of 13 checks passed
Vanocore added a commit to Vanocore/xinference that referenced this pull request Sep 22, 2024
@Vanocore
Merge branch 'main' of https://github.com/xorbitsai/inference
e3df693 
* 'main' of https://github.com/xorbitsai/inference:
  FEAT: support qwen2.5-coder-instruct and qwen2.5 sglang (xorbitsai#2332)
  DOC: update models for doc and readme (xorbitsai#2330)
  BUG: fix stable diffusion from dify tool (xorbitsai#2336)
  BUG: support old register llm format (xorbitsai#2335)
  FEAT: Support Qwen 2.5 (xorbitsai#2325)
  BUG: Fix CosyVoice missing output (xorbitsai#2320)
  BUG: [UI] Fix registration page bug. (xorbitsai#2315)
  Bug: modify vllm image version (xorbitsai#2312)
  BUG: modify vllm image version (xorbitsai#2311)
  FEAT: qwen2 audio (xorbitsai#2271)
  BUG: fix sampler_name for img2img (xorbitsai#2301)
  FEAT: Support yi-coder-chat (xorbitsai#2302)
  FEAT: support flux.1 image2image and inpainting (xorbitsai#2296)
  FEAT: support sdapi/img2img (xorbitsai#2293)
  ENH: Support fish speech 1.4 (xorbitsai#2295)
  FEAT: Update Qwen2-VL-Model to support flash_attention_2 implementation (xorbitsai#2289)
  FEAT: support deepseek-v2 and 2.5 (xorbitsai#2292)

# Conflicts:
#	xinference/model/audio/cosyvoice.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ChengjieLi28 ChengjieLi28 ChengjieLi28 approved these changes

@qinxuye qinxuye qinxuye approved these changes

Assignees
No one assigned
Labels
feature
Projects
None yet
Milestone
v0.15
Development

Successfully merging this pull request may close these issues.
4 participants
@codingl2k1 @qinxuye @ChengjieLi28 @XprobeBot