Skip to content

Add Qwen2.5-Omni #36752

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 57 commits into from
Apr 14, 2025
+12,063 −49
Merged

Add Qwen2.5-Omni #36752

Show file tree
Hide file tree
Changes from 53 commits
Commits
Show all changes
57 commits
Select commit Hold shift + click to select a range
b4ff115
Add qwen2.5-omni
Mar 16, 2025
33e479e
Remove einops dependency
Mar 16, 2025
241abde
Add torchdiffeq dependency
Mar 16, 2025
9b847cb
Sort init
Mar 16, 2025
2157b5a
Add torchdiffeq to extras['diffeq']
Mar 16, 2025
e541399
Fix repo consistency
Mar 17, 2025
d937243
use cached_file
Mar 17, 2025
586f7ff
del odeint
Mar 17, 2025
29db603
Merge branch 'qwen25omni' of http://gitlab.alibaba-inc.com/DamoAGI/tr…
Mar 17, 2025
7f158f5
renew pytest
Mar 17, 2025
6027556
format
Mar 17, 2025
1a8533d
Remove torchdiffeq
Mar 17, 2025
bdbb8ea
format
Mar 17, 2025
827404a
fixed batch infer bug
Mar 17, 2025
1d04f0d
Change positional_embedding to parameter
Mar 19, 2025
a169211
Change default speaker
Mar 22, 2025
f1d63db
Config revision
Mar 22, 2025
7413de0
Use modular & code clean
Mar 24, 2025
3a1ead0
code clean
Mar 26, 2025
5efaed6
decouple padding with model & code cleaning
Mar 27, 2025
99fe6f8
sort init
Mar 27, 2025
3d4ebe8
fix
Mar 28, 2025
f742a64
fix
Mar 28, 2025
63ec845
Second code review
Mar 30, 2025
04e5260
fix
Mar 30, 2025
07626dc
Merge branch 'main' into qwen25omni
BakerBunker Mar 30, 2025
ae15523
fix
Mar 30, 2025
299eaa8
rename vars to full name + some comments
zucchini-nlp Apr 2, 2025
67efc09
update pytest
Apr 1, 2025
590d167
Code clean & fix
Apr 2, 2025
debde07
fix
Apr 2, 2025
08c05fd
style
Apr 2, 2025
01f48b5
more clean up
zucchini-nlp Apr 2, 2025
2f32d27
fixup
zucchini-nlp Apr 2, 2025
319d79e
smaller vision model in tests
zucchini-nlp Apr 2, 2025
771f8f2
fix processor test
Apr 2, 2025
61d21d8
Merge remote-tracking branch 'upstream/main' into qwen25omni
zucchini-nlp Apr 2, 2025
26e54de
deflake a bit the tests (still flaky though)
zucchini-nlp Apr 2, 2025
0d5c29d
de-flake tests finally + add generation mixin
zucchini-nlp Apr 2, 2025
4641c44
final nits i hope
zucchini-nlp Apr 2, 2025
134856d
make sure processor tests are complete
zucchini-nlp Apr 2, 2025
f74562c
replace with Qwen2_5OmniForConditionalGeneration
zucchini-nlp Apr 3, 2025
e6776df
fix tests after updating ckpt
zucchini-nlp Apr 3, 2025
6929d60
fix typos when cleaning, also we can't change ckpt
zucchini-nlp Apr 3, 2025
2ec1964
fixup
zucchini-nlp Apr 3, 2025
466f4bf
images and videos kwargs for processor
zucchini-nlp Apr 3, 2025
b317f84
thinker and talker loadable from hub ckpt
zucchini-nlp Apr 7, 2025
ee7b7f9
merge main
zucchini-nlp Apr 10, 2025
4da369e
address comments and update tests after rebase
zucchini-nlp Apr 10, 2025
ecd3133
fixup
zucchini-nlp Apr 10, 2025
7ed74dd
merge main
zucchini-nlp Apr 11, 2025
03752e4
skip for now
zucchini-nlp Apr 11, 2025
ecc920e
fixup
zucchini-nlp Apr 11, 2025
d9be9c9
fixup
Apr 12, 2025
605da81
remove torch dependency in processors
zucchini-nlp Apr 14, 2025
1240a81
Merge branch 'main' into qwen25omni
zucchini-nlp Apr 14, 2025
ef73ef7
Merge branch 'main' into qwen25omni
zucchini-nlp Apr 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions docs/source/en/_toctree.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -993,6 +993,8 @@
title: Pix2Struct
- local: model_doc/pixtral
title: Pixtral
- local: model_doc/qwen2_5_omni
title: Qwen2.5-Omni
- local: model_doc/qwen2_5_vl
title: Qwen2.5-VL
- local: model_doc/qwen2_audio
Expand Down
Loading