Skip to content
Merged
Show file tree
Hide file tree
Changes from 45 commits
Commits
Show all changes
132 commits
Select commit Hold shift + click to select a range
c0fee5f
rename
stas00 Jul 12, 2023
535c696
restore
stas00 Jul 19, 2023
22d369a
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Jul 19, 2023
3041404
mappings
stas00 Jul 19, 2023
702831f
unedited tests+docs
stas00 Jul 19, 2023
728154e
docs
stas00 Jul 19, 2023
2f70508
fixes
stas00 Jul 19, 2023
936fd87
fix auto-sync breakage
stas00 Jul 20, 2023
acdd4e6
cleanup
stas00 Jul 20, 2023
9b33761
wip
stas00 Jul 20, 2023
a9fc12b
wip
stas00 Jul 20, 2023
b07e5ad
add fetch_images
stas00 Jul 20, 2023
9bdbae4
remove einops dependency
stas00 Jul 20, 2023
4ad1102
update
stas00 Jul 20, 2023
64d1c6d
fix
stas00 Jul 21, 2023
569f10c
fix
stas00 Jul 21, 2023
78fab55
fix
stas00 Jul 21, 2023
ede00bd
fix
stas00 Jul 21, 2023
855b003
fix
stas00 Jul 21, 2023
c1953d5
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Jul 21, 2023
d9b2dd1
re-add
stas00 Jul 21, 2023
17e9c81
add batching
stas00 Jul 21, 2023
5db6061
rework
stas00 Jul 21, 2023
f2981f7
fix
stas00 Jul 21, 2023
88f8854
improve
stas00 Jul 21, 2023
21977ae
add Leo as I am extending his work
leot13 Jul 21, 2023
87ec8ca
cleanup
stas00 Jul 21, 2023
4d824b5
fix
stas00 Jul 21, 2023
d1e0a4d
cleanup
stas00 Jul 21, 2023
9a72641
slow-test
stas00 Jul 21, 2023
b47a2ce
fix
stas00 Jul 22, 2023
094031d
fix
stas00 Jul 22, 2023
e16d36a
fixes
stas00 Jul 22, 2023
ef1bbb5
deal with warning
stas00 Jul 22, 2023
d9a8fbe
rename modified llama classes
stas00 Jul 22, 2023
224847b
rework fetch_images
stas00 Jul 24, 2023
305eebf
alternative implementation
stas00 Jul 24, 2023
4873206
cleanup
stas00 Jul 25, 2023
41b8214
strict version
stas00 Jul 25, 2023
4c8c8cc
cleanup
stas00 Jul 25, 2023
1d17358
[`IDEFICS`] Fix idefics ci (#25056)
younesbelkada Jul 25, 2023
cc4b4ce
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Jul 25, 2023
ae30b63
remove compat checks
stas00 Jul 25, 2023
975521e
style
stas00 Jul 25, 2023
faf25f5
explain that Idefics is not for training from scratch
stas00 Jul 25, 2023
7aa8f05
require pt>=2.0
stas00 Jul 25, 2023
4d7f589
fix idefics vision config (#25092)
younesbelkada Jul 26, 2023
cc8b236
cleanup
stas00 Jul 26, 2023
bf066ae
style
stas00 Jul 26, 2023
c1cae94
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Jul 26, 2023
7300c51
cleanup
stas00 Jul 26, 2023
19e60c3
Apply suggestions from code review
stas00 Jul 26, 2023
93aef19
upcase
stas00 Jul 26, 2023
1fc3852
sequence of images
stas00 Jul 26, 2023
b807289
handle the case with no images
stas00 Jul 26, 2023
a25d1e4
Update src/transformers/image_processing_utils.py
stas00 Jul 26, 2023
fd0a072
support pure lm take 2
stas00 Jul 26, 2023
f5029dd
support tokenizer options
stas00 Jul 26, 2023
8ca44c0
parameterize num_channels
stas00 Jul 26, 2023
0e35f25
fix upcase
stas00 Jul 26, 2023
ee8a300
s|IdeficsForCausalLM|IdeficsForVisionText2Text|g
stas00 Jul 26, 2023
6b1449b
manual to one line
stas00 Jul 26, 2023
820d12d
addressing review
stas00 Jul 26, 2023
127006a
unbreak
stas00 Jul 26, 2023
bfc0058
remove clip dependency
stas00 Jul 26, 2023
455252b
fix test
stas00 Jul 26, 2023
d6717ff
consistency
stas00 Jul 26, 2023
d330108
PIL import
stas00 Jul 26, 2023
30d8efd
Idefics prefix
stas00 Jul 26, 2023
94ee1c5
Idefics prefix
stas00 Jul 26, 2023
6b1d63a
hack to make tests work
stas00 Jul 27, 2023
9bc11b9
style
stas00 Jul 27, 2023
10e6a11
fix
stas00 Jul 27, 2023
a4e9232
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Jul 27, 2023
3642e53
fix
stas00 Jul 27, 2023
c9def17
revert
stas00 Jul 27, 2023
eed8043
try/finally
stas00 Jul 27, 2023
588ed5a
cleanup
stas00 Jul 27, 2023
ac241e1
clean up
stas00 Jul 27, 2023
348bd64
move
stas00 Jul 27, 2023
af46ff2
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Jul 27, 2023
9d38545
[`IDEFICS`] Fix idefics config refactor (#25149)
younesbelkada Jul 27, 2023
b3b370c
fix
stas00 Jul 27, 2023
66a0f64
license
stas00 Jul 27, 2023
ee1ea2f
condition on pt
stas00 Jul 27, 2023
86b997c
fix
stas00 Jul 27, 2023
9ab038f
style
stas00 Jul 27, 2023
4dbd4d1
fix
stas00 Jul 27, 2023
a7b0e94
rm torchvision dependency, allow custom transforms
stas00 Jul 27, 2023
8e7f138
address review
stas00 Jul 27, 2023
c7ba1d3
rework device arg
stas00 Jul 27, 2023
e00f75d
add_eos_token
stas00 Jul 27, 2023
a9c36ae
s/transforms/transform/
stas00 Jul 27, 2023
85b9c13
fix top level imports
stas00 Jul 28, 2023
c13783f
fix return value
stas00 Jul 28, 2023
566b371
cleanup
stas00 Jul 28, 2023
428b907
cleanup
stas00 Jul 28, 2023
660366d
fix
stas00 Jul 28, 2023
85aaf87
style
stas00 Jul 28, 2023
1237e7f
license
stas00 Jul 28, 2023
bbffd19
license
stas00 Jul 28, 2023
64da7ea
Update src/transformers/models/idefics/image_processing_idefics.py
stas00 Jul 28, 2023
f977e83
add a wrapper to freeze vision layears
stas00 Jul 28, 2023
c146974
tidyup
stas00 Jul 28, 2023
5e50e49
use the correct std/mean settings
stas00 Jul 28, 2023
a49cffe
parameterize values from config
stas00 Jul 29, 2023
f11c181
add tests/models/idefics/test_image_processing_idefics.py
stas00 Jul 29, 2023
6b8e59a
add test_processor_idefics.py
stas00 Jul 29, 2023
7e821f9
cleanup
stas00 Jul 29, 2023
eaf4e6e
cleanups
stas00 Jul 30, 2023
5b28c2c
fix
stas00 Jul 30, 2023
24b7207
fix
stas00 Jul 30, 2023
dda7df4
move to the right group
stas00 Jul 30, 2023
5c39219
style
stas00 Jul 30, 2023
1c7d8e4
Apply suggestions from code review
stas00 Jul 31, 2023
662e4d3
add perceiver config
stas00 Jul 31, 2023
3182195
reset
stas00 Jul 31, 2023
52d5568
missing arg docs
stas00 Jul 31, 2023
f1de97b
Apply suggestions from code review
stas00 Jul 31, 2023
e8817e8
address review comments
stas00 Jul 31, 2023
40b91c7
inject automatic end of utterance tokens (#25218)
stas00 Jul 31, 2023
b597998
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Aug 1, 2023
76f7fdf
Update src/transformers/models/idefics/processing_idefics.py
stas00 Aug 1, 2023
b3a8a7c
address review
stas00 Aug 1, 2023
ae26401
Apply suggestions from code review
stas00 Aug 18, 2023
58a2b2e
Update src/transformers/image_processing_utils.py
stas00 Aug 18, 2023
a24b07e
[`Idefics`] add image_embeddings option in generate-related methods (…
leot13 Aug 18, 2023
35e28a8
Merge remote-tracking branch 'origin/main' into add-model-idefics
stas00 Aug 18, 2023
49dd882
fix rebase changes
stas00 Aug 18, 2023
906485b
unbreak #25237 - to be fixed in follow up PRs
stas00 Aug 18, 2023
2e37e6c
is_composition = False
stas00 Aug 18, 2023
1e416d9
no longer needed
stas00 Aug 18, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -374,6 +374,7 @@ Current number of checkpoints: ![](https://img.shields.io/endpoint?url=https://h
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (from UCSD, NVIDIA) released with the paper [GroupViT: Semantic Segmentation Emerges from Text Supervision](https://arxiv.org/abs/2202.11094) by Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang.
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (from Facebook) released with the paper [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://arxiv.org/abs/2106.07447) by Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed.
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (from Berkeley) released with the paper [I-BERT: Integer-only BERT Quantization](https://arxiv.org/abs/2101.01321) by Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer.
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (from OpenAI) released with the paper [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/) by Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever.
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (from Salesforce) released with the paper [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500) by Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi.
Expand Down
1 change: 1 addition & 0 deletions README_es.md
Original file line number Diff line number Diff line change
Expand Up @@ -351,6 +351,7 @@ Número actual de puntos de control: ![](https://img.shields.io/endpoint?url=htt
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (from UCSD, NVIDIA) released with the paper [GroupViT: Semantic Segmentation Emerges from Text Supervision](https://arxiv.org/abs/2202.11094) by Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang.
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (from Facebook) released with the paper [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://arxiv.org/abs/2106.07447) by Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed.
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (from Berkeley) released with the paper [I-BERT: Integer-only BERT Quantization](https://arxiv.org/abs/2101.01321) by Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer.
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (from OpenAI) released with the paper [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/) by Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever.
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (from Salesforce) released with the paper [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500) by Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi.
Expand Down
1 change: 1 addition & 0 deletions README_hd.md
Original file line number Diff line number Diff line change
Expand Up @@ -323,6 +323,7 @@ conda install -c huggingface transformers
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (UCSD, NVIDIA से) साथ में कागज [GroupViT: टेक्स्ट सुपरविजन से सिमेंटिक सेगमेंटेशन इमर्जेस](https://arxiv .org/abs/2202.11094) जियारुई जू, शालिनी डी मेलो, सिफ़ी लियू, वोनमिन बायन, थॉमस ब्रेउएल, जान कौट्ज़, ज़ियाओलोंग वांग द्वारा।
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (फेसबुक से) साथ में पेपर [ह्यूबर्ट: सेल्फ सुपरवाइज्ड स्पीच रिप्रेजेंटेशन लर्निंग बाय मास्क्ड प्रेडिक्शन ऑफ हिडन यूनिट्स](https ://arxiv.org/abs/2106.07447) वेई-निंग सू, बेंजामिन बोल्टे, याओ-हंग ह्यूबर्ट त्साई, कुशाल लखोटिया, रुस्लान सालाखुतदीनोव, अब्देलरहमान मोहम्मद द्वारा।
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (बर्कले से) साथ में कागज [I-BERT: Integer-only BERT Quantization](https:// arxiv.org/abs/2101.01321) सेहून किम, अमीर घोलमी, ज़ेवेई याओ, माइकल डब्ल्यू महोनी, कर्ट केटज़र द्वारा।
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (from OpenAI) released with the paper [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/) by Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever.
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (Salesforce से) Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi. द्वाराअनुसंधान पत्र [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500) के साथ जारी किया गया
Expand Down
1 change: 1 addition & 0 deletions README_ja.md
Original file line number Diff line number Diff line change
Expand Up @@ -385,6 +385,7 @@ Flax、PyTorch、TensorFlowをcondaでインストールする方法は、それ
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (UCSD, NVIDIA から) Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang から公開された研究論文: [GroupViT: Semantic Segmentation Emerges from Text Supervision](https://arxiv.org/abs/2202.11094)
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (Facebook から) Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed から公開された研究論文: [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://arxiv.org/abs/2106.07447)
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (Berkeley から) Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer から公開された研究論文: [I-BERT: Integer-only BERT Quantization](https://arxiv.org/abs/2101.01321)
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (OpenAI から) Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever から公開された研究論文: [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/)
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (Salesforce から) Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi. から公開された研究論文 [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500)
Expand Down
1 change: 1 addition & 0 deletions README_ko.md
Original file line number Diff line number Diff line change
Expand Up @@ -300,6 +300,7 @@ Flax, PyTorch, TensorFlow 설치 페이지에서 이들을 conda로 설치하는
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (UCSD, NVIDIA 에서) Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang 의 [GroupViT: Semantic Segmentation Emerges from Text Supervision](https://arxiv.org/abs/2202.11094) 논문과 함께 발표했습니다.
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (Facebook 에서) Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed 의 [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://arxiv.org/abs/2106.07447) 논문과 함께 발표했습니다.
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (Berkeley 에서) Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer 의 [I-BERT: Integer-only BERT Quantization](https://arxiv.org/abs/2101.01321) 논문과 함께 발표했습니다.
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (OpenAI 에서) Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever 의 [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/) 논문과 함께 발표했습니다.
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (Salesforce 에서 제공)은 Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi.의 [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500)논문과 함께 발표했습니다.
Expand Down
1 change: 1 addition & 0 deletions README_zh-hans.md
Original file line number Diff line number Diff line change
Expand Up @@ -324,6 +324,7 @@ conda install -c huggingface transformers
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (来自 UCSD, NVIDIA) 伴随论文 [GroupViT: Semantic Segmentation Emerges from Text Supervision](https://arxiv.org/abs/2202.11094) 由 Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang 发布。
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (来自 Facebook) 伴随论文 [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://arxiv.org/abs/2106.07447) 由 Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed 发布。
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (来自 Berkeley) 伴随论文 [I-BERT: Integer-only BERT Quantization](https://arxiv.org/abs/2101.01321) 由 Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer 发布。
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (来自 OpenAI) 伴随论文 [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/) 由 Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever 发布。
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (来自 Salesforce) 伴随论文 [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500) 由 Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi 发布。
Expand Down
1 change: 1 addition & 0 deletions README_zh-hant.md
Original file line number Diff line number Diff line change
Expand Up @@ -336,6 +336,7 @@ conda install -c huggingface transformers
1. **[GroupViT](https://huggingface.co/docs/transformers/model_doc/groupvit)** (from UCSD, NVIDIA) released with the paper [GroupViT: Semantic Segmentation Emerges from Text Supervision](https://arxiv.org/abs/2202.11094) by Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang.
1. **[Hubert](https://huggingface.co/docs/transformers/model_doc/hubert)** (from Facebook) released with the paper [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://arxiv.org/abs/2106.07447) by Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed.
1. **[I-BERT](https://huggingface.co/docs/transformers/model_doc/ibert)** (from Berkeley) released with the paper [I-BERT: Integer-only BERT Quantization](https://arxiv.org/abs/2101.01321) by Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer.
1. **[Idefics](https://huggingface.co/docs/transformers/main/model_doc/idefics)** (from HuggingFace) released with the paper [OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://huggingface.co/papers/2306.16527) by Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander M. Rush, Douwe Kiela, Matthieu Cord, Victor Sanh.
1. **[ImageGPT](https://huggingface.co/docs/transformers/model_doc/imagegpt)** (from OpenAI) released with the paper [Generative Pretraining from Pixels](https://openai.com/blog/image-gpt/) by Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, Ilya Sutskever.
1. **[Informer](https://huggingface.co/docs/transformers/model_doc/informer)** (from Beihang University, UC Berkeley, Rutgers University, SEDD Company) released with the paper [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://arxiv.org/abs/2012.07436) by Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang.
1. **[InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip)** (from Salesforce) released with the paper [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://arxiv.org/abs/2305.06500) by Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven Hoi.
Expand Down
2 changes: 2 additions & 0 deletions docs/source/en/_toctree.yml
Original file line number Diff line number Diff line change
Expand Up @@ -335,6 +335,8 @@
title: HerBERT
- local: model_doc/ibert
title: I-BERT
- local: model_doc/idefics
title: Idefics
- local: model_doc/jukebox
title: Jukebox
- local: model_doc/led
Expand Down
Loading