Skip to content
Merged
Show file tree
Hide file tree
Changes from 160 commits
Commits
Show all changes
180 commits
Select commit Hold shift + click to select a range
3918f1c
Commit with BTModel and latest HF code
abhiwand Nov 23, 2022
46c3869
Placeholder classes for BTForMLM and BTForITR
abhiwand Nov 29, 2022
50b54fa
Importing Bert classes from transformers
abhiwand Nov 29, 2022
3615f70
Removed objectives.py and dist_utils.py
abhiwand Nov 29, 2022
7470286
Removed swin_transformer.py
abhiwand Nov 29, 2022
b261834
Add image normalization, BridgeTowerForImageAndTextRetrieval
shaoyent-IL Dec 2, 2022
be7e37f
Add center_crop
abhiwand Dec 4, 2022
5eb8853
Removing bert tokenizer and LCI references
abhiwand Dec 5, 2022
6891d8c
Tested config loading from HF transformers hub
abhiwand Dec 6, 2022
4d0c5df
Removed state_dict updates and added path to hub
abhiwand Dec 7, 2022
8ae887b
Enable center crop
shaoyent-IL Dec 8, 2022
037dfa4
Getting image_size from config, renaming num_heads and num_layers
abhiwand Dec 8, 2022
bf298bd
Handling max_length in BridgeTowerProcessor
abhiwand Dec 9, 2022
83c551e
Add BridgeTowerForMaskedLM
shaoyent-IL Dec 9, 2022
42c9431
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
shaoyent-IL Dec 9, 2022
a0271f4
Add doc string for BridgeTowerConfig
abhiwand Dec 9, 2022
3cefae0
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
abhiwand Dec 9, 2022
f15a6ee
Add doc strings for BT config, processor, image processor
abhiwand Dec 9, 2022
c392282
Adding docs, removed swin
abhiwand Dec 10, 2022
fa46a84
Merge branch 'main' of https://github.com/huggingface/transformers in…
abhiwand Dec 12, 2022
ceaa586
Removed convert_bridgetower_original_to_pytorch.py
abhiwand Dec 12, 2022
383aa0f
Added doc files for bridgetower, removed is_vision
abhiwand Dec 13, 2022
d934318
Add support attention_mask=None and BridgeTowerModelOutput
shaoyent-IL Dec 13, 2022
ffaa351
Fix formatting
shaoyent-IL Dec 13, 2022
41e29f3
Fixes with 'make style', 'make quality', 'make fixup'
abhiwand Dec 13, 2022
9ffdb5e
Remove downstream tasks from BridgeTowerModel
shaoyent-IL Dec 13, 2022
2249cbe
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
abhiwand Dec 13, 2022
31f47ce
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
abhiwand Dec 13, 2022
e9386af
Formatting fixes, add return_dict to BT models
abhiwand Dec 13, 2022
0e427e2
Clean up after doc_test
abhiwand Dec 13, 2022
b6befba
Update BTModelOutput return type, fix todo in doc
abhiwand Dec 13, 2022
e60d1ad
Remove loss_names from init
shaoyent-IL Dec 13, 2022
43ed8c0
implement tests and update tuples returned by models
tileintel Dec 13, 2022
7823968
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
tileintel Dec 13, 2022
a4e013a
Add image reference to bridgetower.mdx
abhiwand Dec 14, 2022
0e0e8d5
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
abhiwand Dec 14, 2022
2d67f9d
after make fix-copies, make fixup, make style, make quality, make rep…
tileintel Dec 14, 2022
5b87156
Rename class names with BridgeTower prefix
abhiwand Dec 14, 2022
d778bef
Merge branch 'btmodel.tests' of https://github.com/intel-sandbox/brid…
abhiwand Dec 14, 2022
e83540a
Fix for image_size in BTImageProcessor
abhiwand Dec 14, 2022
dcbd2cc
implement feature extraction bridgetower tests
tileintel Dec 14, 2022
db5d228
Update image_mean and image_std to be list
abhiwand Dec 14, 2022
8b12a61
Merge branch 'btmodel' of https://github.com/intel-sandbox/bridgetowe…
tileintel Dec 14, 2022
91cebfa
Merge branch 'main' of https://github.com/abhiwand/transformers into …
abhiwand Dec 14, 2022
fdfec70
Merge branch 'btmodel.fea_extract_tests' of https://github.com/intel-…
abhiwand Dec 14, 2022
26708da
remove unused import
tileintel Dec 14, 2022
4a4522f
Removed old comments
abhiwand Dec 14, 2022
4596860
Merge pull request #6 from intel-sandbox/btmodel.fea_extract_tests
abhiwand Dec 14, 2022
b96cb11
Rework CLIP
shaoyent-IL Dec 15, 2022
b65c5ca
update config in tests followed config update
tileintel Dec 15, 2022
cd29d4e
Formatting fixes
abhiwand Dec 15, 2022
3ba2708
Add copied from for BridgeTowerPredictionHeadTransform
abhiwand Dec 15, 2022
bb97190
Update bridgetower.mdx
abhiwand Dec 15, 2022
8e79e09
Update test_feature_extraction_bridgetower.py
abhiwand Dec 15, 2022
2f21e29
Update bridgetower.mdx
shaoyent-IL Dec 15, 2022
bb95b96
BridgeTowerForMaskedLM is conditioned on image too
shaoyent-IL Dec 15, 2022
42bc283
Add BridgeTowerForMaskedLM
shaoyent-IL Dec 15, 2022
5877c13
Fixes
shaoyent-IL Dec 15, 2022
0c9f3a8
Merge pull request #1 from abhiwand/add_bridgetower_model.shaoyen
shaoyent-IL Dec 15, 2022
35cc7fa
Call post_init to init weights
shaoyent-IL Dec 16, 2022
f4a22a0
Merge pull request #2 from abhiwand/hf-fork/add_bridgetower_model.pr_…
shaoyent-IL Dec 16, 2022
92948d3
Move freeze layers into method
shaoyent-IL Dec 16, 2022
c37dffd
Remove BTFeatureExtractor, add BT under multimodal models
abhiwand Dec 16, 2022
b58c529
Remove BTFeatureExtractor, add BT under multimodal models
abhiwand Dec 16, 2022
6a29d13
Merge branch 'add_bridgetower_model.pr_review' of https://github.com/…
abhiwand Dec 16, 2022
04c5940
Code review feedback - cleanup
abhiwand Dec 17, 2022
0c068b8
Rename variables
abhiwand Dec 17, 2022
84cc8ff
Formatting and style to PR review feedback
abhiwand Dec 17, 2022
99e562f
Move center crop after resize
shaoyent-IL Dec 17, 2022
0849d64
Use named parameters
shaoyent-IL Dec 17, 2022
06ba836
Merge pull request #3 from abhiwand/add_bridgetower_model.pr_review
shaoyent-IL Dec 17, 2022
78631e5
Style fix for modeling_bridgetower.py
abhiwand Dec 17, 2022
91eff9b
Merge pull request #4 from abhiwand/add_bridgetower_model.pr_review
abhiwand Dec 17, 2022
a890134
Merge branch 'add_bridgetower_model' of https://github.com/abhiwand/t…
abhiwand Dec 19, 2022
7315044
Update docs/source/en/model_doc/bridgetower.mdx
abhiwand Dec 19, 2022
873e343
Update docs/source/en/model_doc/bridgetower.mdx
abhiwand Dec 19, 2022
021e5a8
Update docs/source/en/model_doc/bridgetower.mdx
abhiwand Dec 19, 2022
c89936a
Update src/transformers/models/bridgetower/modeling_bridgetower.py
abhiwand Dec 19, 2022
5f04b9b
Update src/transformers/models/bridgetower/modeling_bridgetower.py
abhiwand Dec 19, 2022
2a4b906
Update docs/source/en/model_doc/bridgetower.mdx
abhiwand Dec 19, 2022
0de08da
Update src/transformers/models/bridgetower/modeling_bridgetower.py
abhiwand Dec 19, 2022
7f4e68f
Rename config params, copy BERT classes, clean comments
abhiwand Dec 19, 2022
bccef0f
Merge branch 'add_bridgetower_model' into add_bridgetower.pr_review2
abhiwand Dec 20, 2022
ca81490
Merge pull request #5 from abhiwand/add_bridgetower.pr_review2
abhiwand Dec 20, 2022
275551a
Cleanup irtr
abhiwand Dec 20, 2022
f611391
Merge branch 'add_bridgetower.pr_review2' of https://github.com/abhiw…
abhiwand Dec 20, 2022
53e31fe
Replace Roberta imports, add BTTextConfig and Model
abhiwand Dec 20, 2022
312797d
Update docs, add visionconfig, consistent arg names
abhiwand Dec 21, 2022
ed0ee7a
make fixup
abhiwand Dec 21, 2022
cb96a93
Comments for forward in BTModel and make fixup
abhiwand Dec 22, 2022
efff351
correct tests
tileintel Dec 22, 2022
c22057e
Merge pull request #6 from abhiwand/pr_review2_tile
abhiwand Dec 22, 2022
5534bbc
Merge branch 'main' of https://github.com/abhiwand/transformers into …
abhiwand Dec 22, 2022
50a79c2
Merge pull request #7 from abhiwand/add_bridgetower.pr_review2
abhiwand Dec 22, 2022
32d7796
Remove inconsistent roberta copied from
abhiwand Dec 23, 2022
b941d49
Add BridgeTowerTextModel to dummy_pt_objects.py
abhiwand Dec 23, 2022
b8bd739
Add BridgeTowerTextModel to IGNORE_NON_TESTED
abhiwand Dec 23, 2022
6d9f539
Update docs for BT Text and Vision Configs
abhiwand Dec 23, 2022
337025b
Treat BridgeTowerTextModel as a private model
abhiwand Dec 23, 2022
7d4c23a
BridgeTowerTextModel as private
abhiwand Dec 23, 2022
608fb11
Run make fix-copies
abhiwand Dec 23, 2022
b2d8c43
Adding BTTextModel to PRIVATE_MODELS
abhiwand Dec 23, 2022
2c99cef
Fix for issue with BT Text and Image configs
abhiwand Dec 23, 2022
e85f724
make style changes
abhiwand Dec 23, 2022
46416dd
Merge branch 'main' into add_bridgetower_model
tileintel Dec 28, 2022
a9939f8
Update README_ja.md
tileintel Dec 28, 2022
ad7c744
Clean up config, .mdx and arg names
abhiwand Jan 3, 2023
dbcf749
Fix init_weights. Remove nn.Sequential
shaoyent-IL Jan 3, 2023
97d714c
Formatting and style fixes
abhiwand Jan 4, 2023
be618cf
Re-add tie_word_embeddings in config
abhiwand Jan 4, 2023
1bdee7b
update test implementation
tileintel Jan 4, 2023
da4c5ed
update style
tileintel Jan 4, 2023
cfad024
remove commented out
tileintel Jan 4, 2023
d1effd6
Merge pull request #9 from abhiwand/pr_review3.main.tile
tileintel Jan 4, 2023
27dccd7
Merge pull request #10 from abhiwand/add_bridgetower.pr_review3
tileintel Jan 4, 2023
c63e7c9
fix style
tileintel Jan 4, 2023
ae762c6
Update README with abs for BridgeTower
abhiwand Jan 4, 2023
59e0626
fix style
tileintel Jan 4, 2023
d123e3b
fix mdx file
tileintel Jan 4, 2023
db92600
Merge branch 'main' into add_bridgetower_model
tileintel Jan 4, 2023
c30008e
Update bridgetower.mdx
abhiwand Jan 7, 2023
32822e6
Update img src in bridgetower.mdx
abhiwand Jan 8, 2023
cd686dd
Update README.md
tileintel Jan 9, 2023
f5581b6
Update README.md
tileintel Jan 9, 2023
556cf9a
resolve style failed
tileintel Jan 9, 2023
f86486f
Update _toctree.yml
abhiwand Jan 17, 2023
e78b9a9
Update README_ja.md
abhiwand Jan 17, 2023
dcc5e0f
Removed mlp_ratio, rename feats, rename BTCLIPModel
abhiwand Jan 17, 2023
1c557cf
Replace BTCLIP with BTVisionModel,pass in vision_config to BTVisionModel
abhiwand Jan 17, 2023
b9098fe
Add test_initialization support
shaoyent-IL Jan 17, 2023
50048d2
Add support for output_hidden_states
shaoyent-IL Jan 18, 2023
d6b9e48
Update support for output_hidden_states
shaoyent-IL Jan 18, 2023
254c84d
Add support for output_attentions
shaoyent-IL Jan 18, 2023
26b9131
Add docstring for output_hidden_states
shaoyent-IL Jan 18, 2023
d2ff5ef
update tests
tileintel Jan 18, 2023
964a6d7
Merge pull request #11 from abhiwand/add_bridgetower.pr_review4
tileintel Jan 18, 2023
10e50cd
add bridgetowervisionmodel as private model
tileintel Jan 18, 2023
c61a149
rerun the PR test
tileintel Jan 18, 2023
3749bc6
Remove model_type, pass configs to classes, renames
abhiwand Jan 18, 2023
e1ac7b7
Change self.device to use weight device
shaoyent-IL Jan 18, 2023
65652b8
Remove image_size
shaoyent-IL Jan 18, 2023
eee8268
Style check fixes
abhiwand Jan 18, 2023
dba003e
Merge pull request #12 from abhiwand/add_bridgetower.pr_review5
abhiwand Jan 18, 2023
8fc2c73
Add hidden_size and num_hidden_layers to BridgeTowerTransformer
abhiwand Jan 18, 2023
3576893
Merge pull request #13 from abhiwand/add_bridgetower.pr_review5
abhiwand Jan 18, 2023
8cb834e
Update device setting
abhiwand Jan 20, 2023
e7bed0a
Merge pull request #14 from abhiwand/add_bridgetower.pr_review6
abhiwand Jan 20, 2023
6302e8a
cosmetic update
tileintel Jan 21, 2023
fea5aca
trigger test again
tileintel Jan 21, 2023
dcf4fdb
trigger tests again
tileintel Jan 21, 2023
56f197e
Merge branch 'main' of https://github.com/abhiwand/transformers into …
tileintel Jan 21, 2023
155eecb
Update test_modeling_bridgetower.py
tileintel Jan 21, 2023
e5f1aee
Update test_modeling_bridgetower.py
tileintel Jan 21, 2023
8d4b5b8
Merge branch 'main' of https://github.com/abhiwand/transformers into …
tileintel Jan 21, 2023
71664d0
Merge pull request #15 from abhiwand/tile.resolvegithub
tileintel Jan 21, 2023
0346e28
minor update
tileintel Jan 21, 2023
90b7e05
re-trigger tests
tileintel Jan 23, 2023
d6c328c
Update docs/source/en/model_doc/bridgetower.mdx
abhiwand Jan 23, 2023
bb7cccd
Remove pad, update max_text_len, doc cleanup, pass eps to LayerNorm
abhiwand Jan 23, 2023
1850bd5
Merge pull request #16 from abhiwand/add_bridgetower.pr_review7
abhiwand Jan 23, 2023
67bd533
Added copied to, some more review feedback
abhiwand Jan 24, 2023
1d7e663
make fixup
abhiwand Jan 24, 2023
90c2ec4
Use BridgeTowerVisionEmbeddings
shaoyent-IL Jan 24, 2023
09457d4
Code cleanup
abhiwand Jan 25, 2023
1b12f96
Merge pull request #17 from abhiwand/add_bridgetower.pr_review8
abhiwand Jan 25, 2023
74c09e7
Fixes for BridgeTowerVisionEmbeddings
shaoyent-IL Jan 25, 2023
628a9cd
Merge pull request #18 from abhiwand/add_bridgetower.pr_review8
tileintel Jan 25, 2023
f6b7ecc
style checks
tileintel Jan 25, 2023
81a4e45
Merge pull request #18 from abhiwand/add_bridgetower.pr_review8
tileintel Jan 25, 2023
a530218
re-tests
tileintel Jan 25, 2023
2030a9a
fix embedding
tileintel Jan 25, 2023
34c90ec
address comment on init file
tileintel Jan 25, 2023
a4b91ab
retrigger tests
tileintel Jan 25, 2023
4324b24
Merge pull request #19 from huggingface/main
tileintel Jan 25, 2023
22db8a6
Merge branch 'main' of https://github.com/abhiwand/transformers into …
tileintel Jan 25, 2023
5ca4e77
update import prepare_image_inputs
tileintel Jan 25, 2023
7031f84
Merge pull request #20 from huggingface/main
tileintel Jan 25, 2023
1a234d1
Merge branch 'main' of https://github.com/abhiwand/transformers into …
tileintel Jan 25, 2023
59c3ecb
update test_image_processing_bridgetower.py to reflect test_image_pro…
tileintel Jan 25, 2023
885e456
retrigger tests
tileintel Jan 25, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -289,6 +289,7 @@ Current number of checkpoints: ![](https://img.shields.io/endpoint?url=https://h
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (from Salesforce) released with the paper [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) by Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi.
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (from BigScience workshop) released by the [BigScience Workshop](https://bigscience.huggingface.co/).
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (from Alexa) released with the paper [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499) by Adrian de Wynter and Daniel J. Perry.
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (from Harbin Institute of Technology/Microsoft Research Asia/Intel Labs) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (from Google Research) released with the paper [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626) by Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel.
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (from Inria/Facebook/Sorbonne) released with the paper [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894) by Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot.
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (from Google Research) released with the paper [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874) by Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting.
Expand Down
1 change: 1 addition & 0 deletions README_es.md
Original file line number Diff line number Diff line change
Expand Up @@ -282,6 +282,7 @@ Número actual de puntos de control: ![](https://img.shields.io/endpoint?url=htt
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (from Salesforce) released with the paper [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) by Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi.
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (from BigScience workshop) released by the [BigScience Workshop](https://bigscience.huggingface.co/).
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (from Alexa) released with the paper [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499) by Adrian de Wynter and Daniel J. Perry.
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (from Harbin Institute of Technology/Microsoft Research Asia/Intel Labs) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (from Google Research) released with the paper [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626) by Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel.
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (from Inria/Facebook/Sorbonne) released with the paper [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894) by Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot.
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (from Google Research) released with the paper [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874) by Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting.
Expand Down
1 change: 1 addition & 0 deletions README_hd.md
Original file line number Diff line number Diff line change
Expand Up @@ -254,6 +254,7 @@ conda install -c huggingface transformers
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (from Salesforce) released with the paper [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) by Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi.
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (from BigScience workshop) released by the [BigSicence Workshop](https://bigscience.huggingface.co/).
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (एलेक्सा से) कागज के साथ [बीईआरटी के लिए ऑप्टिमल सबआर्किटेक्चर एक्सट्रैक्शन](https://arxiv.org/abs/ 2010.10499) एड्रियन डी विंटर और डैनियल जे पेरी द्वारा।
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (हरबिन इंस्टिट्यूट ऑफ़ टेक्नोलॉजी/माइक्रोसॉफ्ट रिसर्च एशिया/इंटेल लैब्स से) कागज के साथ [ब्रिजटॉवर: विजन-लैंग्वेज रिप्रेजेंटेशन लर्निंग में एनकोडर्स के बीच ब्रिज बनाना](<https://arxiv.org/abs/2206.08657>) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (Google अनुसंधान से) साथ में कागज [ByT5: पूर्व-प्रशिक्षित बाइट-टू-बाइट मॉडल के साथ एक टोकन-मुक्त भविष्य की ओर] (https://arxiv.org/abs/2105.13626) Linting Xue, Aditya Barua, Noah Constant, रामी अल-रफू, शरण नारंग, मिहिर काले, एडम रॉबर्ट्स, कॉलिन रैफेल द्वारा पोस्ट किया गया।
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (इनरिया/फेसबुक/सोरबोन से) साथ में कागज [CamemBERT: एक टेस्टी फ्रेंच लैंग्वेज मॉडल](https:// arxiv.org/abs/1911.03894) लुई मार्टिन*, बेंजामिन मुलर*, पेड्रो जेवियर ऑर्टिज़ सुआरेज़*, योआन ड्यूपॉन्ट, लॉरेंट रोमरी, एरिक विलेमोन्टे डे ला क्लर्जरी, जैमे सेडाह और बेनोइट सगोट द्वारा।
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (Google रिसर्च से) साथ में दिया गया पेपर [कैनाइन: प्री-ट्रेनिंग ए एफिशिएंट टोकनाइजेशन-फ्री एनकोडर फॉर लैंग्वेज रिप्रेजेंटेशन]( https://arxiv.org/abs/2103.06874) जोनाथन एच क्लार्क, डैन गैरेट, यूलिया टर्क, जॉन विएटिंग द्वारा।
Expand Down
1 change: 1 addition & 0 deletions README_ja.md
Original file line number Diff line number Diff line change
Expand Up @@ -316,6 +316,7 @@ Flax、PyTorch、TensorFlowをcondaでインストールする方法は、それ
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (Salesforce から) Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi から公開された研究論文: [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086)
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (BigScience workshop から) [BigScience Workshop](https://bigscience.huggingface.co/) から公開されました.
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (Alexa から) Adrian de Wynter and Daniel J. Perry から公開された研究論文: [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499)
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (Harbin Institute of Technology/Microsoft Research Asia/Intel Labs から) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (Google Research から) Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel から公開された研究論文: [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626)
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (Inria/Facebook/Sorbonne から) Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot から公開された研究論文: [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894)
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (Google Research から) Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting から公開された研究論文: [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874)
Expand Down
1 change: 1 addition & 0 deletions README_ko.md
Original file line number Diff line number Diff line change
Expand Up @@ -231,6 +231,7 @@ Flax, PyTorch, TensorFlow 설치 페이지에서 이들을 conda로 설치하는
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (from Salesforce) released with the paper [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) by Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi.
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (from BigScience workshop) released by the [BigScience Workshop](https://bigscience.huggingface.co/).
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (Alexa 에서) Adrian de Wynter and Daniel J. Perry 의 [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499) 논문과 함께 발표했습니다.
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (from Harbin Institute of Technology/Microsoft Research Asia/Intel Labs) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (Google Research 에서) Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel 의 [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626) 논문과 함께 발표했습니다.
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (Inria/Facebook/Sorbonne 에서) Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot 의 [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894) 논문과 함께 발표했습니다.
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (Google Research 에서) Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting 의 [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874) 논문과 함께 발표했습니다.
Expand Down
1 change: 1 addition & 0 deletions README_zh-hans.md
Original file line number Diff line number Diff line change
Expand Up @@ -255,6 +255,7 @@ conda install -c huggingface transformers
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (来自 Salesforce) 伴随论文 [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) 由 Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi 发布。
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (from BigScience workshop) released by the [BigScience Workshop](https://bigscience.huggingface.co/).
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (来自 Alexa) 伴随论文 [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499) 由 Adrian de Wynter and Daniel J. Perry 发布。
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (from Harbin Institute of Technology/Microsoft Research Asia/Intel Labs) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (来自 Google Research) 伴随论文 [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626) 由 Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel 发布。
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (来自 Inria/Facebook/Sorbonne) 伴随论文 [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894) 由 Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot 发布。
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (来自 Google Research) 伴随论文 [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874) 由 Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting 发布。
Expand Down
1 change: 1 addition & 0 deletions README_zh-hant.md
Original file line number Diff line number Diff line change
Expand Up @@ -267,6 +267,7 @@ conda install -c huggingface transformers
1. **[BLIP](https://huggingface.co/docs/transformers/main/model_doc/blip)** (from Salesforce) released with the paper [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) by Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi.
1. **[BLOOM](https://huggingface.co/docs/transformers/model_doc/bloom)** (from BigScience workshop) released by the [BigScience Workshop](https://bigscience.huggingface.co/).
1. **[BORT](https://huggingface.co/docs/transformers/model_doc/bort)** (from Alexa) released with the paper [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499) by Adrian de Wynter and Daniel J. Perry.
1. **[BridgeTower](https://huggingface.co/docs/transformers/main/model_doc/bridgetower)** (from Harbin Institute of Technology/Microsoft Research Asia/Intel Labs) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](https://huggingface.co/docs/transformers/model_doc/byt5)** (from Google Research) released with the paper [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626) by Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel.
1. **[CamemBERT](https://huggingface.co/docs/transformers/model_doc/camembert)** (from Inria/Facebook/Sorbonne) released with the paper [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894) by Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot.
1. **[CANINE](https://huggingface.co/docs/transformers/model_doc/canine)** (from Google Research) released with the paper [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874) by Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting.
Expand Down
4 changes: 3 additions & 1 deletion docs/source/en/_toctree.yml
Original file line number Diff line number Diff line change
Expand Up @@ -516,6 +516,8 @@
title: AltCLIP
- local: model_doc/blip
title: BLIP
- local: model_doc/bridgetower
title: BridgeTower
- local: model_doc/chinese_clip
title: Chinese-CLIP
- local: model_doc/clip
Expand Down Expand Up @@ -595,4 +597,4 @@
- local: internal/file_utils
title: General Utilities
title: Internal Helpers
title: API
title: API
2 changes: 2 additions & 0 deletions docs/source/en/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,7 @@ The documentation is organized into five sections:
1. **[BLIP](model_doc/blip)** (from Salesforce) released with the paper [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://arxiv.org/abs/2201.12086) by Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi.
1. **[BLOOM](model_doc/bloom)** (from BigScience workshop) released by the [BigScience Workshop](https://bigscience.huggingface.co/).
1. **[BORT](model_doc/bort)** (from Alexa) released with the paper [Optimal Subarchitecture Extraction For BERT](https://arxiv.org/abs/2010.10499) by Adrian de Wynter and Daniel J. Perry.
1. **[BridgeTower](model_doc/bridgetower)** (from Harbin Institute of Technology/Microsoft Research Asia/Intel Labs) released with the paper [BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning](https://arxiv.org/abs/2206.08657) by Xiao Xu, Chenfei Wu, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan.
1. **[ByT5](model_doc/byt5)** (from Google Research) released with the paper [ByT5: Towards a token-free future with pre-trained byte-to-byte models](https://arxiv.org/abs/2105.13626) by Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel.
1. **[CamemBERT](model_doc/camembert)** (from Inria/Facebook/Sorbonne) released with the paper [CamemBERT: a Tasty French Language Model](https://arxiv.org/abs/1911.03894) by Louis Martin*, Benjamin Muller*, Pedro Javier Ortiz Suárez*, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Djamé Seddah and Benoît Sagot.
1. **[CANINE](model_doc/canine)** (from Google Research) released with the paper [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://arxiv.org/abs/2103.06874) by Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting.
Expand Down Expand Up @@ -250,6 +251,7 @@ Flax), PyTorch, and/or TensorFlow.
| BlenderbotSmall | ✅ | ✅ | ✅ | ✅ | ✅ |
| BLIP | ❌ | ❌ | ✅ | ❌ | ❌ |
| BLOOM | ❌ | ✅ | ✅ | ❌ | ❌ |
| BridgeTower | ❌ | ❌ | ✅ | ❌ | ❌ |
| CamemBERT | ✅ | ✅ | ✅ | ✅ | ❌ |
| CANINE | ✅ | ❌ | ✅ | ❌ | ❌ |
| Chinese-CLIP | ❌ | ❌ | ✅ | ❌ | ❌ |
Expand Down
Loading