synchronize with main HF by tileintel · Pull Request #24 · abhiwand/transformers

tileintel · 2023-03-13T12:23:24Z

What does this PR do?

Fixes # (issue)

Before submitting

This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
Did you read the contributor guideline,
Pull Request section?
Was this discussed/approved via a Github issue or the forum? Please add a link
to it if that's the case.
Did you make sure to update the documentation with your changes? Here are the
documentation guidelines, and
here are tips on formatting docstrings.
Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

* slow me --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

…22034) fix slow tokenizers with passing offset_mapping

* Fix typos and add code examples, resources

* [21737][T5]: Fix gradient checkpoint bug * [21737][T5]: Fix gradient checkpoint bug * [21737][T5]: Fix gradient checkpoint bug * Update src/transformers/models/mt5/modeling_mt5.py * Update src/transformers/models/t5/modeling_t5.py --------- Co-authored-by: njindal <njindal@adobe.com> Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

…x it (#22045) In ZSH, not using ' ' around pip install fails Running ``` pip install transformers[torch] ``` in the default ZSH terminal will fail with the error `zsh: no matches found: transformers[torch]` The solution is to wrap the installation path in ' ' like ``` pip install 'transformers[torch]' ``` Relevant StackOverflow: https://stackoverflow.com/questions/30539798/zsh-no-matches-found-requestssecurity

* Remove set_access_token usage + fail tests if FutureWarning * do not fail on FutureWarning in CI --------- Co-authored-by: testbot <lucainp@hf.co>

* show hfh warnings --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* return analysis for hyperparameter_search with ray backend * Revert "return analysis for hyperparameter_search with ray backend" This reverts commit cd51790. * add run_summary attribute to BestRun and return analysis for ray backend * fix typo * add doc for run_summary for ray backend

* Add an argument to pt-to-tf to allow overriding the model class * make fixup * Minor fix to error message * Remove unused extra conversion from the script

rm $ symbol from code block Removed the $ symbol from the code block to make copy-pasting easier.

* [deepspeed] offload + non-cpuadam optimizer exception * flip * revert min version

* Edit the docstring of `image_processing_donut` to match code * improve style * more style improvement after installing quality

* skip 3 tests --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Add setters by type of args to TrainingArguments * Define more setters

Update the script Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

…22007) Co-authored-by: EC2 Default User <ec2-user@ip-172-31-42-72.us-west-2.compute.internal>

* Add a progress bar for the total download of shards * Check for no cache at all * Fix check

* Fix gradient checkpointing bug in Speech2Text * Update modeling_speech_to_text.py * Update modeling_speech_to_text_2.py

* Make sure position ids are masked * test that padded input produce the same results * fix failing tests * fixup * fix batch test

* Update flan-ul2.mdx * Update flan-ul2.mdx

fix broken links

* Fix gradient checkpointing bug in Speecht5 * Update modeling_speech_to_text.py * Update src/transformers/models/speech_to_text/modeling_speech_to_text.py * Fix change errors --------- Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

fix hint

* re: #21989 * update re: #21989 * removed cpu option * make style

* Fix imports of TF MobileViT * Fix copies

Revert "[GPT2] Propose fix for #21080 (#21853)" to avoid CI failure This reverts commit a3fef89.

* [Whisper] Remove embed_tokens from encoder docstring * new line to retrigger CI * remove new line

Adds AutoModelForZeroShotImageClassification to transformers

* add new model of MGP-STR * fix the check failings * remove torch and numpy from mgp_tokenization * remove unused import from modeling_mgp_str * add test_processing_mgp_str * rm test_processing_mgp_str.py * add test_processing_mgp_str * add test_processing_mgp_str * add test_processing_mgp_str * rm test_processing_mgp_str and add softmax outs to model * rm test_processing_mgp_str and add softmax outs to model * rewrite the code of mgp-str according to PR suggestions * rewrite the code of mgp-str according to PR suggestions * add new model of MGP-STR * fix the check failings * remove torch and numpy from mgp_tokenization * remove unused import from modeling_mgp_str * add test_processing_mgp_str * rm test_processing_mgp_str.py * add test_processing_mgp_str * add test_processing_mgp_str * add test_processing_mgp_str * rm test_processing_mgp_str and add softmax outs to model * rewrite the code of mgp-str according to PR suggestions * rewrite the code of mgp-str according to PR suggestions * remove representation_size from MGPSTRConfig * reformat configuration_mgp_str.py * format test_processor_mgp_str.py * add test for tokenizer and complete model/processer test and model file * rm Unnecessary tupple in modeling_mgp_str * reduce hidden_size/layers/label_size in test_model * add integration tests and change MGPSTR to Mgpstr * add test for logit values * reformat test model file --------- Co-authored-by: yue kun <yuekun.wp@alibaba-inc.com>

HuggingFaceDocBuilderDev · 2023-03-13T12:37:48Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

ydshieh and others added 30 commits March 8, 2023 21:48

Mark all BridgeTower tests slow for now (#22039)

1cbac68

* slow me --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

Bug fix: token classification pipeline while passing offset_mapping (#…

3ec8171

…22034) fix slow tokenizers with passing offset_mapping

Update ALIGN docs (#22025)

2055d73

* Fix typos and add code examples, resources

Can't install tf2 on M1 Chip by default (#22046)

6847743

Remove set_access_token usage + fail tests if FutureWarning (#22051)

923110b

* Remove set_access_token usage + fail tests if FutureWarning * do not fail on FutureWarning in CI --------- Co-authored-by: testbot <lucainp@hf.co>

Show the number of huggingface_hub warnings in CI report (#22054)

90a7c95

* show hfh warnings --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

pt-to-tf model architecture override (#22055)

fdf8409

* Add an argument to pt-to-tf to allow overriding the model class * make fixup * Minor fix to error message * Remove unused extra conversion from the script

rm $ symbol from code block from contributing.md (#22057)

d0c19b3

rm $ symbol from code block Removed the $ symbol from the code block to make copy-pasting easier.

[deepspeed] offload + non-cpuadam optimizer exception (#22043)

ec24132

* [deepspeed] offload + non-cpuadam optimizer exception * flip * revert min version

Edit the docstring of image_processing_donut to match code (#22033)

8434cb8

* Edit the docstring of `image_processing_donut` to match code * improve style * more style improvement after installing quality

Skip 3 tests for WhisperEncoderModelTest (#22060)

ab81d31

* skip 3 tests --------- Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

Add setters by type of args to TrainingArguments (#21570)

7a2b915

* Add setters by type of args to TrainingArguments * Define more setters

Update tiny model creation script (#22058)

6d9031f

Update the script Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

Fix case when using --gradient_accumulation_steps with DDP disabled. (#…

1a5fc30

…22007) Co-authored-by: EC2 Default User <ec2-user@ip-172-31-42-72.us-west-2.compute.internal>

Add a progress bar for the total download of shards (#22062)

a9bd5df

* Add a progress bar for the total download of shards * Check for no cache at all * Fix check

Fix gradient checkpointing bug in Speech2Text (#22079)

b927335

* Fix gradient checkpointing bug in Speech2Text * Update modeling_speech_to_text.py * Update modeling_speech_to_text_2.py

Fix gradient checkpointing bug in switch transformer (#22081)

eee195b

[GPT2] Propose fix for #21080 (#21853)

a3fef89

* Make sure position ids are masked * test that padded input produce the same results * fix failing tests * fixup * fix batch test

Fix small typo in flan-ul2.mdx (#22068)

ade26bf

* Update flan-ul2.mdx * Update flan-ul2.mdx

Generate - Fix broken documentation links (#22078)

7014fc3

fix broken links

Fix hint in src/transformers/modeling_utils.py (#22074)

a70da86

fix hint

handle numpy inputs in whole word mask data collator (#22032)

2f4cdd9

GPT-J specific half precision on CPU note (#22086)

bdec276

* re: #21989 * update re: #21989 * removed cpu option * make style

Fix imports of TF MobileViT (#22065)

499770c

* Fix imports of TF MobileViT * Fix copies

Revert "[GPT2] Propose fix for #21080" (#22093)

2f32066

Revert "[GPT2] Propose fix for #21080 (#21853)" to avoid CI failure This reverts commit a3fef89.

[Whisper] Remove embed_tokens from encoder docstring (#21996)

b90fbc7

* [Whisper] Remove embed_tokens from encoder docstring * new line to retrigger CI * remove new line

alaradirik and others added 2 commits March 13, 2023 12:46

Add AutoModelForZeroShotImageClassification (#22087)

32e3466

Adds AutoModelForZeroShotImageClassification to transformers

tileintel merged commit dbba2d7 into abhiwand:main Mar 13, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

synchronize with main HF#24

synchronize with main HF#24
tileintel merged 32 commits into
abhiwand:mainfrom
huggingface:main

tileintel commented Mar 13, 2023

Uh oh!

HuggingFaceDocBuilderDev commented Mar 13, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

tileintel commented Mar 13, 2023

What does this PR do?

Before submitting

Who can review?

Uh oh!

HuggingFaceDocBuilderDev commented Mar 13, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants