[WIP] Ner pipeline grouped_entities fixes#5970

Merged

LysandreJik merged 23 commits intohuggingface:masterfrom

cceyda:ner_pipeline_group_fix

Nov 3, 2020

Commits on Jul 22, 2020

Bug fix: NER pipeline shouldn't group separate entities of same type
Ceyda Cinarel
committed
style fix
Ceyda Cinarel
committed
[Bug Fix] Shouldn't group entities that are both 'B' even if they are same type
Ceyda Cinarel
committed

Commits on Sep 14, 2020

use offset_mapping to fix [UNK] token problem
Ceyda Cinarel
committed
ignore score for subwords
Ceyda Cinarel
committed

Commits on Sep 16, 2020

Merge remote-tracking branch 'upstream/master' into ner_pipeline_group_fix
Ceyda Cinarel
committed
modify ner_pipeline test
Ceyda Cinarel
committed
modify ner_pipeline test
Ceyda Cinarel
committed
modify ner_pipeline test
Ceyda Cinarel
committed
ner_pipeline change ignore_subwords default to true
Ceyda Cinarel
committed
add ner_pipeline ignore_subword=False test case
Ceyda Cinarel
committed

Commits on Sep 21, 2020

fix offset_mapping index
Ceyda Cinarel
committed
fix style again duh
Ceyda Cinarel
committed

Commits on Oct 14, 2020

Merge remote-tracking branch 'upstream/master' into ner_pipeline_group_fix
Ceyda Cinarel
committed

Commits on Oct 26, 2020

change is_subword and convert_tokens_to_string logic
Ceyda Cinarel
committed
merge new tests
Ceyda Cinarel
committed
merge tests with new test structure
Ceyda Cinarel
committed
change test names
Ceyda Cinarel
committed
remove old tests
Ceyda Cinarel
committed
ner tests for fast tokenizer
Ceyda Cinarel
committed
fast tokenizers have convert_tokens_to_string
Ceyda Cinarel
committed

Commits on Nov 3, 2020