Skip to content

Commit

Permalink
revise
Browse files Browse the repository at this point in the history
  • Loading branch information
zheyuye committed Aug 20, 2020
1 parent 7a625c4 commit 8fcde49
Showing 1 changed file with 9 additions and 9 deletions.
18 changes: 9 additions & 9 deletions scripts/question_answering/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -141,7 +141,7 @@ Notice that the standard metrics of SQuAD are EM and F1. The former is an exact
|ALBERT base | 90.55/83.83 | 82.09/79.40 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_base_v2_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_base_v2_squad_2.0/finetune_squad2.0.log) |
|ALBERT large | 92.66/86.43 | 84.98/82.19 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_large_v2_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_large_v2_squad_2.0/finetune_squad2.0.log) |
|ALBERT xlarge | 93.85/87.71 | 87.92/85.04 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_xlarge_v2_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_xlarge_v2_squad_2.0/finetune_squad2.0.log) |
|ALBERT xxlarge | 95.00/89.01 | 90.0/86.9 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_xxlarge_v2_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_xxlarge_v2_squad_2.0/finetune_squad2.0.log) |
|ALBERT xxlarge | 95.00/89.01 | 89.91/86.87 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_xxlarge_v2_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_albert_xxlarge_v2_squad_2.0/finetune_squad2.0.log) |

For reference, we've included the results from Google's Original Experiments

Expand All @@ -154,14 +154,14 @@ For reference, we've included the results from Google's Original Experiments

For the reset pretrained models, the results on SQuAD1.1 and SQuAD2.0 are given as follows.

| Model Name | SQuAD1.1 dev | SQuAD2.0 dev |
|--------------------------|---------------|--------------|
|BERT base | 88.40/81.24 | 76.89/74.01 |
|BERT large | 90.45/83.55 | 81.89/78.77 |
|ELECTRA small | 85.42/78.95 | 74.44/71.86 |
|ELECTRA base | 92.63/87.34 | 86.34/83.62 |
|ELECTRA large | 94.95/89.94 | 90.59/88.13 |
|RoBERTa large | 94.58/88.86 | 89.01/85.93 |
| Model Name | SQuAD1.1 dev | SQuAD2.0 dev | Json | Log |
|--------------------------|---------------|--------------|------|-----|
|BERT base | 88.40/81.24 | 76.43/73.59 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_en_uncased_bert_base_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_en_uncased_bert_base_squad_2.0/finetune_squad2.0.log) |
|BERT large | 90.45/83.55 | 81.89/78.77 | json | log |
|ELECTRA small | 85.42/78.95 | 74.44/71.86 | json | log |
|ELECTRA base | 92.63/87.34 | 86.65/83.95 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_electra_base_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_electra_base_squad_2.0/finetune_squad2.0.log) |
|ELECTRA large | 94.95/89.94 | 90.67/88.32 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_electra_large_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_google_electra_large_squad_2.0/finetune_squad2.0.log) |
|RoBERTa large | 94.58/88.86 | 89.69/86.80 |[json](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_fairseq_roberta_large_squad_2.0/best_results.json) | [log](https://gluon-nlp-log.s3.amazonaws.com/squad_training_log/fintune_fairseq_roberta_large_squad_2.0/finetune_squad2.0.log) |

For reference, we have also included the results of original version from Google and Fairseq

Expand Down

0 comments on commit 8fcde49

Please sign in to comment.