Backport #862

[leezu]

See #862

[codecov]

Codecov Report

❗ No coverage uploaded for pull request head (7xfixvocabunktoken@513e920). Click here to learn what that means.
The diff coverage is n/a.

[codecov]

Codecov Report

Merging #863 into v0.7.x will decrease coverage by 0.67%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           v0.7.x     #863      +/-   ##
==========================================
- Coverage   90.43%   89.76%   -0.68%     
==========================================
  Files          66       66              
  Lines        6348     6350       +2     
==========================================
- Hits         5741     5700      -41     
- Misses        607      650      +43

Impacted Files	Coverage Δ
src/gluonnlp/vocab/vocab.py	97.32% <100%> (+0.02%)	⬆️
src/gluonnlp/model/parameter.py	92% <0%> (-8%)	⬇️
src/gluonnlp/data/registry.py	78.12% <0%> (-6.25%)	⬇️
src/gluonnlp/vocab/subwords.py	81.13% <0%> (-5.67%)	⬇️
src/gluonnlp/data/corpora/wikitext.py	94.82% <0%> (-5.18%)	⬇️
src/gluonnlp/optimizer/bert_adam.py	86.27% <0%> (-3.93%)	⬇️
src/gluonnlp/data/batchify/batchify.py	92.85% <0%> (-3.58%)	⬇️
src/gluonnlp/data/utils.py	70.74% <0%> (-3.41%)	⬇️
src/gluonnlp/data/transforms.py	77.13% <0%> (-3.38%)	⬇️
src/gluonnlp/data/dataset.py	97.61% <0%> (-1.59%)	⬇️
... and 3 more

[szha]

This needs more fixing

[mli]

Found link check problems in job PR-863/7:
(line 19) broken https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/ - 404 Client Error: Not Found for url: https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/
(line 5) broken https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/ - 404 Client Error: Not Found for url: https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/
(line 5) broken https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/ - 404 Client Error: Not Found for url: https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/
(line 21) broken https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/ - 404 Client Error: Not Found for url: https://www.salesforce.com/products/einstein/ai-research/the-wikitext-dependency-language-modeling-dataset/
(line 442) broken https://www.aclweb.org/anthology/P02-1040.pdf)[1 - 404 Client Error: Not Found for url: https://www.aclweb.org/anthology/P02-1040.pdf)%5B1
(line 92) broken https://nlp.stanford.edu/pubs/glove.pdf)[2 - 404 Client Error: NOT FOUND for url: https://nlp.stanford.edu/pubs/glove.pdf)%5B2
(line 208) broken https://www.bioinf.jku.at/publications/older/2604.pdf)[3 - 404 Client Error: Not Found for url: https://www.bioinf.jku.at/publications/older/2604.pdf)%5B3

[mli]

Job PR-863/7 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-863/7/index.html