Skip to content

v0.1.0

Latest
Compare
Choose a tag to compare
@julia-tagbot julia-tagbot released this 21 May 21:11
v0.1.0
  • First version of BERT.jl
  • Pretraining module and finetuning module for sequence classification
  • BertAdam, which is basically a version of Adam that uses weight decay
  • Tokenization is implemented
  • Ability to load weights from pytorch models
  • Provided examples