This repository showcases the mobileBERT model implemented defined in https://aclanthology.org/2020.acl-main.195.pdf.
video1052930271.mp4
I used this model: https://huggingface.co/docs/transformers/model_doc/mobilebert
For a practical tutorial about BERT (not mobileBERT), I recommend this https://www.youtube.com/watch?v=l8ZYCvgGu0o and this https://colab.research.google.com/drive/1uSlWtJdZmLrI3FCNIlUHFxwAJiSu2J0-#scrollTo=rH8NbBlsfxZ_.