-
Notifications
You must be signed in to change notification settings - Fork 310
Closed
Labels
stat:contributions welcomeAdd this label to feature request issues so they are separated out from bug reporting issuesAdd this label to feature request issues so they are separated out from bug reporting issuestype:featureNew feature or requestNew feature or request
Description
In #653 we added a masked language modeling task for RoBERTa. We can make a similar change for the Albert model.
- Update
AlbertTokenizerto expect a mask token. - Add a
AlbertMaskedLMPreprocessorpreprocessor layer and tests. - Add a
AlbertMaskedLMtask model and tests. - Update
keras_nlp/models/__init__.pyto exportAlbertMaskedLMandAlbertMaskedLMPreprocessor.
Metadata
Metadata
Assignees
Labels
stat:contributions welcomeAdd this label to feature request issues so they are separated out from bug reporting issuesAdd this label to feature request issues so they are separated out from bug reporting issuestype:featureNew feature or requestNew feature or request