Support for Camembert Huggingface bert-like models

[itzsimpl]

Signed-off-by: Iztok Lebar Bajec [email protected]

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Collection: nlp

Changelog

• Support for loading Huggingface Camembert models, e.g. https://huggingface.co/camembert-base

Usage

• You can potentially add a usage example below
  In /examples/nlp/token_classification/conf/punctuation_capitalization_config.yaml set

pretrained_model_name: camembert-base

Before your PR is "Ready for review"

Pre checks:

• Make sure you read and followed Contributor guidelines
• Did you write any new necessary tests?
• Did you add or update any necessary documentation?
• Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

• New Feature
• Bugfix
• Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

• Related to # (issue)

[ekmb]

Thanks for your contribution!
Please run cd NeMo/ && python setup.py style --fix to fix style errors.

[itzsimpl]

As for running cd NeMo/ && python setup.py style --fix the command requires isort (not in NeMo requirements.txt and not customarily installed, so a heads up would be welcome). After installing it, it still fails with the following:

$ python setup.py style --fix
running style
Running command: isort --multi-line=3 --trailing-comma --force-grid-wrap=0 --use-parentheses --line-width=119 -rc -ws .
ERROR: Found nemo_text_processing.text_normalization.normalize import while parsing, but FIRSTPARTY was not included in the `sections` setting of your config. Please add it before continuing
See https://pycqa.github.io/isort/#custom-sections-and-ordering for more info.
Running command: black --skip-string-normalization --line-length=119 .
error: [Errno 2] No such file or directory: 'black'

Since none of these were modified by this PR I left everything as is.

[ekmb]

Right, the CI is failing due to the style issues of the newly added files. Have you installed NeMo by running ./reinstall.sh?
black/isort is a part of https://github.com/NVIDIA/NeMo/blob/main/requirements/requirements_test.txt

[itzsimpl]

Ok, thnx, I was using pip install -e ., had to run ./reinstall.sh inside a container and then in it python setup.py style --fix.

[ekmb]

@itzsimpl, thanks for your PR!