Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for finetune guard classifier #325

Closed

Conversation

VibhuJawa
Copy link
Collaborator

@VibhuJawa VibhuJawa commented Oct 25, 2024

This PR adds support for FineTuneGuard Model

@VibhuJawa VibhuJawa changed the title Add support for fine-tune classifier Add support for finetune guard classifier Oct 29, 2024
@VibhuJawa VibhuJawa marked this pull request as ready for review November 14, 2024 10:23
Copy link
Collaborator

@sarahyurick sarahyurick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a few typo fixes but looks good so far!

When you get a chance can you add it to the examples/ and nemo_curator/scripts/ folders? And to the documentation? You should be able to reference #361 which has all the files that should be created/updated.

nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
@VibhuJawa
Copy link
Collaborator Author

When you get a chance can you add it to the examples/ and nemo_curator/scripts/ folders? And to the documentation? You should be able to reference #361 which has all the files that should be created/updated.

We can do that as a followup, as that is documentation related. Lets get this in first.

nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
nemo_curator/classifiers/aegis.py Outdated Show resolved Hide resolved
sarahyurick added a commit to sarahyurick/NeMo-Curator that referenced this pull request Nov 27, 2024
Signed-off-by: Sarah Yurick <[email protected]>
@sarahyurick
Copy link
Collaborator

Some of these commits are not signed, so re-opening it as #397.

sarahyurick added a commit that referenced this pull request Nov 27, 2024
* add changes from #325

Signed-off-by: Sarah Yurick <[email protected]>

* edit state_dict read

Signed-off-by: Sarah Yurick <[email protected]>

---------

Signed-off-by: Sarah Yurick <[email protected]>
ruchaa-apte pushed a commit to ruchaa-apte/NeMo-Curator that referenced this pull request Dec 13, 2024
* add changes from NVIDIA#325

Signed-off-by: Sarah Yurick <[email protected]>

* edit state_dict read

Signed-off-by: Sarah Yurick <[email protected]>

---------

Signed-off-by: Sarah Yurick <[email protected]>
Signed-off-by: Rucha Apte <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants