-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding NeMo Megatron Launcher integration inline in SteerLM documentation #84
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Gerald Shen <[email protected]> Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Zenodia Charpy <[email protected]>
Signed-off-by: Gerald Shen <[email protected]>
For details of HelpSteer dataset, please refer to our paper `HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM <https://arxiv.org/abs/2311.09528>`_. | ||
|
||
For detail on leveraging scalable training and inference via integration with `NeMo-Megatron-Launcher <https://github.com/NVIDIA/NeMo-Megatron-Launcher>`_, please refer to the `user guide <https://docs.nvidia.com/nemo-framework/user-guide/latest/playbooks/pretraining.html#project-instructions-and-milestones>`_. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you give a brief description of what nemo megatron launcher here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
mostly LGTM after resolving 1 more comment. Please make sure to also sign your commits before merge: https://github.com/NVIDIA/NeMo-Aligner/pull/84/checks?check_run_id=21083012106
What does this PR do ?
Adding NeMo Megatron Launcher integration inline in SteerLM documentation.
Add a one line overview of what this PR aims to accomplish.
Changelog
@gshennvm please kindly advise if i should be updating changelog or if you would like to do this ?
Usage
Before your PR is "Ready for review"
Pre checks:
Checklist when contributing a new algorithm
max_steps=-1
andvalidation
?Additional Information