Skip to content

Reproducing Llama Nemotron Results with NeMo-Skills #676

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
shtoshni merged 21 commits into from
Aug 15, 2025
Merged

Reproducing Llama Nemotron Results with NeMo-Skills #676

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
f415012
Docs for Llama Nemotron
Aug 11, 2025
0d1f686
Reasoning results added
shtoshni Aug 15, 2025
f02be78
Adding long context benchmark MRCR (#634)
fayejf Aug 11, 2025
4de54b1
Fix a small bug in generation with chunks (#661)
fchen97 Aug 12, 2025
3b7aa33
Small fix for mrcr prepare.py (#662)
fayejf Aug 12, 2025
1361309
Fix base checkpoints in the docs
Kipok Aug 12, 2025
c12e802
Fix formatting
Kipok Aug 12, 2025
275f196
Fix type mismatch for max code executions (#665)
Kipok Aug 13, 2025
69049ba
Allow generation type or custom module in `eval` pipeline (#666)
activatedgeek Aug 13, 2025
64526b7
update grpo with megatron backend (#653)
wedu-nvidia Aug 13, 2025
7f373d8
bugfix: missing generation module arg in eval pipeline cmd script (#668)
activatedgeek Aug 13, 2025
4637602
add support for nsys profile (#667)
wedu-nvidia Aug 14, 2025
017d945
Fixing BFCL (#669)
shtoshni Aug 14, 2025
2cf6a2f
Minor fixes to dataset defaults (#672)
shtoshni Aug 14, 2025
de2c9a4
Enable system_message for openai prompt format (#670)
Kipok Aug 14, 2025
822dddd
Reasoning off results
shtoshni Aug 15, 2025
ac7d4e1
Precommit hook
Aug 15, 2025
6af8bcc
Merge branch 'main' into shtoshni/llama_nemotron_docs
shtoshni Aug 15, 2025
5872794
Update docs/tutorials/posts/llama-nemotron-super-v1.5-evals.md
shtoshni Aug 15, 2025
2d491a6
Resolving comments
shtoshni Aug 15, 2025
f3b862b
Added news
shtoshni Aug 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ Here are some of the features we support:
- [Model training](https://nvidia.github.io/NeMo-Skills/pipelines/training): Train models using [NeMo-Aligner](https://github.com/NVIDIA/NeMo-Aligner/), [NeMo-RL](https://github.com/NVIDIA/NeMo-RL/) or [verl](https://github.com/volcengine/verl).

## News

* [08/15/2025]: Added details for [reproducing evals](docs/tutorials/posts/llama-nemotron-super-v1.5-evals.md) for the [Llama-3_3-Nemotron-Super-49B-v1_5](nvidia/Llama-3_3-Nemotron-Super-49B-v1_5) model by NVIDIA.
* [07/30/2025]: The datasets used to train OpenReasoning models are released! Math and code are available as part of [Nemotron-Post-Training-Dataset-v1](https://huggingface.co/datasets/nvidia/Nemotron-Post-Training-Dataset-v1) and science is available in
[OpenScienceReasoning-2](https://huggingface.co/datasets/nvidia/OpenScienceReasoning-2).
See our [documentation](https://nvidia.github.io/NeMo-Skills/releases/openreasoning/training) for more details.
Expand Down
Loading