diff --git a/.claude/skills/add-benchmark/SKILL.md b/.claude/skills/add-benchmark/SKILL.md index d2b0cb65e4..e58fd910dc 100644 --- a/.claude/skills/add-benchmark/SKILL.md +++ b/.claude/skills/add-benchmark/SKILL.md @@ -72,7 +72,7 @@ Convert your source dataset to Gym JSONL format. Each line must have `responses_ **Data conversion**: Write conversion scripts in the **source repo** (e.g. your dataset repository), not in NeMo-Gym. Prompt files also belong in the source repo. Exception: when there is no external source repo. See `references/patterns.md` § "Data Conversion Script Pattern". -**`example.jsonl`**: Generate 5 entries for smoke testing, committed directly to git in `data/example.jsonl`. Each row must be in materialized Responses format (contain `responses_create_params`) — example datasets are not templated via `prompt_config`, so raw rows won't validate. +**`example.jsonl`**: Generate five entries for smoke testing, committed directly to git in `data/example.jsonl`. Each row must already be in Responses API format (contain `responses_create_params`), because example datasets are not templated through `prompt_config`, so raw rows will not validate. This file is distinct from the `*_materialized_inputs.jsonl` files generated during rollout collection. **`train`/`validation` datasets**: Upload to the GitLab dataset registry — these must NOT be committed to git. diff --git a/fern/versions/latest/pages/data/prepare-validate.mdx b/fern/versions/latest/pages/data/prepare-validate.mdx index 528f1b4299..3e869bf19f 100644 --- a/fern/versions/latest/pages/data/prepare-validate.mdx +++ b/fern/versions/latest/pages/data/prepare-validate.mdx @@ -244,7 +244,7 @@ ng_prepare_data "+config_paths=[resources_servers/example_multi_step/configs/exa -`example.jsonl` must already be in materialized Responses format (each row containing `responses_create_params`). Example-type datasets are not templated via `prompt_config`, so raw rows won't validate. +`example.jsonl` must already be in Responses API format (each row containing `responses_create_params`), because example datasets are not templated through `prompt_config`. Raw, untemplated rows will not validate. This file is distinct from the `*_materialized_inputs.jsonl` files generated during rollout collection. ### Training Preparation @@ -388,7 +388,7 @@ datasets: ### License values -`license` is required for `train` and `validation` datasets. It is validated against an allowed set defined in code — see the `license` enum in [`nemo_gym/config_types.py`](https://github.com/NVIDIA-NeMo/Gym/blob/main/nemo_gym/config_types.py). +`license` is required for `train` and `validation` datasets. It is validated against an allowed set defined in code — refer to the `license` enum in [`nemo_gym/config_types.py`](https://github.com/NVIDIA-NeMo/Gym/blob/main/nemo_gym/config_types.py). ---