Skip to content

docs: download the DAPO jsonl mirror the launcher expects - #2398

Merged
Shi-Dong merged 1 commit into
mainfrom
shi/quickstart-dapo-dataset
Aug 11, 2026
Merged

docs: download the DAPO jsonl mirror the launcher expects#2398
Shi-Dong merged 1 commit into
mainfrom
shi/quickstart-dapo-dataset

Conversation

@Shi-Dong

@Shi-Dong Shi-Dong commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Summary

Fixes the Quick Start dataset download so the recipe actually runs end to end. A user following the page hit this: the DAPO download command fetched a repo whose contents don't match what scripts/run-qwen3-4B.sh consumes.

  • The page told users to download BytedTsinghua-SIA/DAPO-Math-17K, which today contains only data/dapo-math-17k.parquet, with the label nested at reward_model.ground_truth.
  • The launcher expects --prompt-data /root/dapo-math-17k/dapo-math-17k.jsonl with --input-key prompt and a flat --label-key label, so the downloaded repo satisfied neither the path, the format, nor the key layout.
  • zhuzilin/dapo-math-17k ships exactly that file: dapo-math-17k.jsonl whose rows are {"prompt": [chat messages], "label": "..."} (verified by fetching the repo tree and the first rows from the Hub). It is also the mirror every other recipe page already uses — including the AIME-2024 eval set on the same Quick Start page (zhuzilin/aime-2024), which is why AIME worked while DAPO didn't.

Changes:

  • docs/getting-started/quick-start.md: download zhuzilin/dapo-math-17k instead of BytedTsinghua-SIA/DAPO-Math-17K.
  • docs/models/qwen/index.md: point the DAPO-Math-17k link at the same mirror it names the file path of (link-only change).

No launcher changes needed — with the right repo, the existing --prompt-data path and keys line up.

The same audit found one more page with this class of bug (docs/examples/reproducibility.md downloading openai/gsm8k); that fix is in a follow-up PR.

Test plan

  • hf download --repo-type dataset zhuzilin/dapo-math-17k --local-dir /root/dapo-math-17k produces /root/dapo-math-17k/dapo-math-17k.jsonl
  • Verified the jsonl rows carry prompt + flat label, matching the launcher's keys

@Shi-Dong
Shi-Dong merged commit fd73c3a into main Aug 11, 2026
15 of 20 checks passed
@Shi-Dong
Shi-Dong deleted the shi/quickstart-dapo-dataset branch August 11, 2026 23:41
yueming-yuan added a commit that referenced this pull request Aug 12, 2026
docs/getting-started/quick-start.md carried `<<<<<<< HEAD` / `>>>>>>> yueming/script-bugfix`
from an earlier merge on this branch: that resolution pass checked for stale references but
not for the markers themselves. The hunk kept the wrong side of #2398 as well, so the file
now downloads zhuzilin/dapo-math-17k -- the mirror that actually carries the .jsonl the
launcher reads -- into the --data-dir layout.

`git grep '^<<<<<<< ' HEAD` over the whole tree finds nothing else.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants