Skip to content

feat: Add agent skills for NeMo Gym - #1060

Closed
lbliii wants to merge 1 commit into
mainfrom
lbliii/docs-org-strategy
Closed

feat: Add agent skills for NeMo Gym#1060
lbliii wants to merge 1 commit into
mainfrom
lbliii/docs-org-strategy

Conversation

@lbliii

@lbliii lbliii commented Apr 13, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds 7 agent skills following the agentskills.io spec: gym-review, gym-debug, gym-profile, gym-config, gym-data, gym-scaffold-agent, and updates to add-benchmark
  • Each skill includes evals/evals.json with 3 assertion-based evals (21 total) and a chains.yaml for multi-step workflows
  • gym-review is an S-tier reference implementation with a standalone deterministic Python checker (scripts/review.py), self-contained anti-pattern/fix-pattern references, and portable eval fixtures — works without the NeMo Gym repo
  • Skills cover the full contributor workflow: data prep, config composition, server scaffolding, code review, debugging, and reward profiling

Test plan

  • Run python .claude/skills/gym-review/scripts/review.py .claude/skills/gym-review/evals/files/ and verify expected findings per fixture
  • Verify skills load correctly in Claude Code (check / menu shows all 7)
  • Run with-skill vs without-skill evals per agentskills.io eval spec

🤖 Generated with Claude Code

…, config, data, and scaffolding

Seven spec-compliant agent skills with evals, references, and a deterministic
review script. gym-review is the S-tier reference implementation with a
standalone Python checker (scripts/review.py), self-contained anti-pattern
and fix-pattern references, and portable eval fixtures.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@lbliii

lbliii commented Apr 13, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by new PR — original branch couldn't be force-pushed to fix DCO sign-off.

@lbliii lbliii closed this Apr 13, 2026
@lbliii lbliii mentioned this pull request Apr 13, 2026
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant