Simplify v1 CLI plumbing - #2427
Conversation
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 9b15b4ff21
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
ApprovabilityVerdict: Not approved Macroscope's review found this PR not approvable — This PR combines a mostly mechanical CLI refactor with changes to persisted debug status, resume rollout selection, and the exported configuration API. Those effects cross durable-run and compatibility boundaries, so the changes merit human review. You can add or adjust custom eligibility rules. Learn more. |
## Summary - Bump the `deps/verifiers` submodule from `d4f3d5a8c` to `807aaf389` (latest `main`). - Pulls in: - [vf#2425](PrimeIntellect-ai/verifiers#2425): forward sampling parameters across dialects. - [vf#2428](PrimeIntellect-ai/verifiers#2428): centralize v1 egress policy decisions. - [vf#2427](PrimeIntellect-ai/verifiers#2427): simplify v1 CLI plumbing. - Bump the `deps/prime-envs` submodule from `b30aad36` to `26dafdc9` (latest `main`). - Pulls in: - [prime-envs#761](PrimeIntellect-ai/prime-envs#761): environment-design rules in AGENTS.md. - [prime-envs#762](PrimeIntellect-ai/prime-envs#762): CI fix for swebench 5 + prime-sandboxes 0.2.37. - [prime-envs#684](PrimeIntellect-ai/prime-envs#684): deshuffle-papers environment. - [prime-envs#675](PrimeIntellect-ai/prime-envs#675): DeepSWE environment. - Relock `uv.lock`: new workspace members `deep-swe` and `deshuffle-papers`; `mcp-atlas` 0.3.0 → 0.3.1, `swesmith-env` 0.1.2 → 0.1.3. 🤖 Generated with [Claude Code](https://claude.com/claude-code) <!-- CURSOR_SUMMARY --> --- > [!NOTE] > **Medium Risk** > Dependency/submodule bump that pulls new training environments and tighter swebench/prime-sandboxes pins; not auth-critical, but can change eval/training behavior. > > **Overview** > Bumps `deps/verifiers` and `deps/prime-envs` to latest `main` and relocks `uv.lock`. > > **verifiers** picks up sampling-parameter forwarding across dialects, centralized v1 egress policy, and simpler v1 CLI plumbing. > > **prime-envs** adds the `deep-swe` and `deshuffle-papers` workspace environments, plus env-design AGENTS.md rules. `mcp-atlas` goes 0.3.0 → 0.3.1 (`prime-sandboxes>=0.2.37`); `swesmith-env` goes 0.1.2 → 0.1.3 (`swebench>=4.1.0,<5`). > > <sup>Reviewed by [Cursor Bugbot](https://cursor.com/bugbot) for commit b5b07f4. Bugbot is set up for automated code reviews on this repo. Configure [here](https://www.cursor.com/dashboard/bugbot).</sup> <!-- /CURSOR_SUMMARY --> Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Overview
This makes the v1 command-line tools smaller and more consistent. It removes code that was doing the same work twice, uses information that is already saved with each run, and fixes debug runs being recorded as failures when their command succeeded.
What changed
Evaluation and resume
Debug and validation
configs/debug.json, matching the other commands.Environment scaffolding and command configuration
--forcebehavior remain unchanged.Dashboards and saved output
configs/<command>.json,traces.jsonl, andrun.dirrather than the old TOML paths or display name.