Skip to content

chore: bump verifiers to 4fd5921 and prime-envs to d4fb80a - #3762

Merged
hallerite merged 1 commit into
mainfrom
chore/bump-verifiers-agent-user
Oct 2, 2026
Merged

hallerite merged 1 commit into
mainfrom
chore/bump-verifiers-agent-user

Conversation

@hallerite

@hallerite hallerite commented Oct 2, 2026 •

Copy link
Copy Markdown
Member

Summary

Validation

Run from this branch's stack (verifiers 4fd5921, prime-sandboxes 0.4.1):

  • pi-programbench: loading with its defaults resolves pi-programbench@2026-10-02 with agent_user == "agent". Before the prime-envs bump, two uv run eval pi-programbench rollouts on Prime (bash harness, GLM-5.3) ran as agent: they saw the reference as ---x--x--x root, and the separate verifier graded both with no errors.
  • programbench-synth 1.1.0 (PrimeIntellect-ai/prime-tasks-private#369, also [agent] user = "agent"), three rollouts on Prime:
    • the root healthcheck ran;
    • the agent ran as agent;
    • two episodes were graded in the separate offline verifier, and the third was still running.

🤖 Generated with Claude Code


Note

Medium Risk
Lockfile-only, but it pins sandbox and verifier runtime versions and new SWE env packages that affect how rollouts execute in containers.

Overview
Refreshes uv.lock after bumping verifiers and prime-envs, wiring in new SWE evaluation packages swe-sweep and pi-swe-sweep and bumping several editable envs (pi-programbench 0.1.2, pi-officeqa-pro-v2 0.1.4 with huggingface-hub dropped from that package’s lock metadata).

The lock also moves prime-sandboxes 0.3.2 → 0.4.1 (reflected in verifiers’ minimum sandbox version) and records verifiers’ new optional e2b extra. Together this tracks upstream Harbor/agent-user and sandbox API changes described in the linked verifiers and prime-envs PRs.

Reviewed by Cursor Bugbot for commit 3f59069. Bugbot is set up for automated code reviews on this repo. Configure here.

@hallerite
hallerite marked this pull request as ready for review October 2, 2026 23:27
@hallerite
hallerite force-pushed the chore/bump-verifiers-agent-user branch from 1652db0 to 0866323 Compare October 2, 2026 23:27
verifiers 185b67d -> 4fd5921:
- PrimeIntellect-ai/verifiers#2748: run the agent as a task-declared user (Harbor's
  [agent] user), e.g. ProgramBench's unprivileged agent next to an execute-only
  reference. Needs prime-sandboxes 0.4.1.
- PrimeIntellect-ai/verifiers#2744: nano-rlm default bumped to c38e20b; ACP semantic
  edges accept loops.
- PrimeIntellect-ai/verifiers#2736: preserve inline reasoning under network restrictions.
- PrimeIntellect-ai/verifiers#2294: E2B runtime provider.

prime-envs e82de8b -> d4fb80a:
- pi-programbench 0.1.2 (PrimeIntellect-ai/prime-envs#960): pi-programbench@2026-10-02,
  the solver runs as the images' agent user; 0.1.1 (PrimeIntellect-ai/prime-envs#879)
  ends the rollout on the submit command.
- swe-sweep and pi-swe-sweep (PrimeIntellect-ai/prime-envs#873, PrimeIntellect-ai/prime-envs#878); OfficeQA
  updates (PrimeIntellect-ai/prime-envs#958,
  PrimeIntellect-ai/prime-envs#959).

uv.lock: prime-sandboxes 0.3.2 -> 0.4.1, pi-programbench 0.1.2, the new envs.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@hallerite
hallerite force-pushed the chore/bump-verifiers-agent-user branch from 0866323 to 3f59069 Compare October 2, 2026 23:27
@hallerite
hallerite merged commit 46e5082 into main Oct 2, 2026
18 of 20 checks passed
@hallerite
hallerite deleted the chore/bump-verifiers-agent-user branch October 2, 2026 23:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants