feat(v1): configurable agentic-judge grading policy, uploads, and reward weights - #2109

Merged

mikasenghaas merged 19 commits into

mainfrom

feat/agentic-judge-ootb

Jul 23, 2026

Commits on Jul 22, 2026

feat(v1): configurable agentic-judge grading policy, uploads, and reward weights

mikasenghaas
and
claude
committed
e785d9c

Commits on Jul 23, 2026

review: JudgeTaskConfig/ScoreConfig nesting, single prompt field, trace-centric naming

mikasenghaas
and
claude
committed
a0e106e
feat(v1): shared-runtime agentic judge (on by default)

mikasenghaas
and
claude
committed
6b5857d
feat(v1): rubric-graded agentic judge; trace record is the only upload

mikasenghaas
and
claude
committed
10ed266
feat(v1): seat replay — pin any env agent to a finished run's traces

mikasenghaas
and
claude
committed
29c7333
Revert "feat(v1): seat replay — pin any env agent to a finished run's traces"
mikasenghaas
committed
9a330c7
Merge origin/main (runtime moved onto the agent, #2106)

mikasenghaas
and
claude
committed
f73ae6c
review: shared box only, full trace uploaded, terse module docstring

mikasenghaas
and
claude
committed
48c44c6
chore: strip comments from the agentic-judge example config

mikasenghaas
and
claude
committed
7e3b7a2
review: hardcode the trace upload path, grade_prompt -> build_prompt, drop finalize docstring

mikasenghaas
and
claude
committed
a0d1101
review: JudgeTask.files is public

mikasenghaas
and
claude
committed
0f42abf
review: JudgeTask.from_trace takes the JudgeTaskConfig, not the env config

mikasenghaas
and
claude
committed
717c055
style: format

mikasenghaas
and
claude
committed
bf32c19
review: from_trace needs only the trace — the solved task rides on it

mikasenghaas
and
claude
committed
ed4160e
docs: module docstring matches the fixed trace path

mikasenghaas
and
claude
committed
6b5ebe3
fix: remove pre-existing files at upload paths before seeding the judge box

mikasenghaas
and
claude
committed
dfc23b2
fix: duplicate criterion entries in the verdict fail instead of last-write-wins

mikasenghaas
and
claude
committed
ca25ca9
fix: align the judge's runtime config with the solver's

mikasenghaas
and
claude
committed
63132a8
feat: hint section for the judge prompt; workspace note warns the record can be huge

mikasenghaas
and
claude
committed
68e2a63

Navigation Menu

Uh oh!

feat(v1): configurable agentic-judge grading policy, uploads, and reward weights - #2109

feat(v1): configurable agentic-judge grading policy, uploads, and reward weights#2109
mikasenghaas merged 19 commits into
mainfrom
feat/agentic-judge-ootb

Commits on Jul 22, 2026

feat(v1): configurable agentic-judge grading policy, uploads, and reward weights

Commits on Jul 23, 2026

review: JudgeTaskConfig/ScoreConfig nesting, single prompt field, trace-centric naming

feat(v1): shared-runtime agentic judge (on by default)

feat(v1): rubric-graded agentic judge; trace record is the only upload

feat(v1): seat replay — pin any env agent to a finished run's traces

Revert "feat(v1): seat replay — pin any env agent to a finished run's traces"

Merge origin/main (runtime moved onto the agent, #2106)

review: shared box only, full trace uploaded, terse module docstring

chore: strip comments from the agentic-judge example config

review: hardcode the trace upload path, grade_prompt -> build_prompt, drop finalize docstring

review: JudgeTask.files is public

review: JudgeTask.from_trace takes the JudgeTaskConfig, not the env config

style: format

review: from_trace needs only the trace — the solved task rides on it

docs: module docstring matches the fixed trace path

fix: remove pre-existing files at upload paths before seeding the judge box

fix: duplicate criterion entries in the verdict fail instead of last-write-wins

fix: align the judge's runtime config with the solver's

feat: hint section for the judge prompt; workspace note warns the record can be huge