Repository navigation

Minor tweaks to evals - #1266

Merged

aantn merged 25 commits into

masterfrom

claude/fix-eval-regression-marker-XeZ7i

Dec 29, 2025

Commits on Dec 29, 2025
- Fix eval regression marker default for manual triggers
  claude
  committed
  8774a0b
- Add test preview and warning for manual eval triggers
  claude
  committed
  ac63a82
- Add notification comment for manual eval triggers
  claude
  committed
  12db5cb
- Rename Test preview to Evals to run and remove limit
  claude
  committed
  7b43d8a
- Fix duplicate comment issue and remove placeholder text
  claude
  committed
  682a686
- Split markers and eval names into separate details sections
  claude
  committed
  044ec35
- Fix grep -c exit code issue in test collection
  claude
  committed
  0d133f5
- Add trigger context for automatic eval runs
  claude
  committed
  b41b283
- Add progress checklist to eval workflow
  claude
  committed
  2e9f10d
- Fix empty MODEL causing 0 tests to be collected
  claude
  committed
  8bcefd7
- Dynamically collect markers and eval names instead of hardcoding
  claude
  committed
  9ea1501
- Unify comment generation with shared helper functions
  claude
  committed
  efee49a
- Extract eval comment helpers to shared JS file
  claude
  committed
  1536571
- Fix trigger source text and remove eyes reaction on completion
  claude
  committed
  7bc70b3
- Unify comment generation with shared helper functions
  claude
  committed
  ecfe41e
- DRY: Use base_params JSON to reduce repetition in workflow steps
  claude
  committed
  452b283
- Auto-detect PR from branch in workflow_dispatch
  claude
  committed
  9b8a501
- Improve eval results comment formatting
  claude
  committed
  959f740
- Add Legend section with test status emoji explanations
  claude
  committed
  c5d2ba6
- Show footer (legend, re-run, markers, evals) on both manual and automatic runs
  claude
  committed
  15270ab
- Merge master and resolve conflicts
  claude
  committed
  8d85979
- Show footer (legend, re-run, markers, evals) on all progress updates
  claude
  committed
  ce87e8e
- Improve loading message for markers/evals in footer
  claude
  committed
  865f0ce
- Remove duplicate legend from Python reporter
  claude
  committed
  c49f969
- Change loading message to "Collecting from ..."
  claude
  committed
  dc8628e

Navigation Menu

Repository navigation

Minor tweaks to evals - #1266

Minor tweaks to evals #1266
aantn merged 25 commits into
masterfrom
claude/fix-eval-regression-marker-XeZ7i

Commits on Dec 29, 2025

Fix eval regression marker default for manual triggers

Add test preview and warning for manual eval triggers

Add notification comment for manual eval triggers

Rename Test preview to Evals to run and remove limit

Fix duplicate comment issue and remove placeholder text

Split markers and eval names into separate details sections

Fix grep -c exit code issue in test collection

Add trigger context for automatic eval runs

Add progress checklist to eval workflow

Fix empty MODEL causing 0 tests to be collected

Dynamically collect markers and eval names instead of hardcoding

Unify comment generation with shared helper functions

Extract eval comment helpers to shared JS file

Fix trigger source text and remove eyes reaction on completion

Unify comment generation with shared helper functions

DRY: Use base_params JSON to reduce repetition in workflow steps

Auto-detect PR from branch in workflow_dispatch

Improve eval results comment formatting

Add Legend section with test status emoji explanations

Show footer (legend, re-run, markers, evals) on both manual and automatic runs

Merge master and resolve conflicts

Show footer (legend, re-run, markers, evals) on all progress updates

Improve loading message for markers/evals in footer

Remove duplicate legend from Python reporter

Change loading message to "Collecting from ..."