Improvements to manual evals run - #1265

Merged

aantn merged 18 commits into

claude/fix-eval-regression-marker-XeZ7i

Dec 29, 2025

Commits on Dec 29, 2025

Fix eval regression marker default for manual triggers
claude
committed
8774a0b
Add test preview and warning for manual eval triggers
claude
committed
ac63a82
Add notification comment for manual eval triggers
claude
committed
12db5cb
Rename Test preview to Evals to run and remove limit
claude
committed
7b43d8a
Fix duplicate comment issue and remove placeholder text
claude
committed
682a686
Split markers and eval names into separate details sections
claude
committed
044ec35
Fix grep -c exit code issue in test collection
claude
committed
0d133f5
Add trigger context for automatic eval runs
claude
committed
b41b283
Add progress checklist to eval workflow
claude
committed
2e9f10d
Fix empty MODEL causing 0 tests to be collected
claude
committed
8bcefd7
Dynamically collect markers and eval names instead of hardcoding
claude
committed
9ea1501
Unify comment generation with shared helper functions
claude
committed
efee49a
Extract eval comment helpers to shared JS file
claude
committed
1536571
Fix trigger source text and remove eyes reaction on completion
claude
committed
7bc70b3
Unify comment generation with shared helper functions
claude
committed
ecfe41e
DRY: Use base_params JSON to reduce repetition in workflow steps
claude
committed
452b283
Auto-detect PR from branch in workflow_dispatch
claude
committed
9b8a501
Improve eval results comment formatting
claude
committed
959f740