Repository navigation

Test cli performance - #1415

Merged

aantn merged 29 commits into

masterfrom

claude/holmes-performance-benchmarks-yKW8b

Feb 1, 2026

Commits on Jan 23, 2026
- Add CLI performance benchmark for PRs
  claude
  committed
  75931d7
- Enhance CLI benchmark to separate startup vs e2e timing
  claude
  committed
  93b2b5d
- Add cold/warm start metrics and baseline persistence
  claude
  committed
  23a3e75
- Simplify workflow: benchmark PR vs master in same run
  claude
  committed
  26d98e2
- Fix: copy benchmark script before checkout master
  claude
  committed
  ad598fc
- Fix YAML syntax: use list for report instead of multi-line f-string
  claude
  committed
  0bae2dd
Commits on Jan 24, 2026
- Fix: remove copied script before checkout back to PR branch
  claude
  committed
  bc6884d
- Fix: use unique delimiter for GITHUB_OUTPUT heredoc
  claude
  committed
  ac9cc28
- Fix benchmark workflow and clarify job names
  claude
  committed
  be3af1e
- Fix: read report from file instead of GITHUB_OUTPUT
  claude
  committed
  fc36269
- Use OpenRouter + Haiku for LLM benchmark, report if API key missing
  claude
  committed
  2263ba2
- Fix: use Haiku 4.5 model (not 3.5) for LLM benchmark
  claude
  committed
  905d644
- Improve LLM benchmark error diagnostics and fix model name
  claude
  committed
  a2b1350
- Refactor: unified benchmark job with consistent formatting
  claude
  committed
  29f0e56
- Clean up benchmark script and fix comment detection
  claude
  committed
  f2a8f21
- Fix cold start measurement: clear bytecode cache and venv for master
  claude
  committed
  36b6d40
- Add 'benchmark running' banner to PR comment during execution
  claude
  committed
  96e6bd8
- Add sudo drop_caches to clear OS page cache before master benchmark
  claude
  committed
  76fe990
- Aggressive cache clearing: add memory pressure and clear all caches
  claude
  committed
  a4fecf5
- Increase memory pressure to 8GB (exceeds 7GB runner RAM)
  claude
  committed
  9939162
- Fix running banner: add logging, fix URL, continue-on-error
  claude
  committed
  6112d23
- Fix CodeRabbit issues: bot detection, script injection, workflow_dispatch
  claude
  committed
  faaf5be
- Remove redundant timestamp from PR comment
  claude
  committed
  82a3509
- Increase memory pressure to 16GB for more aggressive cache eviction
  claude
  committed
  fb408b6
Commits on Jan 25, 2026
- Refactor to separate jobs for true cold start isolation
  claude
  committed
  87a210a
Commits on Jan 30, 2026
- Merge branch 'master' into claude/holmes-performance-benchmarks-yKW8b
  aantn
  authored
  b4ed214
Commits on Feb 1, 2026

Navigation Menu

Repository navigation

Test cli performance - #1415

Test cli performance#1415
aantn merged 29 commits into
masterfrom
claude/holmes-performance-benchmarks-yKW8b

Commits on Jan 23, 2026

Add CLI performance benchmark for PRs

Enhance CLI benchmark to separate startup vs e2e timing

Add cold/warm start metrics and baseline persistence

Simplify workflow: benchmark PR vs master in same run

Fix: copy benchmark script before checkout master

Fix YAML syntax: use list for report instead of multi-line f-string

Commits on Jan 24, 2026

Fix: remove copied script before checkout back to PR branch

Fix: use unique delimiter for GITHUB_OUTPUT heredoc

Fix benchmark workflow and clarify job names

Fix: read report from file instead of GITHUB_OUTPUT

Use OpenRouter + Haiku for LLM benchmark, report if API key missing

Fix: use Haiku 4.5 model (not 3.5) for LLM benchmark

Improve LLM benchmark error diagnostics and fix model name

Refactor: unified benchmark job with consistent formatting

Clean up benchmark script and fix comment detection

Fix cold start measurement: clear bytecode cache and venv for master

Add 'benchmark running' banner to PR comment during execution

Add sudo drop_caches to clear OS page cache before master benchmark

Aggressive cache clearing: add memory pressure and clear all caches

Increase memory pressure to 8GB (exceeds 7GB runner RAM)

Fix running banner: add logging, fix URL, continue-on-error

Fix CodeRabbit issues: bot detection, script injection, workflow_dispatch

Remove redundant timestamp from PR comment

Increase memory pressure to 16GB for more aggressive cache eviction

Commits on Jan 25, 2026

Refactor to separate jobs for true cold start isolation

Commits on Jan 30, 2026

Merge branch 'master' into claude/holmes-performance-benchmarks-yKW8b

Commits on Feb 1, 2026

Merge branch 'master' into claude/holmes-performance-benchmarks-yKW8b

Merge branch 'master' into claude/holmes-performance-benchmarks-yKW8b

Merge branch 'master' into claude/holmes-performance-benchmarks-yKW8b