Skip to content

chore: refresh benchmarks for v1.32.0 - #1080

Merged
jdx merged 1 commit into
mainfrom
bench-refresh
Jul 22, 2026
Merged

jdx merged 1 commit into
mainfrom
bench-refresh

Conversation

@jdx

@jdx jdx commented Jul 22, 2026 •

Copy link
Copy Markdown
Collaborator

🤖 Refreshed benchmarks

benchmarks/results.json was pinned to aube 1.31.0; the workspace is now 1.32.0. Re-ran mise run bench:bump on the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regenerated benchmarks/results.json plus the README BENCH_RATIOS block. The benchmark matrix pins aube's GVS mode via npm_config_enable_global_virtual_store=true|false (the auto-synthesized env alias for the enableGlobalVirtualStore setting), so GitHub Actions' inherited CI=true environment does not change whether aube runs with GVS enabled or disabled.

Benchmark changes

Versions:

  • aube: 1.31.0 -> 1.32.0

Public ratios: warm installs vs Bun 1.5x -> 2x; warm installs vs pnpm 3x -> 4x; repeat test vs Bun 4x -> 5x; repeat test vs pnpm 32x -> 31x.

Benchmark aube bun deno pnpm npm yarn
Fresh install (warm cache) 989ms -> 571ms (-42%) 1457ms -> 1343ms (-8%) 2434ms -> 1885ms (-23%) 2477ms -> 2094ms (-15%) 7150ms -> 7023ms (-2%) 8139ms -> 8035ms (-1%)
Fresh install (cold cache) 15024ms -> 15243ms (+1%) 4827ms -> 4719ms (-2%) 7911ms -> 7495ms (-5%) 11536ms -> 12487ms (+8%) 9866ms -> 9722ms (-1%) 13150ms -> 14612ms (+11%)
npm install && npm run test 12ms -> 12ms (0%) 45ms -> 54ms (+20%) 47ms -> 46ms (-2%) 380ms -> 370ms (-3%) 736ms -> 776ms (+5%) 1576ms -> 1594ms (+1%)

Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.

Once merged to main, the updated bench results flow into the next release-plz-pr run automatically.


Generated by the bench-refresh workflow.


Note

Low Risk
Documentation and benchmark artifact updates only; no runtime or install logic changes.

Overview
Re-runs the benchmark suite and lands updated numbers for aube 1.32.0 in benchmarks/results.json (timestamp, pinned version, and timings for warm/cold install and repeat install && test scenarios across all package managers).

The README BENCH_RATIOS block is regenerated to match: warm install claims move to ~4× vs pnpm and ~2× vs Bun; repeat-test claims to up to 31× vs pnpm and 5× vs Bun, reflecting a large warm-cache win for aube (989ms → 571ms) while cold-cache aube is essentially unchanged.

Reviewed by Cursor Bugbot for commit 93a9ce7. Bugbot is set up for automated code reviews on this repo. Configure here.

Summary by CodeRabbit

  • Documentation

    • Updated installation benchmark claims, including warm install and repeat test command speedups.
  • Chores

    • Refreshed benchmark results, timestamps, and version information to reflect the latest measurements.

Copilot AI review requested due to automatic review settings July 22, 2026 06:28
@coderabbitai

coderabbitai Bot commented Jul 22, 2026 •

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Central YAML (base), Organization UI (inherited)

Review profile: CHILL

Plan: Pro Plus

Run ID: 48c038bf-6501-49bd-9686-94cd81d89ec7

📥 Commits

Reviewing files that changed from the base of the PR and between 9f2f5f8 and 93a9ce7.

📒 Files selected for processing (2)
  • README.md
  • benchmarks/results.json

📝 Walkthrough

Walkthrough

Benchmark metadata and measurements were refreshed for aube 1.32.0, and the README’s install and repeat-command performance ratios were updated accordingly.

Changes

Benchmark refresh

Layer / File(s) Summary
Refresh benchmark metadata and measurements
benchmarks/results.json
Updates the benchmark timestamp, aube version, and timing values and statistics for the warm, cold, and install-test scenarios.
Update README benchmark claims
README.md
Adjusts the reported warm-install and repeat-test speedup ratios for pnpm and Bun.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

  • jdx/aube#1072: Updates the same README benchmark claims and benchmark result rows.
  • jdx/aube#1060: Refreshes the same benchmark metadata, measurements, and README ratios.
  • jdx/aube#1041: Updates the same benchmark artifacts and regenerated statistics.

Suggested reviewers: mise-en-dev

Poem

I’m a rabbit with numbers to share,
Fresh benchmark results fill the air.
Warm installs hop quick,
New ratios now stick,
While version one-thirty-two’s there!

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly matches the main change: refreshing benchmark data for aube v1.32.0.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Refreshes published benchmark artifacts to align with the workspace bump from aube v1.31.0 → v1.32.0, updating both the machine-readable benchmark dataset and the README’s summarized performance claims.

Changes:

  • Update the README BENCH_RATIOS statement to reflect the newly generated warm-install and repeat-test ratios.
  • Regenerate benchmarks/results.json with the new updated timestamp, pinned aube version, and updated benchmark timings/statistics.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
README.md Updates the BENCH_RATIOS block to match the newly refreshed benchmark ratios.
benchmarks/results.json Updates pinned aube version to 1.32.0 and replaces benchmark timings/stats with the newly generated results.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@greptile-apps

greptile-apps Bot commented Jul 22, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

This PR refreshes the published benchmarks for aube 1.32.0. The main changes are:

  • Replaces all benchmark measurements and statistics with the latest run.
  • Updates the recorded aube version and benchmark timestamp.
  • Regenerates the README performance ratios.

Confidence Score: 5/5

This looks safe to merge.

  • No blocking issues found in the changed code.
  • The displayed values match the rounded means.
  • The README ratios match the repository's generation rules.

Important Files Changed

Filename Overview
README.md Updates the generated performance claims; all four ratios match the benchmark data and generator rounding.
benchmarks/results.json Refreshes the version, timestamp, measurements, and statistics while preserving the expected schema and internal consistency.

Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile

@jdx
jdx merged commit c404c46 into main Jul 22, 2026
19 checks passed
@jdx
jdx deleted the bench-refresh branch July 22, 2026 15:33
@cursor cursor Bot mentioned this pull request Jul 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants