Repository navigation
chore: refresh benchmarks for v1.31.0 - #1072
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Central YAML (base), Organization UI (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
📝 WalkthroughWalkthroughBenchmark metadata and timing results were regenerated for three benchmark scenarios, and the README’s Fast installs speedup figures were updated accordingly. ChangesBenchmark refresh
Estimated code review effort: 2 (Simple) | ~10 minutes Possibly related PRs
Suggested reviewers: Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Pull request overview
Refreshes the repo’s published benchmark artifacts to reflect the current workspace release (aube v1.31.0) and updated pnpm version, keeping README performance claims aligned with the latest hermetic benchmark run.
Changes:
- Updated the README
BENCH_RATIOSblock to reflect new “warm install” and “install && test” relative-performance ratios. - Regenerated
benchmarks/results.jsonwith a newupdatedtimestamp, pinned tool versions, and refreshed benchmark values/stats.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
| README.md | Updates the public benchmark ratio statement in the BENCH_RATIOS block. |
| benchmarks/results.json | Updates pinned versions, timestamp, and benchmark measurements/statistics for the latest hermetic run. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
|
|
||
| <!-- BENCH_RATIOS:START --> | ||
| **[Fast installs](https://aube.jdx.dev/benchmarks).** Warm installs are about 3x faster than pnpm and ~1.4x faster than Bun in the current benchmarks. Repeat test commands run up to 40x faster than pnpm and up to 4x faster than Bun. | ||
| **[Fast installs](https://aube.jdx.dev/benchmarks).** Warm installs are about 3x faster than pnpm and ~1.5x faster than Bun in the current benchmarks. Repeat test commands run up to 32x faster than pnpm and up to 4x faster than Bun. |
Greptile SummaryThis PR refreshes the published benchmarks for aube 1.31.0. The main changes are:
Confidence Score: 5/5This looks safe to merge.
Important Files Changed
Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube1.29.1; the workspace is now1.31.0. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 1.4x -> 1.5x; warm installs vs pnpm 3x -> 3x; repeat test vs Bun 4x -> 4x; repeat test vs pnpm 40x -> 32x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.Note
Low Risk
Documentation and benchmark data only; no runtime or application code changes.
Overview
Re-runs the hermetic benchmark suite and updates pinned results for aube 1.31.0 (from 1.29.1) and pnpm 11.15.1 (from 11.13.1) in
benchmarks/results.json, with a newupdatedtimestamp and refreshed means/stddev for warm/cold install and repeatinstall && testscenarios.The README
BENCH_RATIOSblock is regenerated to match: warm install vs Bun is now ~1.5x (was ~1.4x), repeat test vs pnpm is up to 32x (was 40x); the 3x vs pnpm warm-install and 4x vs Bun repeat-test claims are unchanged.Reviewed by Cursor Bugbot for commit ed370bb. Bugbot is set up for automated code reviews on this repo. Configure here.
Summary by CodeRabbit
Documentation
Chores