Repository navigation
chore: refresh benchmarks for v1.37.0 - #1206
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Central YAML (base), Organization UI (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
📝 WalkthroughWalkthroughThe benchmark dataset now contains updated metadata, tool versions, and measurements. The README reports revised speedup ratios for warm installs and repeated test commands. ChangesBenchmark refresh
Estimated code review effort: 2 (Simple) | ~10 minutes Possibly related PRs
Suggested reviewers: Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Greptile SummaryRefreshes benchmark artifacts for aube 1.37.0.
Confidence Score: 5/5The PR appears safe to merge because the refreshed benchmark data and README ratios are internally consistent. The benchmark matrix remains complete, every displayed millisecond value and statistic matches the generation format, and the README ratios correctly reflect the committed results. Important Files Changed
Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
Instruction counts
No instruction-count regression above 1%. Only instruction counts gate. Wall clock is shown for context — on identical hardware it moves 4-20% run to run. Measured by tak — instruction-counted CLI benchmarks, stored in this repository's git notes.
|
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube1.36.0; the workspace is now1.37.0. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 1.9x -> 3x; warm installs vs pnpm 3x -> 8x; repeat test vs Bun 4x -> 5x; repeat test vs pnpm 33x -> 44x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.Note
Low Risk
Documentation and benchmark data only; no product code or configuration behavior changes.
Overview
Re-runs the benchmark suite and updates published numbers for aube 1.37.0 (from 1.36.0), along with pnpm 11.18.0 and yarn 4.18.0 in
benchmarks/results.json.The README BENCH_RATIOS block is regenerated to match: warm installs are now cited as ~8x vs pnpm and ~3x vs Bun (up from ~3x and ~1.9x); repeat
install && testis up to 44x vs pnpm and 5x vs Bun. Notable timing shifts include aube warm install 728ms → 299ms and repeat test 12ms → 8ms; other managers’ rows move modestly in the same file.No runtime or install logic changes—only benchmark artifacts and marketing copy tied to the hermetic bench run.
Reviewed by Cursor Bugbot for commit 99b3a59. Bugbot is set up for automated code reviews on this repo. Configure here.
Summary by CodeRabbit