Repository navigation
chore: refresh benchmarks for v1.38.1 - #1257
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Central YAML (base), Organization UI (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
📝 WalkthroughWalkthroughThe benchmark metadata, Aube version, and measurements were refreshed in ChangesBenchmark refresh
Estimated code review effort: 2 (Simple) | ~10 minutes Possibly related PRs
Suggested reviewers: Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Greptile SummaryThe PR refreshes benchmark data for aube 1.38.1 and synchronizes the README’s generated performance ratios.
Confidence Score: 5/5The PR appears safe to merge, with benchmark data and README claims remaining synchronized and internally consistent. The refreshed measurements match their full-precision statistics, the displayed ratios match the repository’s generation logic, and no additional coordinated updates are required. Important Files Changed
Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
Instruction counts
No instruction-count regression above 1%. Only instruction counts gate. Wall clock is shown for context — on identical hardware it moves 4-20% run to run. Measured by tak — instruction-counted CLI benchmarks, stored in this repository's git notes.
|
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube1.38.0; the workspace is now1.38.1. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 3x -> 3x; warm installs vs pnpm 7x -> 7x; repeat test vs Bun 4x -> 4x; repeat test vs pnpm 47x -> 42x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.Note
Low Risk
Documentation and benchmark data only; no runtime or application code changes.
Overview
Re-runs the hermetic benchmark suite and updates
benchmarks/results.jsonfor aube 1.38.1 (from 1.38.0), including refreshed timings and stats for warm/cold installs and the repeatinstall && testscenario across all package managers.The auto-generated
README.mdBENCH_RATIOSblock is updated to match; the only public ratio change is repeat test vs pnpm (47x → 42x); warm vs pnpm/Bun claims stay at 7x and 3x.Reviewed by Cursor Bugbot for commit db11a34. Bugbot is set up for automated code reviews on this repo. Configure here.
Summary by CodeRabbit
Documentation
Benchmarks