Repository navigation
chore: refresh benchmarks for v1.38.0 - #1244
Conversation
📝 WalkthroughWalkthroughThe PR refreshes benchmark metadata, tool versions, measurements, and statistics in ChangesBenchmark refresh
Estimated code review effort: 2 (Simple) | ~10 minutes Possibly related PRs
Suggested reviewers: Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Greptile SummaryRefreshes the published benchmark artifacts for aube 1.38.0.
Confidence Score: 5/5The PR appears safe to merge. No blocking failure remains. Important Files Changed
Reviews (2): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
Instruction counts
No instruction-count regression above 1%. Only instruction counts gate. Wall clock is shown for context — on identical hardware it moves 4-20% run to run. Measured by tak — instruction-counted CLI benchmarks, stored in this repository's git notes.
|
Dismissed because a newer commit was pushed; Greptile will re-review the current head.
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube1.37.0; the workspace is now1.38.0. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 3x -> 3x; warm installs vs pnpm 7x -> 7x; repeat test vs Bun 4x -> 4x; repeat test vs pnpm 48x -> 47x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.Note
Low Risk
Documentation and benchmark artifacts only; no runtime or product code changes.
Overview
Refreshes published benchmark data for aube 1.38.0 (was 1.37.0) by re-running the hermetic
bench:bumppipeline and committing the newbenchmarks/results.jsonsnapshot, including updated tool versions (deno 2.9.5, pnpm 11.20.0) and revised timings/stats for warm install, cold install, and install+test scenarios.The auto-generated README
BENCH_RATIOSblock is updated so the repeat-test claim vs pnpm drops from 48× to 47×; warm vs pnpm/Bun headline ratios stay at 7× and 3×.Reviewed by Cursor Bugbot for commit f5b5a1c. Bugbot is set up for automated code reviews on this repo. Configure here.
Summary by CodeRabbit
Documentation
Benchmarks