docs(benchmarks): §9.8 — baseline ingest/recovery + real-corpus A1/C1/C2 + B1/B2 - #250
Conversation
…rpus A1/C1/C2 + B1/B2 Records the 2026-06-18 authoritative `baseline-8vcpu-32gib` (Hetzner ccx33) run: (a) the self-contained `ingest_write_path` (RFC 0014) + `recovery` (RFC0008.3) criterion benches as supportive wall-clock, and (b) the `ourios-bench` binary's A1/C1/C2 on two real corpora (LogHub HDFS_v1 — 11.18M real production lines / 1.58 GiB, above §8's 1 GiB minimum — and frozen OTel-Demo v1) plus the B1/B2 criterion benches over them. Headlines: C1 reconstructs all 11,175,578 non-lossy HDFS rows bit-for-bit; C2 converges (40 templates, ratio 0.825); a time-windowed B2 query on HDFS prunes 13/14 row groups (~5×) — predicate pushdown on real data; A1 fails as the recorded diagnostic (RFC 0011), not a gate. Curated narrative outside the managed BENCH-RESULTS region; VM torn down after the run. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
Warning Review limit reached
More reviews will be available in 49 minutes and 22 seconds. Learn how PR review limits work. Your organization has used up its prepaid credits, and credit purchases are no longer available. Enable the review add-on in the billing tab to keep reviews running — you're only billed for reviews past your plan's rate limits ($0.25/file). ⌛ How to resolve this issue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based credits. 🚦 How do rate limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan refill rate. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, the refill rate gradually slows as usage increases. The highest same-day bursts are limited more strictly. Please see our Fair Usage Limits Policy for further information. 📝 WalkthroughWalkthroughAppends a new §9.8 section (2026-06-18, Changes§9.8 benchmark results
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes Possibly related PRs
Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Pull request overview
Adds a new curated benchmark entry documenting the 2026-06-18 authoritative baseline-8vcpu-32gib run in docs/benchmarks.md §9.8, capturing ingest write-path + recovery criterion results and real-corpus A1/C1/C2 + B1/B2 thesis-gate outcomes.
Changes:
- Adds §9.8 narrative documenting baseline hardware, run parameters, and measured ingest/recovery wall-clock figures.
- Records real-corpus gate results for LogHub HDFS_v1 and OTel-Demo v1 (A1/C1/C2) plus B1/B2 timings and pruning outcomes.
- Notes bench-tooling boundary (curated narrative outside the managed
BENCH-RESULTSregion) and criterion setting differences for b1/b2.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Actionable comments posted: 1
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@docs/benchmarks.md`:
- Around line 865-866: The HDFS_v1 corpus size representation contains a factual
inconsistency where lines 865-866 and line 889 state the size as 1.58 GiB.
However, the documented byte count at line 749 (1,577,982,906 raw bytes)
calculates to 1.4688 GiB, which should be rounded to 1.47 GiB. Replace all
instances of "1.58 GiB" with "1.47 GiB" at both locations (lines 865-866 and
889) to align with the correct calculation and maintain consistency with the
size representation used throughout sections §1, §9.4, and §9.6 of the document.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
…s §1/§9.4/§9.6) Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…-row note, attached % Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…odel, match §9.7) Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
What
Records the 2026-06-18 authoritative
baseline-8vcpu-32gibrun as a newdocs/benchmarks.md§9.8 (curated narrative, outside the managedBENCH-RESULTSregion). Two dedicated-vCPU cloud hosts (8 vCPU EPYC-Milan / 32 GiB), gitd3f2cae, torn down immediately after.(a) Ingest write-path + recovery — supportive criterion wall-clock (the metrics-fill + bench arc, #247/#248):
wal_append372 µs ·sink_write/1000012.24 ms (817 K rec/s) ·recovery/{1,4,16}169 µs→507 µs→1.87 ms (O(N)).(b) Thesis gates A1/C1/C2 on real corpora — LogHub HDFS_v1 (11.18 M real Hadoop production lines / 1.58 GiB, above §8's 1 GiB minimum; Zenodo md5-pinned, never redistributed) + frozen OTel-Demo v1:
(c) B1/B2 query gates on real corpora — headline: a time-windowed B2 query on HDFS prunes 13/14 row groups (~5×) via Parquet min/max stats — the predicate-pushdown thesis (pillar #1) on real production data.
Notes
--update-benchmarks-mdmanaged region is untouched.--warm-up-time 1 --measurement-time 3(matchingquery-bench.yml); structural pruning/template numbers are exact and criterion-setting-independent.mdbook buildclean.🤖 Generated with Claude Code
Summary by CodeRabbit