docs(benchmarks): record authoritative baseline C1/C2 on HDFS_v1 (§9.6) - #194
Conversation
Adds §9.6 — the authoritative `baseline-8vcpu-32gib` C1/C2 rerun on the representative LogHub HDFS_v1 corpus (11.2 M lines), the run §9.5 anticipated for RFC 0001's `validated` flip. Run on a freshly provisioned 8-vCPU/32-GiB dedicated host (torn down immediately after), git 9a57ace, `ourios-bench --gates c1,c2 --hardware-kind baseline-8vcpu-32gib`: - C1 = 1.000000 (11,175,578/11,175,578 non-lossy reconstruct bit-identical; lossy ratio 4.6e-06) - C2 = 40 templates at 11.2 M lines (33 at 1 M), ratio 0.825, formal gate applies Verdicts match §9.5 bit-for-bit — expected, since C1/C2 are deterministic functions of (corpus, miner) with no hardware-sensitive component (contrast A1's writer-environment sensitivity, §9.4). A1 was not run: diagnostic, not gating (RFC 0011). Under RFC 0011 these two gates define RFC 0001's `validated`; both PASS authoritatively, leaving the status flip to the maintainer. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthrough
Changes§9.6 Authoritative C1/C2 HDFS_v1 Benchmark Results
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes Possibly related PRs
Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Pull request overview
Adds an authoritative record of the baseline (baseline-8vcpu-32gib) C1/C2 benchmark rerun on the LogHub HDFS_v1 corpus, capturing the hardware-kind-stamped results needed for RFC 0001’s validated gate evidence.
Changes:
- Updates the §9.5 narrative to reference the completed authoritative rerun on 2026-06-14.
- Adds new §9.6 with corpus/hardware/run provenance and a C1/C2 results table for HDFS_v1.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
What
Adds §9.6 to
docs/benchmarks.md: the authoritativebaseline-8vcpu-32gibC1/C2 rerun on the representative LogHub HDFS_v1 corpus (11.2 M lines) — the run §9.5 anticipated for RFC 0001'svalidatedflip.How
Provisioned a fresh 8-vCPU/32-GiB dedicated host, fetched HDFS_v1 on the box (md5-verified, never redistributed), ran
ourios-bench --gates c1,c2 --hardware-kind baseline-8vcpu-32gibat git9a57ace, pulled the results JSON, and tore the box down immediately after.The verdicts match §9.5's local diagnostic run bit-for-bit — expected, since C1 (reconstruction fidelity) and C2 (template-count convergence) are deterministic functions of (corpus, miner) with no wall-clock or hardware-sensitive component (contrast A1's writer-environment sensitivity, §9.4). The value of this run is the authoritative
hardware_kindstamp.Invariants (CLAUDE.md §3)
Doc-only change. No code, no schema, no hot path. §3.1 (reconstruction/lossy retention) and §3.3 (bit-identical reconstruction) are the invariants C1 measures, and the recorded reading is PASS.
Follow-up (not in this PR)
Under RFC 0011 these are RFC 0001's
validatedgates; both now PASS authoritatively, leaving the RFC 0001 →validatedstatus flip to the maintainer.🤖 Generated with Claude Code
Summary by CodeRabbit