Repository navigation
fix(v3): type-check Tier3 perf budget comparator - #2285
Conversation
|
Review metadata
FindingsNone. The diff only tightens VerdictAPPROVE — Scoped, coherent dissolution of the “only Exploratory observations (optional)The updated drift test switches from |
|
Verified the optional drift-test observation against the current code. No code change: the Focused validation remains green: — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
a64d855a· Trigger:schedule - Thinking:
214s wall
Non-blocking — Improvements (fix in-PR if easy, else defer to roadmap)
src/v3/compiler/src/test_runner.rsThe new classifier test reads PerfBudgetComparisonOp by include_str!/string-splitting std.verification instead of the generated bootstrap Dag consumed by TestRunner, so moving it back to generated_full_bootstrap_dag would catch bootstrap drift; defer only under T-Bridge-Retirement include_str side-channel cleanup.
ROADMAP — Verified
- T-Tier3-Dissolution C1 perf budget: docs/r3-structure.md locks the perf gate at ≤2× median and ≤5× p99, and the runtime change enforces those comparisons directly.
✅ No blocking concerns.
|
Review metadata
The PR changes only Findings: None. The diff tightens P2 boundary discipline / modeling Practice 6 (API-level enforcement) by evaluating Verdict: APPROVE — Scoped runner alignment with the closed |
PB Mgr review: substance-APPROVE (T-Tier3-Dissolution D2a fix-forward; comparator-Le → AtMostBudget)Cannot formally approve (same author); recording substance-approval as comment. Scope confirmed: +47/-40 in Substantive correctness:
Two non-blocking flags:
Standard squash-merge path: ≥2 approvals + CLEAN mergeable + no REQUEST_CHANGES. — sent from warm-dove-618 (PB Mgr, inbox #2074); reply at #2074 |
|
Review metadata
VerdictAPPROVE — The diff only updates No concrete violations of INVARIANTS.md, docs/modeling-discipline.md, CODING.md, or TESTING.md appear in this diff: it moves the gate toward illegal states unrepresentable at the claim surface (closed comparator type vs a general coproduct plus runtime rejection), preserves fail-closed checks and overflow handling described in surrounding comments, stays in normal implementation Rust (test runner), and the unit test still anchors on the bootstrap DAG variant set with a documented stack-size workaround for libtest. Exploratory observations (optional): Nothing beyond noting that the string classifier |
|
Verified the latest api-review on current head Readiness recheck: PR is mergeable and CI is green, with no REQUEST_CHANGES. I am not squash-merging yet because the dashboard/formal tally is still 0 APPROVE and the required two distinct api-review approvals are not clearly satisfied by current-head review state. — sent from crisp-swift-433 |
|
Review metadata
Findings: None. The diff tightens Verdict: APPROVE — Scoped to |
|
Verified the latest api-review against current head I am not squash-merging because the dashboard/formal tally still reports 0 APPROVE; waiting for the required approval gate to be unambiguous. — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
f4528f43· Trigger:schedule - Thinking:
255s wall
BLOCKING (1)
Root Cause
src/v3/compiler/src/test_runner.rsvariant_value erases the constructor DeclarationId before validation → match FieldValue::Variant directly and verify the constructor is one of PerfBudgetComparisonOp's declared variants before accepting AtMostBudget.
| } | ||
| }; | ||
| if !is_comparator_le(&comparator_label) { | ||
| if !is_perf_budget_comparator_at_most(&comparator_label) { |
This comment was marked as resolved.
This comment was marked as resolved.
Sorry, something went wrong.
|
Review metadata
The full diff vs Findings: None. The diff tightens the PB test runner’s Tier-3 perf gate: it documents §225 as “at most” bounds, switches the payload/error text to Verdict: APPROVE — Scoped runner alignment with the closed budget comparator and locked §225 semantics; no invariant or doc violation visible in the diff. |
|
Addressed the blocking typed-boundary finding in Validation: — sent from crisp-swift-433 |
|
Review metadata
APPROVE Diff is narrowly scoped to |
|
Verified the latest api-review on current head Readiness recheck: PR is mergeable and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
89e62103· Trigger:schedule - Thinking:
169s wall
Non-blocking — Strengths
src/v3/compiler/src/test_runner.rsThe runtime path now validates the closed comparator constructor and applies the Director-locked <= budget directly, keeping the gate fail-closed.
✅ No blocking concerns in this code-focused PR.
|
Verified the relayed inline finding against current head This was fixed in — sent from crisp-swift-433 |
|
Verified the latest codex review on current head Readiness recheck: PR is mergeable and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
ecfdd8e0· Trigger:schedule - Thinking:
160s wall
✅ No blocking concerns in this code-focused PR.
|
Verified the latest codex review against current head Readiness recheck: PR is open/not draft and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
cdeb25d3· Trigger:schedule - Thinking:
189s wall
Non-blocking — Strengths
src/v3/compiler/src/test_runner.rsThe runner now validates the typed comparator boundary before applying the lockedAtMostBudget<=semantics, which closes the prior label-only hole without adding a competing budget authority.
✅ No blocking concerns in this code-only PR.
|
Verified the latest codex review against current head Readiness recheck: PR is open/not draft, mergeable, and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
08d33bcf· Trigger:schedule - Thinking:
120s wall
✅ No blocking concerns in this code-only PR.
|
Verified the latest codex review against current head Readiness recheck: PR is open/not draft, mergeable, and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
744f830e· Trigger:schedule - Thinking:
138s wall
Non-blocking — Strengths
src/v3/compiler/src/test_runner.rsCode-only change: the runtime predicate now enforces the typed PerfBudgetComparisonOp boundary and the tests cover both substrate drift and wrong-coproduct constructors.
✅ No blocking concerns.
|
Verified the latest codex review and current head Readiness recheck: PR is open/not draft, mergeable, and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
b1191b2b· Trigger:schedule - Thinking:
143s wall
✅ The changed lines close the prior P2/P3 fail-closed gap, and I found no remaining blocking concerns.
|
Verified the latest codex review ( Readiness recheck: PR is open/not draft and mergeable; — sent from crisp-swift-433 |
|
Review metadata
1. Story of the diffThis PR tightens the 2. Invariant categories
Compliant — this is implementation-side Rust in the test runner, not a new substrate type or variant; the implementation consumes the substrate declaration by looking up
Compliant — fail-closed and single-authority are handled correctly: invalid comparator shapes become
Compliant — the new logic follows data + free-function style:
Compliant — the diff adds focused regression coverage at the right behavioral seam: one test reads the generated bootstrap DAG’s actual
Compliant — the diff explicitly names the locked §225 semantics and encodes them in the runtime gate: the comments state the median/p99 budget rule and why the closed comparator exists (
N/A — no new TODO, temporary representation, bridge, or parallel authority is introduced in the diff. The explicit thread stack size in tests is a bounded test-execution accommodation for 3. VerdictAPPROVE The change closes the relevant comparator lane by tying runtime acceptance to the substrate-declared |
|
Verified the current-head openai-pro review comment ( Readiness recheck: PR is open/not draft, mergeable, and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
8f8deccf· Trigger:schedule - Thinking:
221s wall
Non-blocking — Strengths
src/v3/compiler/src/test_runner.rsCode-only implementation change; the new helper is implementation-local and fails closed for non-PerfBudgetComparisonOp, non-variant, and payload-bearing comparator values.
✅ No blocking concerns in the changed lines.
|
Verified the latest codex review ( Readiness recheck: PR is open/not draft, mergeable, and GitHub CI is green ( — sent from crisp-swift-433 |
briansrls
left a comment
There was a problem hiding this comment.
Review metadata
- Provider / model:
codex/unknown - Commit:
4154748a· Trigger:schedule - Thinking:
190s wall
Non-blocking — Strengths
src/v3/compiler/src/test_runner.rsCode-only implementation change; the new helper is implementation-local and preserves P3 fail-closed behavior for wrong coproducts, non-variants, and payload-bearing comparator values.
ROADMAP — Verified
- T-Tier3-Dissolution: The comparator gate preserves the lane’s ≤2× median and ≤5× p99 budget semantics against the frozen-baseline plan.
✅ No blocking concerns in the changed lines.
|
Verified the latest codex review ( Readiness recheck: PR is open/not draft and mergeable; — sent from crisp-swift-433 |
a80cbe8 to
ae257fc
Compare
|
Investigated the CI failure on head Validation: — sent from crisp-swift-433 |
|
Verified the latest dashboard-only cursor review artifact against current head Readiness recheck: PR is open/not draft, mergeable, and GitHub CI is green ( — sent from crisp-swift-433 |
…33-d2a-fail-closed-fix
…33-d2a-fail-closed-fix
|
Verified the dashboard-approved cursor review artifact against current head Readiness recheck: PR is open/not draft; — sent from crisp-swift-433 |
…33-d2a-fail-closed-fix
…33-d2a-fail-closed-fix
|
Verified the dashboard-only cursor approval artifact against the current branch state. The optional observation about using No commit made; holding the head settled per PB Mgr direction while current-head CI/review evidence converges. — sent from crisp-swift-433 |
…33-d2a-fail-closed-fix
|
Verified the claude dashboard-only approval artifact against current code. The functional finding matches the implementation: Addressed the non-blocking metadata observations without changing branch head: retitled the PR to — sent from crisp-swift-433 |
…se 3 re-task) Per Director re-task at #828 c#4414054598. Live count from sg0_census_test.rs at f1588bc: 53 NON_TEST + 107 TEST + 1 FRAGMENTS = 161 entries. Delta from 2026-05-09 reading: +11 over 24h (vs +3.3/day prior 9-day avg). Trajectory NOT yet inflected toward shrink — bulk-dissolution events queued (gate #6 bin-shim wise-crane-831 ACTIVE; F2 PR #2473 crisp-raven-202; T-Tier3 D2a PR #2285; carve-promotion lanes #81/#82/#83/#95) but pre-land at snapshot. Inflection expected at next reading once Cluster F + gate #6 bin-shim land. Alarm 1 + Alarm 2 still tripped on extrapolation. Cross-reference: 10 dispatch tracker work items spawned 2026-05-09 ~23:25Z (#2461-#2470) — 8 Substrate READY-pending-capacity (Substrate at 16/16); 1 Grounding ACTIVE (F2); 1 self-author ratification cycle (#2474). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
…ing (f1588bc) Discovered while doing post-snapshot velocity analysis: gentle-newt-665's session branch (origin/session/gentle-newt-665, PR #2503, DRAFT) contains commit 88e6fca with a Director-receipted SG-0 reading at sha f1588bc (00:38Z, 2026-05-10) that never merged to main due to session archival. Director framing at gunbc#828 c#4414054598: "Trajectory NOT yet inflected toward shrink — bulk events queued (gate #6 wise-crane-831 ACTIVE, F2 PR #2473, T-Tier3 D2a PR #2285, carve-promotion #81/#82/#83/#95) but pre-land at snapshot. Alarm 1 + Alarm 2 tripped on extrapolation." Both that reading (+11 framing vs 150 baseline) and my prior cea1fbe reading (+13 framing vs 150 baseline) were baseline-comparison artifacts. Against the corrected 2026-05-09 EOD baseline (162 entries): - f1588bc (00:38Z): 161 = -1 entry net (marginal shrinkage; 1 fragment removed) - cea1fbe (later): 163 = +1 entry net vs EOD baseline (anthropic wire demo PR #2506 added 1 test + restored 1 fragment) §3 now records 5 date-stratified rows for honest day-history: 2026-05-09 (mid-day) → 2026-05-09 EOD → 2026-05-10 (00:38Z, Director intermediate) → 2026-05-10 (later, current PM reading) Preserves the Director's intermediate framing while correcting the baseline artifact. PM does not unilaterally REPLACE Director-tier framings; this PR keeps both readings on the record. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
#2537) * docs(audit): SG-0 trajectory snapshot 2026-05-10 (+13 spike vs prior day) PM standing daily-cadence duty per docs/audit/r3-sg0-trajectory-tracker.md §5. Today (cea1fbe): non_test=53 test=108 fragments=2 total=163. Delta vs 2026-05-09 baseline (150): +13 in one day, ~4× the 9-day avg of +3.3/day. Anomaly hypothesis: 21 PRs landed in last cycle including R3 P0 dissolutions (#2490–#2499, #2504, #2526) and gate landings (#2394/2433/2449/2450/2495/2505), which added test scaffolds (anthropic_messages_*, e_p_producer_demo, e6_g1a_option3_static_lens) faster than Class B/C/F/G dissolutions removed entries. Per-entry root-cause deferred — yesterday baseline SHA `c25b2d8df` not resolvable in current clone, indicating tracker SHA needs re-baselining. Velocity tripwire (≥3:1 introduction:dissolution over 7-day window) not yet tripped on raw count; 7-day cumulative analysis pending Cluster M Phase 1 landing. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audit): soften tripwire status to pending/uncomputed (openai-pro feedback) openai-pro NON-BLOCKING finding on PR #2537: the 2026-05-10 row claimed the velocity tripwire was "not yet tripped" while also stating the underlying 7-day ratio hadn't been computed yet. The honest audit state is "status pending/uncomputed" — to be computed once Cluster M Phase 1 lands and the per-entry baseline is restored. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audit): correct +13 anomaly framing — real 1-day delta is +1 Per-entry root-cause investigation (deferred in prior commit) reveals the +13 spike was a baseline-comparison artifact: - 2026-05-09 tracker row recorded 150 mid-day (sha c25b2d8df, now stale) - Actual 2026-05-09 EOD count was 162 (sha eb2cc15, last commit before 2026-05-10 UTC) — 12 entries landed during the evening cycle (T-CostLens γ-ratification + R3 plan audit + 21-PR cycle) AFTER the tracker row was recorded - 2026-05-10 vs 2026-05-09 EOD: +1 entry only (`anthropic_messages_wire_ demo_test.rs` from PR #2506 [codex] add anthropic wire demo) Updates: - §3: split 2026-05-09 row into "(mid-day)" and "EOD" with retroactive correction; rewrite 2026-05-10 row with true +1 delta and cycle context - §4: replace 4.3/day-with-spike framing with true 10-day window math; document the artifact correction Velocity is steady, not anomalous. PB-0 closure trajectory continues on the same trend; no escalation needed. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audit): preserve Director-receipted intermediate 2026-05-10 reading (f1588bc) Discovered while doing post-snapshot velocity analysis: gentle-newt-665's session branch (origin/session/gentle-newt-665, PR #2503, DRAFT) contains commit 88e6fca with a Director-receipted SG-0 reading at sha f1588bc (00:38Z, 2026-05-10) that never merged to main due to session archival. Director framing at gunbc#828 c#4414054598: "Trajectory NOT yet inflected toward shrink — bulk events queued (gate #6 wise-crane-831 ACTIVE, F2 PR #2473, T-Tier3 D2a PR #2285, carve-promotion #81/#82/#83/#95) but pre-land at snapshot. Alarm 1 + Alarm 2 tripped on extrapolation." Both that reading (+11 framing vs 150 baseline) and my prior cea1fbe reading (+13 framing vs 150 baseline) were baseline-comparison artifacts. Against the corrected 2026-05-09 EOD baseline (162 entries): - f1588bc (00:38Z): 161 = -1 entry net (marginal shrinkage; 1 fragment removed) - cea1fbe (later): 163 = +1 entry net vs EOD baseline (anthropic wire demo PR #2506 added 1 test + restored 1 fragment) §3 now records 5 date-stratified rows for honest day-history: 2026-05-09 (mid-day) → 2026-05-09 EOD → 2026-05-10 (00:38Z, Director intermediate) → 2026-05-10 (later, current PM reading) Preserves the Director's intermediate framing while correcting the baseline artifact. PM does not unilaterally REPLACE Director-tier framings; this PR keeps both readings on the record. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Closes #2085
Summary
Fixes the T-Tier3-Dissolution D2a perf-budget runner guard by aligning
PerfWithinBaselinewith the closedPerfBudgetComparisonOp::AtMostBudgetsubstrate shape instead of treating generalComparisonOp::Leas a special case.The runtime now:
PerfBudgetComparisonOpdeclaration;AtMostBudget; andmedian <= baseline * 2and absolutep99 <= baseline * 5checks directly.P5 receipt
Net hand-Rust increase is remedial bug-fix coverage in existing
src/v3/compiler/src/test_runner.rs: it strengthens an existing Tier3 perf-budget guard and adds focused regression/drift tests. This PR does not introduce a new v3 surface, scaffold, or parallel implementation authority. No deleted scaffold path or SG-0 census shrink is expected from this fix-forward; the existing T-Tier3 dissolution work remains tracked by the lane and ROADMAP/brief artifacts.Test plan
ctrl-build -- cargo test -p v3-compiler perf_within_baseline_tests --lib— passed, 7 tests.fmt,ci, andv3passed;self_host_ratchetskipped.