Skip to content

Lane 1: exact-head frontier survey (provenance scaffolding — authoritative run on hold) - #7763

Merged
briansrls merged 25 commits into
mainfrom
session/sleek-pike-668-lane1-frontier-survey
Aug 6, 2026
Merged

briansrls merged 25 commits into
mainfrom
session/sleek-pike-668-lane1-frontier-survey

Conversation

@briansrls

@briansrls briansrls commented Aug 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Exact-head closeout scaffolding for all 27 compiler frontier modules — last in chain. Vocabulary split landed in #7776 (merged). #7762 merged (1ef330f4b). This PR lands provenance infrastructure; the authoritative 27/27 run remains on operator hold (escalating release).

Models survey pinning as FrontierSurveySubject + FrontierSurveyManifest (typed CommitSha, GitObjectId tree, Sha256Digest executable, Fnv1a64Structural source-roots digest, ContentHash probe-policy revision). Totality witnesses consume the manifest subject — empty metadata no longer passes.

Provenance — three lists (not one table of caveats):

Closed (mechanism landed, witness-backed):

  • Hole 1 — commit↔tree binding: resolve_survey_subject refuses dirty worktree before survey; frontier_survey_commit_tree_binding_holds proves source_tree == tree(source_commit) via git.Inspect.ShowTree.
  • Hole 2 — local build provenance: build.rs embeds BUILD_COMMIT, BUILD_TREE, and BUILD_DIRTY (git status --porcelain; git failure → unwrap_or(true) assumes dirty). verify_build_provenance refuses missing/empty stamps, commit/tree mismatch, and dirty-worktree builds.
  • Hole 3 — no mixed-head relabel on seed TSV path: all five subject fields per row including probe_policy_revision; subjects_equal compares all five; load_probe_rows_from_tsv refuses SurveySubjectMismatch; manifest emits measured revision literal (not frontier_probe_policy_revision() relabel).

Residual (closed at current grain; named next trigger):

  • Hole 2: cross-machine binary provenance — local build only; a binary built elsewhere is not proven by the embedded stamp.
  • Hole 3: per-row subject equality is enforced by the seed bin loader only — FrontierProbeReceipt has no subject field; honest next trigger is subject-on-receipt (frontier_survey_subject_grounding_note).

Still open (not closed by this PR):

  • Cross-machine binary provenance (hole 2 residual above).
  • Structural per-row subject on FrontierProbeReceipt (hole 3 residual above).

frontier_probe_survey refuses on dirty tree, failed git observation, build-provenance skew, or dirty-build stamp.

Chain (last of four): #7776 (merged) → #7762 (merged) → #7767 diagnostic detail (open, preferred before authoritative run) → one authoritative 27/27 here.

Hold — do not run the definitive 27/27. Operator hold on the authoritative run (escalating release). #7767 is preferred in sequence before the run but is not a hard dependency to execute the survey. Provenance scaffolding is landable without the run.

CI enrollment: seven long/ witnesses are not in per-PR discovery (witness_discovery_scan_dirs omits src/v2/test/claim/long/; OfflineLocalRecipe exclusion). Stub manifest (receipts: Empty) REDs only on the offline local recipe — not a CI failure shape.

Definitive run contract (only after operator releases hold):

  • Clean detached worktree; build receipt binding commit, tree, compiler sources, probe executable digest, source-root set, and probe-policy revision.
  • Every shard carries complete subject on the TSV wire; all 27 subjects compare exactly equal before aggregation (subjects_equal on all five components).
  • No partial or mixed-head receipts in the definitive manifest. Not reconciled, not adjusted, not carried forward with a note. If a shard fails or a predecessor lands mid-run, affected receipts are discarded and re-run at the new exact subject. Do not hand-reconcile around SurveySubjectMismatch — the value is ONE authoritative run at ONE subject; a manifest assembled from two heads looks authoritative and is not.
  • Identity join (not tally): roster_matches_survey + length equality + frontier_probe_survey_roster_bidirectional_totality_holds; offline recipe names all seven functions in claim_batch.

Seven long/ witnesses — TERMINATING one-shot (admitted, identity-frozen). src/v2/test/claim/long/compiler_frontier_per_module_probe_test.dag carries seven witnesses behind a file-grain WitnessExclusionRow. Under #7804 they are ADMITTED (byte-identical to freeze) and refuse nothing. No cadence enrollment — terminating one-shot has no later. Gate carrier: permanent regression → scheduled consumer; terminating one-shot → none; no discriminating red → deletion. These seven are the live TERMINATING specimen (dissolve_on in compiler_frontier_per_module_probe_exclusion_note / gunbc.ci_layer_roots exclusion row).

Identity constraint: admission by exact function identity. Rename or add in that file → new identity refuses. Definitive 27/27 does not add functions. If closing needs a new witness function there, stop and escalate first.

Test plan

@gunbai-bot gunbai-bot Bot changed the title Lane 1: exact-current-head 27/27 frontier survey + status vocabulary correction Lane 1: exact-head frontier survey (draft — blocked on #7762) Aug 4, 2026
gunbai-bot Bot pushed a commit that referenced this pull request Aug 4, 2026
Operator ruling: operational recipe changes belong in #7763, not the
vocabulary-only PR. Keep execution_measurement dissolve_on wording.

Co-authored-by: Cursor <cursoragent@cursor.com>
gunbai-bot Bot pushed a commit that referenced this pull request Aug 4, 2026
Bind commit↔tree via git.Inspect.ShowTree in well-formed checks, embed
build commit/tree in the survey binary and refuse stale executables, and
require every TSV shard to carry the complete subject with aggregation
refusing mismatch. Block 27/27 on #7762 final + #7767; land release
one-shot recipe in ci_layer_roots exclusion note.

Co-authored-by: Cursor <cursoragent@cursor.com>
gunbai-bot Bot pushed a commit that referenced this pull request Aug 4, 2026
Operator ruling: last of #7776 → #7762 → #7767 → survey; three
provenance holes remain open; every shard must carry complete
FrontierSurveySubject with all 27 comparing exactly equal.

Co-authored-by: Cursor <cursoragent@cursor.com>
briansrls added a commit that referenced this pull request Aug 4, 2026
…#7776)

* WIP: Lane 1: exact-current-head 27/27 frontier survey + status vocabulary cor

* Replace frontier closed/open vocabulary with four orthogonal axes.

Introduce execution_measurement vs no_execution_measurement language with
dated census at 9f978aa (self_emit_ready=0, emitter_produced=0) and
state that receipts from different heads cannot be combined.

Co-authored-by: Cursor <cursoragent@cursor.com>

* Restore executable survey step in offline local recipe note.

Cite the transport-aligned one-shot frontier_probe_survey invocation
(survey_manifest_emit_args) with per-module script OOM fallback so the
authority note is runnable between cargo build and claim_batch.

Co-authored-by: Cursor <cursoragent@cursor.com>

* Align offline recipe build step with release survey binary.

Step (1) now passes --release to match target/release/frontier_probe_survey
and witness_bin_build_args in frontier_probe_survey_transport.

Co-authored-by: Cursor <cursoragent@cursor.com>

* WIP: Lane 1: exact-current-head 27/27 frontier survey + status vocabulary cor

* Revert offline recipe to per-module debug process in #7776.

Operator ruling: operational recipe changes belong in #7763, not the
vocabulary-only PR. Keep execution_measurement dissolve_on wording.

Co-authored-by: Cursor <cursoragent@cursor.com>

---------

Co-authored-by: Brian Searls <briansearls1@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Brian Searls and others added 8 commits August 4, 2026 14:36
frontier_probe_survey records git HEAD, binary sha256, and source_root
in host_frontier_probe_survey_manifest; fix per-module script to use
release binary.

Co-authored-by: Cursor <cursoragent@cursor.com>
Replace remaining surveyed/open wording with execution_measurement axes,
add dated census at 9f978aa, and state that 27/27 rerun waits for the
probe fix so manifests do not enshrine manifest-elision artifacts.

Co-authored-by: Cursor <cursoragent@cursor.com>
Bind commit↔tree via git.Inspect.ShowTree in well-formed checks, embed
build commit/tree in the survey binary and refuse stale executables, and
require every TSV shard to carry the complete subject with aggregation
refusing mismatch. Block 27/27 on #7762 final + #7767; land release
one-shot recipe in ci_layer_roots exclusion note.

Co-authored-by: Cursor <cursoragent@cursor.com>
git_object_id_from_untagged_hex already trims plumbing stdout; the
frontier_survey_git_stdout_line wrapper imported trim from v2.std.text
where it does not exist.

Co-authored-by: Cursor <cursoragent@cursor.com>
Operator ruling: last of #7776 → #7762 → #7767 → survey; three
provenance holes remain open; every shard must carry complete
FrontierSurveySubject with all 27 comparing exactly equal.

Co-authored-by: Cursor <cursoragent@cursor.com>
@gunbai-bot
gunbai-bot Bot force-pushed the session/sleek-pike-668-lane1-frontier-survey branch from 8a0a6bc to a88a28f Compare August 4, 2026 14:38
Brian Searls and others added 7 commits August 4, 2026 15:48
Carry probe_policy_revision on every TSV row and emit the measured literal in manifests; refuse dirty-worktree builds via BUILD_DIRTY; validate policy revision as structural ContentHash instead of tautological constant compare; document seed-only per-row subject enforcement on the carrier.

Co-authored-by: Cursor <cursoragent@cursor.com>
Variant patterns bind positionally (Fnv1a64(structural)), not with typed
field labels — the Colon form caused regen and heal_generated_artifacts to panic.

Co-authored-by: Cursor <cursoragent@cursor.com>
TSV loader rows default to FrontierProbeDetailAbsent to match main's
receipt shape; fmt import order.

Co-authored-by: Cursor <cursoragent@cursor.com>
@gunbai-bot
gunbai-bot Bot marked this pull request as ready for review August 5, 2026 17:47
Per-PR discovery omits src/v2/test/claim/long; offline local-recipe RED
on stub manifest is not a CI failure shape.

Co-authored-by: Cursor <cursoragent@cursor.com>
@cursor

cursor Bot commented Aug 5, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@gunbai-bot gunbai-bot Bot changed the title Lane 1: exact-head frontier survey (draft — blocked on #7762) Lane 1: exact-head frontier survey (provenance scaffolding — authoritative run on hold) Aug 5, 2026
Compare manifest probe_policy_revision against frontier_probe_policy_revision()
instead of reusing the source-roots digest shape check. Add --source-root dag to
survey_manifest_emit_args so the transport one-shot matches the shell recipe.

Co-authored-by: Cursor <cursoragent@cursor.com>
@gunbai-bot

gunbai-bot Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

review 48889 (REQUEST_CHANGES): fixed in 61cafcaa8.

Finding 1 — policy-revision well-formed check: Valid. frontier_survey_probe_policy_revision_holds was copy-pasted onto frontier_survey_source_roots_digest_holds (16-digit hex shape only). Now compares revision against frontier_probe_policy_revision() via compare_content_hash → ContentHashEqual, so hand-authored arbitrary structural hashes no longer pass the .dag consumer path.

Finding 2 — transport vs shell source roots: Valid. survey_manifest_emit_args now passes --source-root src/v2 and --source-root dag, matching docs/probes/run_frontier_probe_survey_per_module.sh and the manifest aggregation path (same source_roots_digest contract).

— sent from sleek-pike-668

Co-authored-by: Cursor <cursoragent@cursor.com>
Brian Searls and others added 7 commits August 5, 2026 19:19
frontier_survey_probe_policy_revision_holds no longer wildcard-matches a
coproduct parameter after switching to compare_content_hash; the roster row
made non_fold_residue_stale_roster_count nonzero on CI.

Co-authored-by: Cursor <cursoragent@cursor.com>
Mark Rust digest helpers as seed duplicates with emit dissolve triggers,
rerun build.rs when survey bin sources change, and document src/v2-only
versus dag+src/v2 source-root non-combinability at 9f978aa.

Co-authored-by: Cursor <cursoragent@cursor.com>
Use [[ failures -ne 0 ]] so probe failures refuse manifest promotion.

Co-authored-by: Cursor <cursoragent@cursor.com>
…affolding.

Combine FrontierSurveySubject pinning with assemble_detail TSV columns,
merge frontier_probe_types imports, and align shell TSV header with bin wire.

Co-authored-by: Cursor <cursoragent@cursor.com>
Refresh closeout, provenance-holes, and offline-recipe notes after #7776,

Co-authored-by: Cursor <cursoragent@cursor.com>
#7762, and #7767 landed; document OOM-shell TSV projection limits post-#7767.
@briansrls
briansrls merged commit e83dafc into main Aug 6, 2026
5 checks passed
@briansrls
briansrls deleted the session/sleek-pike-668-lane1-frontier-survey branch August 6, 2026 00:39
gunbai-bot Bot pushed a commit that referenced this pull request Aug 6, 2026
Both #7763 and #7857 touched dag/gunbc/ci_layer_roots.dag, the same file this
branch deletes two long-lane roster rows from. The textual merge is clean, which
is exactly the case worth re-executing rather than trusting: a roster defect can
live only in the composition of two individually correct changes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant