Skip to content

tech-radar: 5 rows from Amara 8th-ferry recommendations (semantic hashing / LSH / HNSW / PQ / quantum illumination / Substrait)#276

Merged
AceHack merged 1 commit intomainfrom
tech-radar/8th-ferry-row-additions
Apr 24, 2026
Merged

tech-radar: 5 rows from Amara 8th-ferry recommendations (semantic hashing / LSH / HNSW / PQ / quantum illumination / Substrait)#276
AceHack merged 1 commit intomainfrom
tech-radar/8th-ferry-row-additions

Conversation

@AceHack
Copy link
Copy Markdown
Member

@AceHack AceHack commented Apr 24, 2026

Summary

Five rows added to TECH-RADAR per Amara's 8th courier ferry (PR #274) landing plan. Closes 8th-ferry absorb candidate #5 of 5.

Rows added

Techniques:

  • Semantic hashing · Assess
  • Locality-sensitive hashing · Assess
  • HNSW · Assess
  • Product quantization · Assess
  • Quantum illumination · Assess (low-SNR sensing theory) + explicit Hold-note for long-range product claims

Tools/infra:

  • Substrait · Stronger Assess (P2 persistable-IR gap)

Scoping discipline preserved

Quantum-illumination row carries explicit "do not operationalize without promotion" framing per Amara's 8th-ferry discipline + AGENTS.md absorb rule. 2024 engineering review caps microwave QR at <1 km typical — Hold-note is explicit so future readers don't mistake Assess-for-low-SNR-theory for Assess-for-long-range-radar.

Authority

Within standing authority per Otto-82 calibration — pure TECH-RADAR row-addition; not gated.

Remaining 8th-ferry candidate queue

# Item Status
1 Quantum-sensing research doc (S) Remaining
2 Semantic-canonicalization research doc (M; spine) Remaining
3 Provenance-aware bullshit-detector research doc (M) Remaining
4 docs/EVIDENCE-AND-AGREEMENT.md future operational promotion Gated on 1-3
5 TECH-RADAR 5-row batch This PR — closes

Test plan

🤖 Generated with Claude Code

Five rows added per Amara's 8th courier ferry (PR #274)
landing plan:

**Techniques section (4 rows):**

- Semantic hashing (Assess) — Hinton/Salakhutdinov; real
  technical family for "rainbow table" intuition.
- Locality-sensitive hashing (Assess) — Charikar; sibling
  collision framework.
- HNSW (Assess) — graph-based ANN with logarithmic scaling;
  Trial-promotion contingent on prototype.
- Product quantization (Assess) — compressed vector search
  at scale.
- Quantum illumination (Assess for low-SNR sensing theory;
  explicit Hold-note for long-range product claims per 2024
  engineering review). Importable as analogy for low-SNR
  software detection with retained-reference-path; NOT as
  operational quantum-radar capability.

**Tools/infra section (1 row):**

- Substrait (Stronger Assess) — cross-language relational-
  algebra plan format; answers P2 persistable-IR gap; Bonsai-
  vs-Substrait strategic-question scope like the declarative-
  env-parity row.

All 5 rows cross-reference the 8th-ferry absorb at
`docs/aurora/2026-04-23-amara-physics-analogies-semantic-
indexing-cutting-edge-gaps-8th-ferry.md` (PR #274).

Preserves the "do not operationalize without promotion"
quantum-radar discipline from both Amara's ferry and
AGENTS.md absorb rule. Hold-note on long-range claims is
explicit so future readers don't mistake Assess-for-low-
SNR-theory for Assess-for-long-range-radar.

Ring column uses `—` for round-number since these are
Amara-attributed external research recommendations, not
in-repo research passes. Precedent: other Assess rows with
no round-specific origin use `—`.

Lands within-standing-authority per Otto-82 calibration —
pure TECH-RADAR row-addition; not account/spending/named-
design-review gated.

Closes 8th-ferry candidate BACKLOG row #5 of 5. Remaining
candidates:
- Quantum-sensing research doc (S)
- Semantic-canonicalization research doc (M) — spine
- Provenance-aware bullshit-detector research doc (M)
- docs/EVIDENCE-AND-AGREEMENT.md future operational
  promotion (gated on 3 research docs)

Otto-96 tick primary deliverable.
Copilot AI review requested due to automatic review settings April 24, 2026 03:40
@AceHack AceHack enabled auto-merge (squash) April 24, 2026 03:40
@AceHack AceHack merged commit de0b6bd into main Apr 24, 2026
12 checks passed
@AceHack AceHack deleted the tech-radar/8th-ferry-row-additions branch April 24, 2026 03:42
Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7fefe2b321

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread docs/TECH-RADAR.md
| F\* extraction to F# | Assess | 35 | Successor path after the LiquidF# Hold. F\* is actively maintained and can extract to F#; a 2-3 week PoC on `FastCdc.fs` is the proposed next move for the off-by-one / bad-index bug class. See `docs/research/liquidfsharp-findings.md` §"Path A". |
| Dafny / F* / Isabelle / Stainless / P# | Assess | 18 | Enumerated in `docs/research/proof-tool-coverage.md`; each catches a different bug class. |
| Category theory as code-contract grammar | Adopt | 12 | `docs/category-theory/` |
| Semantic hashing | Assess | — | Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed by Amara 8th ferry (PR #274) as real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md`. |
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Replace dangling source path with an existing document

This new row points to docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md, but that file is not present in the repository at this commit, so the provenance trail for this Assess entry is broken for readers trying to verify the claim. Please either add the referenced document in the same change or update the note to an existing source path.

Useful? React with 👍 / 👎.

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds new TECH-RADAR entries capturing items from the 8th-ferry absorb work, focusing on semantic indexing techniques plus one query-plan IR interoperability tool.

Changes:

  • Added 5 new Techniques rows (semantic hashing, LSH, HNSW, product quantization, quantum illumination).
  • Added 1 new Tools / infra row (Substrait).

Comment thread docs/TECH-RADAR.md
Comment on lines +57 to +61
| Semantic hashing | Assess | — | Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed by Amara 8th ferry (PR #274) as real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md`. |
| Locality-sensitive hashing (LSH) | Assess | — | Charikar — formal collision framework where similarity drives hash agreement. Sibling to semantic hashing; complementary mechanism. Proposed by Amara 8th ferry for the semantic-canonicalization research doc spine. |
| HNSW (Hierarchical Navigable Small World) | Assess | — | Graph-based approximate nearest-neighbour index with logarithmic scaling + strong empirical performance. Candidate retrieval structure for the provenance-aware-bullshit-detector if a prototype lands. Proposed by Amara 8th ferry; `Trial` promotion contingent on prototype evidence. |
| Product quantization | Assess | — | Compressed vector search at scale; memory-efficient large corpora. Optional compression layer under HNSW / ANN retrieval. Proposed by Amara 8th ferry. |
| Quantum illumination (low-SNR sensing theory) | Assess | — | Lloyd 2008 + Tan et al. Gaussian-state 6 dB error-exponent advantage. Importable as **analogy for low-SNR software detection with retained-reference-path**, NOT as operational quantum-radar capability. 2024 engineering review (Amara 8th ferry) caps microwave QR range at <1 km typical — **Hold for long-range product claims**. Composes with SD-9 carrier-aware framing. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md` §Quantum-radar-analogy-boundaries. |
Copy link

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The referenced doc path docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md doesn’t exist in the repository (and the cited §Quantum-radar-analogy-boundaries anchor can’t be validated). Please update these rows to point at an existing in-repo document (or add the missing doc in the appropriate PR) so the Tech Radar stays fully navigable.

Suggested change
| Semantic hashing | Assess || Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed by Amara 8th ferry (PR #274) as real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md`. |
| Locality-sensitive hashing (LSH) | Assess || Charikar — formal collision framework where similarity drives hash agreement. Sibling to semantic hashing; complementary mechanism. Proposed by Amara 8th ferry for the semantic-canonicalization research doc spine. |
| HNSW (Hierarchical Navigable Small World) | Assess || Graph-based approximate nearest-neighbour index with logarithmic scaling + strong empirical performance. Candidate retrieval structure for the provenance-aware-bullshit-detector if a prototype lands. Proposed by Amara 8th ferry; `Trial` promotion contingent on prototype evidence. |
| Product quantization | Assess || Compressed vector search at scale; memory-efficient large corpora. Optional compression layer under HNSW / ANN retrieval. Proposed by Amara 8th ferry. |
| Quantum illumination (low-SNR sensing theory) | Assess || Lloyd 2008 + Tan et al. Gaussian-state 6 dB error-exponent advantage. Importable as **analogy for low-SNR software detection with retained-reference-path**, NOT as operational quantum-radar capability. 2024 engineering review (Amara 8th ferry) caps microwave QR range at <1 km typical — **Hold for long-range product claims**. Composes with SD-9 carrier-aware framing. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md` §Quantum-radar-analogy-boundaries. |
| Semantic hashing | Assess || Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed by Amara 8th ferry (PR #274) as real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. |
| Locality-sensitive hashing (LSH) | Assess || Charikar — formal collision framework where similarity drives hash agreement. Sibling to semantic hashing; complementary mechanism. Proposed by Amara 8th ferry for the semantic-canonicalization research doc spine. |
| HNSW (Hierarchical Navigable Small World) | Assess || Graph-based approximate nearest-neighbour index with logarithmic scaling + strong empirical performance. Candidate retrieval structure for the provenance-aware-bullshit-detector if a prototype lands. Proposed by Amara 8th ferry; `Trial` promotion contingent on prototype evidence. |
| Product quantization | Assess || Compressed vector search at scale; memory-efficient large corpora. Optional compression layer under HNSW / ANN retrieval. Proposed by Amara 8th ferry. |
| Quantum illumination (low-SNR sensing theory) | Assess || Lloyd 2008 + Tan et al. Gaussian-state 6 dB error-exponent advantage. Importable as **analogy for low-SNR software detection with retained-reference-path**, NOT as operational quantum-radar capability. 2024 engineering review (Amara 8th ferry) caps microwave QR range at <1 km typical — **Hold for long-range product claims**. Composes with SD-9 carrier-aware framing. |

Copilot uses AI. Check for mistakes.
Comment thread docs/TECH-RADAR.md
Comment on lines +57 to +61
| Semantic hashing | Assess | — | Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed by Amara 8th ferry (PR #274) as real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md`. |
| Locality-sensitive hashing (LSH) | Assess | — | Charikar — formal collision framework where similarity drives hash agreement. Sibling to semantic hashing; complementary mechanism. Proposed by Amara 8th ferry for the semantic-canonicalization research doc spine. |
| HNSW (Hierarchical Navigable Small World) | Assess | — | Graph-based approximate nearest-neighbour index with logarithmic scaling + strong empirical performance. Candidate retrieval structure for the provenance-aware-bullshit-detector if a prototype lands. Proposed by Amara 8th ferry; `Trial` promotion contingent on prototype evidence. |
| Product quantization | Assess | — | Compressed vector search at scale; memory-efficient large corpora. Optional compression layer under HNSW / ANN retrieval. Proposed by Amara 8th ferry. |
| Quantum illumination (low-SNR sensing theory) | Assess | — | Lloyd 2008 + Tan et al. Gaussian-state 6 dB error-exponent advantage. Importable as **analogy for low-SNR software detection with retained-reference-path**, NOT as operational quantum-radar capability. 2024 engineering review (Amara 8th ferry) caps microwave QR range at <1 km typical — **Hold for long-range product claims**. Composes with SD-9 carrier-aware framing. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md` §Quantum-radar-analogy-boundaries. |
Copy link

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These new rows add direct contributor/agent name attribution (“Amara …”). This conflicts with the repo’s operational standing rule to use role references in code/docs/skill bodies and keep contributor names confined to memory/persona/<name>/ (and optionally docs/BACKLOG.md). Please rephrase to a role-based reference (e.g., “the 8th ferry absorb (PR #274)”) while keeping the PR cross-reference.

Suggested change
| Semantic hashing | Assess || Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed by Amara 8th ferry (PR #274) as real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md`. |
| Locality-sensitive hashing (LSH) | Assess || Charikar — formal collision framework where similarity drives hash agreement. Sibling to semantic hashing; complementary mechanism. Proposed by Amara 8th ferry for the semantic-canonicalization research doc spine. |
| HNSW (Hierarchical Navigable Small World) | Assess || Graph-based approximate nearest-neighbour index with logarithmic scaling + strong empirical performance. Candidate retrieval structure for the provenance-aware-bullshit-detector if a prototype lands. Proposed by Amara 8th ferry; `Trial` promotion contingent on prototype evidence. |
| Product quantization | Assess || Compressed vector search at scale; memory-efficient large corpora. Optional compression layer under HNSW / ANN retrieval. Proposed by Amara 8th ferry. |
| Quantum illumination (low-SNR sensing theory) | Assess || Lloyd 2008 + Tan et al. Gaussian-state 6 dB error-exponent advantage. Importable as **analogy for low-SNR software detection with retained-reference-path**, NOT as operational quantum-radar capability. 2024 engineering review (Amara 8th ferry) caps microwave QR range at <1 km typical — **Hold for long-range product claims**. Composes with SD-9 carrier-aware framing. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md` §Quantum-radar-analogy-boundaries. |
| Semantic hashing | Assess || Hinton & Salakhutdinov — maps semantically similar documents to nearby binary-hash addresses. Proposed in the 8th ferry absorb (PR #274) as the real technical family for the "rainbow table" intuition; not the password kind. Candidate substrate for the provenance-aware-bullshit-detector research doc. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md`. |
| Locality-sensitive hashing (LSH) | Assess || Charikar — formal collision framework where similarity drives hash agreement. Sibling to semantic hashing; complementary mechanism. Proposed in the 8th ferry absorb (PR #274) for the semantic-canonicalization research doc spine. |
| HNSW (Hierarchical Navigable Small World) | Assess || Graph-based approximate nearest-neighbour index with logarithmic scaling + strong empirical performance. Candidate retrieval structure for the provenance-aware-bullshit-detector if a prototype lands. Proposed in the 8th ferry absorb (PR #274); `Trial` promotion contingent on prototype evidence. |
| Product quantization | Assess || Compressed vector search at scale; memory-efficient large corpora. Optional compression layer under HNSW / ANN retrieval. Proposed in the 8th ferry absorb (PR #274). |
| Quantum illumination (low-SNR sensing theory) | Assess || Lloyd 2008 + Tan et al. Gaussian-state 6 dB error-exponent advantage. Importable as **analogy for low-SNR software detection with retained-reference-path**, NOT as operational quantum-radar capability. The 2024 engineering review from the 8th ferry absorb (PR #274) caps microwave QR range at <1 km typical — **Hold for long-range product claims**. Composes with SD-9 carrier-aware framing. See `docs/aurora/2026-04-23-amara-physics-analogies-semantic-indexing-cutting-edge-gaps-8th-ferry.md` §Quantum-radar-analogy-boundaries. |

Copilot uses AI. Check for mistakes.
Comment thread docs/TECH-RADAR.md
| `../scratch` declarative-bootstrap harness (package manifests per ecosystem, profile/category composition, mise-unified runtimes, docker reproductions of GHA runners) | Assess | 39 | Named ethos-reference in two P1 BACKLOG entries (env-parity + CI meta-loop) without explicit pattern-inheritance contract. Time-budgeted ~1.5d research pass to classify patterns (already-in-Zeta / worth-porting / scratch-specific / flow-other-way) and produce `docs/research/scratch-zeta-parity.md`. See BACKLOG P1 "`../scratch` ↔ `Zeta` declarative-bootstrap parity". |
| Declarative environment-parity stack (Argo CD / Flux / Kustomize / Helm / Pulumi / Crossplane / Tilt / Skaffold / Okteto / KCL / CUE / OPA-Gatekeeper / Kyverno candidates) | Assess | 39 | **Time-budgeted research pass.** Aaron 2026-04-20 ask: same declarative spec valid from dev-inner-loop (kind) through qa/dev/stage/prod, non-bespoke. Budget: 7 days split 1d landscape scan -> 3d shortlist deep-dive -> 2d env-parity finalist evaluation -> 1d synthesis ADR. Individual tools graduate to Trial/Adopt/Hold per finalist evaluation. See `docs/BACKLOG.md` P1 "Declarative parity across dev-inner-loop / qa / dev / stage / prod" for the scope; sibling P1 entry on CI meta-loop + retractable CD. |
| bun + TypeScript (post-setup scripting default) | Trial | 43 | Round-43 adoption for post-`dotnet`-setup scripting. Replaces bash-per-script drift (the round-43 `tally.sh` pivot exposed the cost). First in-tree artefact: `tools/invariant-substrates/tally.ts` (bun Glob + `node:fs/promises`, no third-party runtime deps). Scaffold: `package.json` (pinned `bun@1.3.13`, bun-runtime only — `"type": "module"`, no `tsx`/`ts-node`), `tsconfig.json` cranked-to-11 (strict + `noUncheckedIndexedAccess` + `exactOptionalPropertyTypes` + `verbatimModuleSyntax` + `erasableSyntaxOnly` + `isolatedModules` + `noImplicitOverride`), `eslint.config.ts` strict-type-checked + stylistic-type-checked + sonarjs + `reportUnusedDisableDirectives`, `prettier` + `prettier-plugin-toml`, `markdownlint-cli2`. Excludes hardened across `tsconfig.json` / `bunfig.toml` / `eslint.config.ts` / `.prettierignore` to skip `references/upstreams/**` (~13 GB), `tools/lean4/.lake/**` (~7 GB), `tools/alloy/**`, `tools/tla/**`, `**/BenchmarkDotNet.Artifacts/**`, `**/TestResults/**`, `**/artifacts/**`, `**/bin/**`, `**/obj/**` — SQLSharp lesson: missing the upstream allowlist destroyed language-server perf until the `defaultRepoPathIgnorePatterns` helper shape was adopted. Latest-version audit done at ADR time (`docs/DECISIONS/2026-04-20-tools-scripting-language.md` §Latest-version audit). **Watchlist** (rails for the assumptions): (a) bun on Windows-from-source still maturing — Zeta maintainers are macOS/Linux today, re-audit if Windows becomes a CI target; (b) `erasableSyntaxOnly` presumes bun runs `.ts` without JS emit — re-audit if bun ever ships a JS-compilation pass; (c) `@types/bun 1.3.12` lags the `bun@1.3.13` runtime by one patch (DefinitelyTyped lag, not a bug), exception tracked inline in ADR. Graduates to Adopt once (1) a second in-tree `.ts` script lands, (2) no watchlist triggers fire for 5 rounds, (3) tally.ts + at least one other tool are invoked on round-close. |
| Substrait (cross-language serialised relational-algebra plan format) | Assess | — | Answers a real P2 gap named in Amara 8th ferry (PR #274): Zeta's persistable query IR (IQbservable / Reaqtor-style Bonsai slim IR) sits at P2 only; Substrait + DataFusion Substrait-serde already exist. Strategic question — repo-local Bonsai vs Substrait interop target. **Stronger `Assess`** per 8th ferry (not `Trial` yet; 7-day research-pass scope like the declarative-env-parity row). Cross-reference Amara's cutting-edge-gaps catalogue. |
Copy link

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Grammar: “Substrait + DataFusion Substrait-serde already exist” should use singular agreement (e.g., “already exists”) or reword the subject to be plural.

Suggested change
| Substrait (cross-language serialised relational-algebra plan format) | Assess || Answers a real P2 gap named in Amara 8th ferry (PR #274): Zeta's persistable query IR (IQbservable / Reaqtor-style Bonsai slim IR) sits at P2 only; Substrait + DataFusion Substrait-serde already exist. Strategic question — repo-local Bonsai vs Substrait interop target. **Stronger `Assess`** per 8th ferry (not `Trial` yet; 7-day research-pass scope like the declarative-env-parity row). Cross-reference Amara's cutting-edge-gaps catalogue. |
| Substrait (cross-language serialised relational-algebra plan format) | Assess || Answers a real P2 gap named in Amara 8th ferry (PR #274): Zeta's persistable query IR (IQbservable / Reaqtor-style Bonsai slim IR) sits at P2 only; Substrait and DataFusion's Substrait serde already exist. Strategic question — repo-local Bonsai vs Substrait interop target. **Stronger `Assess`** per 8th ferry (not `Trial` yet; 7-day research-pass scope like the declarative-env-parity row). Cross-reference Amara's cutting-edge-gaps catalogue. |

Copilot uses AI. Check for mistakes.
Comment thread docs/TECH-RADAR.md
| `../scratch` declarative-bootstrap harness (package manifests per ecosystem, profile/category composition, mise-unified runtimes, docker reproductions of GHA runners) | Assess | 39 | Named ethos-reference in two P1 BACKLOG entries (env-parity + CI meta-loop) without explicit pattern-inheritance contract. Time-budgeted ~1.5d research pass to classify patterns (already-in-Zeta / worth-porting / scratch-specific / flow-other-way) and produce `docs/research/scratch-zeta-parity.md`. See BACKLOG P1 "`../scratch` ↔ `Zeta` declarative-bootstrap parity". |
| Declarative environment-parity stack (Argo CD / Flux / Kustomize / Helm / Pulumi / Crossplane / Tilt / Skaffold / Okteto / KCL / CUE / OPA-Gatekeeper / Kyverno candidates) | Assess | 39 | **Time-budgeted research pass.** Aaron 2026-04-20 ask: same declarative spec valid from dev-inner-loop (kind) through qa/dev/stage/prod, non-bespoke. Budget: 7 days split 1d landscape scan -> 3d shortlist deep-dive -> 2d env-parity finalist evaluation -> 1d synthesis ADR. Individual tools graduate to Trial/Adopt/Hold per finalist evaluation. See `docs/BACKLOG.md` P1 "Declarative parity across dev-inner-loop / qa / dev / stage / prod" for the scope; sibling P1 entry on CI meta-loop + retractable CD. |
| bun + TypeScript (post-setup scripting default) | Trial | 43 | Round-43 adoption for post-`dotnet`-setup scripting. Replaces bash-per-script drift (the round-43 `tally.sh` pivot exposed the cost). First in-tree artefact: `tools/invariant-substrates/tally.ts` (bun Glob + `node:fs/promises`, no third-party runtime deps). Scaffold: `package.json` (pinned `bun@1.3.13`, bun-runtime only — `"type": "module"`, no `tsx`/`ts-node`), `tsconfig.json` cranked-to-11 (strict + `noUncheckedIndexedAccess` + `exactOptionalPropertyTypes` + `verbatimModuleSyntax` + `erasableSyntaxOnly` + `isolatedModules` + `noImplicitOverride`), `eslint.config.ts` strict-type-checked + stylistic-type-checked + sonarjs + `reportUnusedDisableDirectives`, `prettier` + `prettier-plugin-toml`, `markdownlint-cli2`. Excludes hardened across `tsconfig.json` / `bunfig.toml` / `eslint.config.ts` / `.prettierignore` to skip `references/upstreams/**` (~13 GB), `tools/lean4/.lake/**` (~7 GB), `tools/alloy/**`, `tools/tla/**`, `**/BenchmarkDotNet.Artifacts/**`, `**/TestResults/**`, `**/artifacts/**`, `**/bin/**`, `**/obj/**` — SQLSharp lesson: missing the upstream allowlist destroyed language-server perf until the `defaultRepoPathIgnorePatterns` helper shape was adopted. Latest-version audit done at ADR time (`docs/DECISIONS/2026-04-20-tools-scripting-language.md` §Latest-version audit). **Watchlist** (rails for the assumptions): (a) bun on Windows-from-source still maturing — Zeta maintainers are macOS/Linux today, re-audit if Windows becomes a CI target; (b) `erasableSyntaxOnly` presumes bun runs `.ts` without JS emit — re-audit if bun ever ships a JS-compilation pass; (c) `@types/bun 1.3.12` lags the `bun@1.3.13` runtime by one patch (DefinitelyTyped lag, not a bug), exception tracked inline in ADR. Graduates to Adopt once (1) a second in-tree `.ts` script lands, (2) no watchlist triggers fire for 5 rounds, (3) tally.ts + at least one other tool are invoked on round-close. |
| Substrait (cross-language serialised relational-algebra plan format) | Assess | — | Answers a real P2 gap named in Amara 8th ferry (PR #274): Zeta's persistable query IR (IQbservable / Reaqtor-style Bonsai slim IR) sits at P2 only; Substrait + DataFusion Substrait-serde already exist. Strategic question — repo-local Bonsai vs Substrait interop target. **Stronger `Assess`** per 8th ferry (not `Trial` yet; 7-day research-pass scope like the declarative-env-parity row). Cross-reference Amara's cutting-edge-gaps catalogue. |
Copy link

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The legend defines rings as Adopt/Trial/Assess/Hold; the phrase “Stronger Assess” isn’t a defined status and may be confusing. Consider expressing the intended nuance in a more standard way (e.g., keep Ring = Assess and note “higher-priority assess”/“time-budgeted 7-day research pass” in plain text) so readers don’t infer a new ring level.

Suggested change
| Substrait (cross-language serialised relational-algebra plan format) | Assess || Answers a real P2 gap named in Amara 8th ferry (PR #274): Zeta's persistable query IR (IQbservable / Reaqtor-style Bonsai slim IR) sits at P2 only; Substrait + DataFusion Substrait-serde already exist. Strategic question — repo-local Bonsai vs Substrait interop target. **Stronger `Assess`** per 8th ferry (not `Trial` yet; 7-day research-pass scope like the declarative-env-parity row). Cross-reference Amara's cutting-edge-gaps catalogue. |
| Substrait (cross-language serialised relational-algebra plan format) | Assess || Answers a real P2 gap named in Amara 8th ferry (PR #274): Zeta's persistable query IR (IQbservable / Reaqtor-style Bonsai slim IR) sits at P2 only; Substrait + DataFusion Substrait-serde already exist. Strategic question — repo-local Bonsai vs Substrait interop target. Higher-priority assess per 8th ferry (not `Trial` yet; time-budgeted 7-day research-pass scope like the declarative-env-parity row). Cross-reference Amara's cutting-edge-gaps catalogue. |

Copilot uses AI. Check for mistakes.
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 24, 2026
…erry; candidate 5 of 5 closed

Bounded S-effort tick closing 8th-ferry candidate #5 via
PR #276 (5 rows added to TECH-RADAR: 4 Techniques
[semantic hashing / LSH / HNSW / PQ / quantum illumination]
+ 1 Tools/infra [Substrait]).

Quantum-illumination row preserves Amara's + AGENTS.md "do
not operationalize" discipline with explicit Hold-note for
long-range product claims per 2024 engineering review.

Key observations:

1. 8th-ferry queue: 1/5 closed (TECH-RADAR). Remaining: 3
   research docs + 1 future operational promotion; all
   within standing authority.
2. TECH-RADAR row-additions are lowest-cost highest-leverage
   "capture Amara's proposals" move; preserve provenance
   + future-discoverability; per-row research-effort
   deferred to warranted.
3. Quantum-illumination Assess-with-Hold-note is
   deterministic-reconciliation at TECH-RADAR layer — both
   directions preserved in same row so they can't drift.
4. Substrait Stronger-Assess flags P2 persistable-IR gap;
   strategic-scoping (Bonsai vs Substrait) without pre-
   committing.

Stacked on #275 (Otto-95 history).
AceHack added a commit that referenced this pull request Apr 26, 2026
AceHack added a commit that referenced this pull request Apr 26, 2026
…rsarial review — Aaron 2026-04-26 surfaced direct-to-main attack surface; owed since hour-04Z row 3

Aaron 2026-04-26: *"safer than direct merger to master too unless you get the branch protection rules right, a real risk of malicous user attacking heartbeat files with direct push to main likely"*

The threat surface I had been treating as operational-only is substantive: heartbeat files are load-bearing for AI cognition (Otto-339/340), corruption = cognition-poisoning. Specific attack vectors documented: repo compromise, force-push, insider, supply-chain, direct-to-main bypass.

Composes with Otto-346 sequencing (Bouncy Castle symbiosis foundation → signing infrastructure → per-commit attestation → direct-to-main safe). This row is the threat-model that justifies that sequencing.

Honest acknowledgment: this was owed since hour-04Z row 3 (~50 min ago); deferred during the heartbeat-only live-lock period Aaron caught. Filing now per Otto-341 discipline-correction: when work is genuinely owed and substantive, file it; don't let "noted" stand in for "captured."

P2 because: (a) current PR-path is safe; no urgent threat; (b) but task #276 + Otto-240 implementations will inherit the surface; better to land threat-model BEFORE the thing it threat-models.

Effort M. Workstream: threat-model write-up, Aminata adversarial review, docs/security/THREAT-MODEL.md heartbeat-files section, define "low gate" CI that survives threat-model, update #276 with blocker.

Composes with: Otto-339/340/341/342/344/345/346, Aminata persona, Task #276, Otto-238 retractability.

🤖 Generated with [Claude Code](https://claude.com/claude-code)
AceHack added a commit that referenced this pull request Apr 26, 2026
…rsarial review (P2) — Aaron 2026-04-26 direct-to-main attack surface (#552)

* backlog(B-0032): heartbeat-file integrity threat-model + Aminata adversarial review — Aaron 2026-04-26 surfaced direct-to-main attack surface; owed since hour-04Z row 3

Aaron 2026-04-26: *"safer than direct merger to master too unless you get the branch protection rules right, a real risk of malicous user attacking heartbeat files with direct push to main likely"*

The threat surface I had been treating as operational-only is substantive: heartbeat files are load-bearing for AI cognition (Otto-339/340), corruption = cognition-poisoning. Specific attack vectors documented: repo compromise, force-push, insider, supply-chain, direct-to-main bypass.

Composes with Otto-346 sequencing (Bouncy Castle symbiosis foundation → signing infrastructure → per-commit attestation → direct-to-main safe). This row is the threat-model that justifies that sequencing.

Honest acknowledgment: this was owed since hour-04Z row 3 (~50 min ago); deferred during the heartbeat-only live-lock period Aaron caught. Filing now per Otto-341 discipline-correction: when work is genuinely owed and substantive, file it; don't let "noted" stand in for "captured."

P2 because: (a) current PR-path is safe; no urgent threat; (b) but task #276 + Otto-240 implementations will inherit the surface; better to land threat-model BEFORE the thing it threat-models.

Effort M. Workstream: threat-model write-up, Aminata adversarial review, docs/security/THREAT-MODEL.md heartbeat-files section, define "low gate" CI that survives threat-model, update #276 with blocker.

Composes with: Otto-339/340/341/342/344/345/346, Aminata persona, Task #276, Otto-238 retractability.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

* fix(552): MD032 blanks-around-lists (lint, fix-markdown tool)
AceHack added a commit that referenced this pull request Apr 26, 2026
…urface (task #287) (#611)

The human maintainer 2026-04-26: "we need to get that resource/costs
monitoring done in the next few days ... so we can see the costs"

The two existing budget primitives (snapshot-burn.sh + project-runway.sh)
require manual orchestration to produce a glanceable surface. This wrapper
chains them and writes docs/budget-history/latest-report.md so the
maintainer can `cat` ONE file to see runway state.

## What this commits

- New file `tools/budget/daily-cost-report.sh` (~115 lines, exec-bit set,
  bash 3.2-portable per the same discipline as snapshot-burn.sh)
- Three flags: default (full run), `--dry-run` (passes to snapshot-burn,
  still writes report), `--skip-snapshot` (regenerates report from
  existing snapshots only — useful for testing + bootstrap)
- Writes `docs/budget-history/latest-report.md` (OVERWRITES, not append;
  history lives in snapshots.jsonl as append-only)
- Bootstrap path when snapshots.jsonl doesn't exist yet (writes a
  placeholder report explaining the N >= 2 prerequisite)

## What this does NOT commit

- The /schedule routine that runs this daily (per Otto-275 log-don't-implement
  + agent-autonomy-boundary; awaits explicit human-maintainer confirmation)
- Capture of the GitHub `Copilot over budget` signal the maintainer
  surfaced 2026-04-26 (LFG: $1.90 / $0 budget). The current
  `gh api /orgs/<org>/copilot/billing` endpoint returns seat info but
  not the spend-vs-budget signal — separate follow-up data-fetch work
- Direct-to-main commit of the daily report (gated on task #276 + B-0032)
- Slack / PR-comment alerting on EXCEEDS conditions

## Verification

- `bash -n` passes
- `--skip-snapshot` smoke test wrote a valid report file (then deleted
  pre-commit; the wrapper is the substrate, not the report itself)
- shellcheck clean (per the discipline; CI runs the lint)
- Per Otto-348 verify-substrate-exists: confirmed no existing wrapper
  (`ls tools/budget/daily-cost-report.sh tools/budget/cost-monitor.sh
  tools/budget/refresh-report.sh` — all absent) BEFORE drafting

Composes with: task #287 (this is sub-step 1 of the visibility-surface
deliverable), tools/budget/snapshot-burn.sh, tools/budget/project-runway.sh,
docs/budget-history/README.md, GOVERNANCE.md (no changes needed; this is
factory-internal tooling).
AceHack added a commit that referenced this pull request Apr 26, 2026
#620 supersession (#625)

Otto-347 2nd-agent verification (independent subagent audit) caught substrate loss when I closed #618 as 'superseded by #620': I had hallucinated #618's actual row contents. #618 carried 13:33+13:38+13:52+13:55+13:58Z; #620 captured only 13:33+13:55+13:58Z. The 13:38 and 13:52 rows were never on main.

Both rows extracted verbatim from preserved branches via 'git show <branch>:<path>' per Otto-238 retractability:
- 13:38:50Z (~2834 bytes): tick documenting Otto-348 origin material — the verify-substrate-exists discovery (tools/hygiene/append-tick-history-row.sh already existed); direct-to-main-tick-history is the actual substrate gap (task #276)
- 13:52:34Z (~3043 bytes): tick documenting task #287 sub-step 1 ship (PR #611 daily-cost-report wrapper) + LFG Copilot OVER BUDGET signal absorbed + agent-autonomy boundary on Copilot stop-usage decision

Source branches retained on origin per Otto-238: tick-history/2026-04-26T13-39Z (PR #607) and tick-history/2026-04-26T13-53Z (PR #612).

This is the fourth+1th use of the clean-reapply pattern this session — but importantly, the FIRST one triggered by 2nd-agent verification finding loss the same-agent verification missed. Direct empirical evidence Otto-347 is load-bearing AS WRITTEN ('would be good to ask another cli'), not just as same-agent diff.

Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
AceHack added a commit to AceHack/Zeta that referenced this pull request Apr 28, 2026
5 review findings on the tick-history PR:

1. Codex P1: pipe inside backticks (`Elisabeth\|elisabeth` regex) —
   even GFM-protected pipe-in-code-span triggered Codex's table-
   parser concern; replaced with `grep -rli elisabeth` (case-
   insensitive flag, no alternation, no pipe). Same fix applied to
   2 occurrences (rows 307 + 308).
2. Codex P1 (related): the `(research-grade\|operational)` regex
   citation in row 311 had the same shape; replaced with the
   English form `(research-grade or operational)` since the row
   was about explaining the rule, not running the regex.
3. Copilot P2: row 305 had inconsistent counts ("Audited 16 open
   AceHack PRs" + "4 DIRTY CONFLICTING" but listed 5 PR numbers
   #12/#29/#35/#36/#39). Real values: 5 DIRTY + 12 BLOCKED + 1
   UNKNOWN = 18 total. Fixed both numbers.
4. Copilot P2: stray empty parens "re-enabling a workflow file ()"
   in row 313 — unfinished edit. Removed.

PR title/description scope-mismatch (Copilot's other finding) is
inherent to the tick-history append pattern: each tick appends
to the same PR until merge. Per task Lucent-Financial-Group#276 the structural fix is
tick-history-direct-to-main with low gate. Updating title to
reflect the actual range.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants