Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions contracts/OMN-11513.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,9 @@ evidence_requirements:
- kind: "manual"
description: "onex_change_control PR #2203 carries the 2026-06-05 handoff reproduction evidence."
command: "See drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml"
- kind: "manual"
description: "onex_change_control PR #2301 carries the 2026-06-07 post-deploy cloud-tier retest evidence."
command: "See drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml"
emergency_bypass:
enabled: false
justification: ""
Expand Down Expand Up @@ -150,3 +153,11 @@ dod_evidence:
- check_type: "command"
check_value: "grep -q '^status: PASS$' drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml
&& grep -q '^pr_number: 2203$' drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml"
- id: "dod-occ-pr-2301"
description: "onex_change_control PR #2301 carries the 2026-06-07 post-deploy cloud-tier retest evidence."
source: "manual"
status: "verified"
checks:
- check_type: "command"
check_value: "grep -q '^status: PASS$' drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml
&& grep -q '^pr_number: 2301$' drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml"
Original file line number Diff line number Diff line change
Expand Up @@ -3,20 +3,21 @@ schema_version: "1.0.0"
ticket_id: "OMN-11513"
evidence_item_id: "dod-deploy-assessment-pr-1739"
check_type: "command"
check_value: "echo 'deploy-gate: OMN-11513 pricing manifest key alignment is configuration-only; no live
deploy before merge, post-merge deploy smoke remains the runtime validation surface'"
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
check_value: "gh pr view 1739 --repo OmniNode-ai/omnibase_infra --json number,state,headRefOid,mergedAt,mergeCommit"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-05-25T15:08:00Z"
commit_sha: "a21892cf47c4aa7fe88771d6d5a564a7e575595a"
runner: "codex-cli"
verifier: "codex"
probe_command: "echo 'deploy-gate: OMN-11513 pricing manifest key alignment is configuration-only; no
live deploy before merge, post-merge deploy smoke remains the runtime validation surface'"
probe_command: "gh pr view 1739 --repo OmniNode-ai/omnibase_infra --json number,state,headRefOid,mergedAt,mergeCommit
&& gh pr checks 1739 --repo OmniNode-ai/omnibase_infra --json name,state,workflow,bucket"
probe_stdout: |
deploy-gate: OMN-11513 pricing manifest key alignment is configuration-only; no live deploy before merge, post-merge deploy smoke remains the runtime validation surface
actual_output: "PASS: deploy-gate assessment recorded for omnibase_infra PR #1739; no live deploy, restart,
Kafka mutation, database mutation, or .201 mutation was performed before merge."
{"headRefOid":"0148132b06cc1ddf4f4d36302ea7c6930d4cdfe5","mergeCommit":{"oid":"dcbfa8e339f4baaece4c64943dca3a03de062070"},"mergedAt":"2026-05-25T18:17:58Z","number":1739,"state":"MERGED"}
gh pr checks inspected CI state for omnibase_infra PR #1739; tests gate and merge event checks were green, with the historical runtime boot smoke failure disclosed separately in the PR evidence.
actual_output: "PASS: deploy-gate assessment is backed by GitHub PR state and CI inspection for omnibase_infra
PR #1739. The PR merged at dcbfa8e339f4baaece4c64943dca3a03de062070; no live deploy, restart, Kafka
mutation, database mutation, or .201 mutation was performed by this receipt."
exit_code: 0
pr_number: 1739
branch: "jonah/omn-11513-b9-pricing-manifest-key-fix"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ actual_output: "PASS: full OCC test suite no longer fails on missing asyncpg; op
gaps are explicit skips."
exit_code: 0
pr_number: 1323
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
branch: "jonah/omn-11513-occ-receipt-evidence"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control"
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1323/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ probe_stdout: |
actual_output: "PASS: onex_change_control PR #1323 is open and binds OMN-11513 OCC evidence to head c5e191f7a4ad90d2f597e406802aad3b1eb562f5."
exit_code: 0
pr_number: 1323
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
branch: "jonah/omn-11513-occ-receipt-evidence"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control"
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1607/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-1607"
check_type: "command"
check_value: "gh pr view 1607 --repo OmniNode-ai/onex_change_control --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-05-25T14:48:00Z"
commit_sha: "0aa641dc5d1cffd015d1a30dee2aad5cb6cc18d5"
Expand Down
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1608/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-1608"
check_type: "command"
check_value: "gh pr view 1608 --repo OmniNode-ai/onex_change_control --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-05-25T15:08:00Z"
commit_sha: "1e0159288e3a3784163fd49f9fcb0ecd6a8d5236"
Expand Down
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1886/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ actual_output: "PASS: onex_change_control PR #1886 carries the OMN-11513 Days 1-
bundle."
exit_code: 0
pr_number: 1886
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
branch: "clone45/omn-11513-integration-evidence-days-1-7"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control-pr1886"
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-2166"
check_type: "command"
check_value: "grep -q '^pr_number: 2166$' \"$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml\""
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-06-04T17:36:00Z"
commit_sha: "6b52cec72b2f43685b1cd5cd78d56a80cdb8296d"
Expand Down
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-2176/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-2176"
check_type: "command"
check_value: "grep -q '^pr_number: 2176$' \"$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-11513/dod-occ-pr-2176/command.yaml\""
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-06-05T02:54:00Z"
commit_sha: "aec52162ab3a65c9ba89ff02448e2dafd379e844"
Expand Down
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-2203"
check_type: "command"
check_value: "grep -q '^pr_number: 2203$' \"$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml\""
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-06-07T13:50:00Z"
commit_sha: "1741235a54cbc83466bc2ef220fe6f6a183cc31f"
Expand Down
21 changes: 21 additions & 0 deletions drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
---
schema_version: "1.0.0"
ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-2301"
check_type: "command"
check_value: "grep -q '^pr_number: 2301$' drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-06-08T15:05:00Z"
commit_sha: "ccc5d7e8673cb04f6909e3ab22391599033edea9"
branch: "clone45/omn-11513-evidence-2026-06-07-postdeploy-retest"
runner: "codex-pr-sweep-20260608"
verifier: "gh-pr-view"
probe_command: "gh pr view 2301 --repo OmniNode-ai/onex_change_control --json number,state,headRefOid,baseRefName,title"
probe_stdout: |
{"baseRefName":"dev","headRefOid":"ccc5d7e8673cb04f6909e3ab22391599033edea9","number":2301,"state":"OPEN","title":"docs(OMN-11513): cloud-tier retest log through 2026-06-07 — post-deploy verification failed on runtime v0.38.3"}
actual_output: "PASS: onex_change_control PR #2301 carries the OMN-11513 2026-06-07 post-deploy cloud-tier
retest evidence at head ccc5d7e8673cb04f6909e3ab22391599033edea9."
exit_code: 0
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513-pr2301/onex_change_control"
pr_number: 2301
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ actual_output: "PASS: omni_home PR #145 is open and carries the OMN-11513 plan/e
7f20351afd25fb58c2cd94f7b5be9a166b3b394b."
exit_code: 0
pr_number: 145
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
branch: "jonah/omn-11513-may-monthly-integration-testing-plan-may-1-22"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/omni_home"
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-omnibase-infra-pr-1735"
check_type: "command"
check_value: "gh pr view 1735 --repo OmniNode-ai/omnibase_infra --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-05-25T14:45:00Z"
commit_sha: "fed67777c6034ee0f88496722ea1d88c46aef31a"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-omnibase-infra-pr-1739"
check_type: "command"
check_value: "gh pr view 1739 --repo OmniNode-ai/omnibase_infra --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
status: PASS
run_timestamp: "2026-05-25T15:02:00Z"
commit_sha: "a21892cf47c4aa7fe88771d6d5a564a7e575595a"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,6 @@ probe_stdout: |
actual_output: "PASS: .201 stability runtime exposes /v1/introspection/manifest and OMN-11513 evidence
recorded synthetic delegation correlation 1efcd854-f2cf-49b2-8772-8e2595b58b1b."
exit_code: 0
contract_sha256: "sha256:b7709ccc90ebec21d602fed96e779fbaa72f3695d7627837be9b79754778d0ed"
contract_sha256: "sha256:5f5b090ac9419606cd8f2c5dbf95ed7597253c0aaa99648f5c92d730f52160ec"
branch: "jonah/omn-11513-may-monthly-integration-testing-plan-may-1-22"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/omni_home"
6 changes: 3 additions & 3 deletions evidence/OMN-11513/EVIDENCE_MANIFEST.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@

**Ticket:** OMN-11513 (May Monthly Integration Testing Plan)
**Engagement:** OmniNode Hackathon Integration — contractor Bret (clone45@gmail.com)
**Period covered:** 2026-05-19 through 2026-06-05
**Last updated:** 2026-06-05
**Period covered:** 2026-05-19 through 2026-06-07
**Last updated:** 2026-06-07

---

Expand All @@ -18,7 +18,7 @@
| `2026-05-26-day5-findings.md` | 2026-05-26 | Day-5 follow-on findings (previously merged; manifest row added 2026-06-04). | **Current** |
| `2026-05-29-bret-day7-findings.md` + `2026-05-29-bret-day7-evidence-manifest.json` | 2026-05-29 | Day-7 findings + typed evidence manifest (previously merged; manifest row added 2026-06-04). | **Current** |
| `2026-05-30-bret-obj1-token-registry-stability.md` | 2026-05-30 | Objective 1 evidence: SEA token + model-registry stability. SEA dev `13127a7`; registry blob `ca392b6f`; remote-live (Tailscale) + local. Authored 2026-05-30, ported to OCC 2026-06-04. | **Current** |
| `2026-06-05-handoff-reproduction/` | 2026-06-05 | Reproduction of the 2026-06-05 handoff proofs from the contractor seat (SEA dev `c553ceb`). SEA `--agent` e2e: **PASS, classified PROOF** per the handoff criteria (bus_backed, stability overlay, no fallback, correlation `affbaf27-…`, generated `status_health_checker` validated/registered/invoked → `{"is_healthy": true}`). Keyless variant: typed credential error (diagnostic — key still required; contract ADK backend selects cloud Gemini). InferenceClient smoke: blocked unpatched (`MaxContextTokensResolutionError` — omnimarket PR #1054 is the gate), then **clean pass under a disclosed temporary local mirror of the .201 routing-tier hotpatch** (diagnostic, never proof; correlation `93c2ade4-…`; patch applied/verified/reverted same hour). **PM update: the smoke now passes UNPATCHED** after the released omnimarket package picked up the routing change (resolver verified failing at 11:00 PT post-revert, passing at 14:58 PT after `uv sync`; correlation `e5a9ecbb-…`, `healthy=true`, 24576 context) — both handoff proofs reproduced. Companion folder `2026-06-05-cloud-tier-retest/`: two forced-escalation runs after infra#1872 merged (20:45Z, 21:30Z) still show the two-URL 404 — fix merged, stability runtime not yet redeployed (correlations `eb671856-…`, `489f8b3b-…`). Cost-observability note: the PROOF run reports $0.0000 despite cloud Gemini serving via ADK. | **Current — first PROOF-classified contractor run** |
| `2026-06-05-handoff-reproduction/` | 2026-06-05 | Reproduction of the 2026-06-05 handoff proofs from the contractor seat (SEA dev `c553ceb`). SEA `--agent` e2e: **PASS, classified PROOF** per the handoff criteria (bus_backed, stability overlay, no fallback, correlation `affbaf27-…`, generated `status_health_checker` validated/registered/invoked → `{"is_healthy": true}`). Keyless variant: typed credential error (diagnostic — key still required; contract ADK backend selects cloud Gemini). InferenceClient smoke: blocked unpatched (`MaxContextTokensResolutionError` — omnimarket PR #1054 is the gate), then **clean pass under a disclosed temporary local mirror of the .201 routing-tier hotpatch** (diagnostic, never proof; correlation `93c2ade4-…`; patch applied/verified/reverted same hour). **PM update: the smoke now passes UNPATCHED** after the released omnimarket package picked up the routing change (resolver verified failing at 11:00 PT post-revert, passing at 14:58 PT after `uv sync`; correlation `e5a9ecbb-…`, `healthy=true`, 24576 context) — both handoff proofs reproduced. Companion folder `2026-06-05-cloud-tier-retest/`: now four forced-escalation runs. #1–#2 post-merge (2026-06-05 20:45Z/21:30Z, correlations `eb671856-…`, `489f8b3b-…`): 404 persists, runtime not yet redeployed. #3 (2026-06-06): DISCARDED — broker outage/transport, no conclusion. #4 (2026-06-07 16:18Z, correlation `1fbfd700-…`): **post-deploy verification FAILED** — runtime observed at v0.38.3 (healthy, via `:18085/health` at test time) and the identical two-URL 404 persists. Trailing whitespace note: log appended across days; trimmed at port time. Cost-observability note: the PROOF run reports $0.0000 despite cloud Gemini serving via ADK. | **Current — first PROOF-classified contractor run** |
| `2026-06-04-judge-dryrun/` | 2026-06-04 | Judge-experience dry run: fresh anonymous clone of the public repo (default branch `dev` @ `106e88c`), no env vars, README four-command judge flow. PASS: clone, `uv sync`, unit suite (1376 passed/1 skipped), keyless `--demo` (replay/fixture), `--replay`. FAIL: keyed `--agent` (`SeaKafkaReadinessError`, ~30s hang, default overlay bootstrap `localhost:19092` unreachable — fail-closed #206 gating the judge path) and native entropy demo (`DelegationBusRuntimeNotWiredError`, 0 tracks). Artifacts: dryrun.log, agent-keyed.log, demo-keyless.log, entropy-native.log, clone-info.txt. | **Current — judge-facing README/architecture divergence evidence** |

### proof-of-life/
Expand Down
Loading
Loading