Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions contracts/OMN-11513.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -118,3 +118,12 @@ dod_evidence:
- check_type: "command"
check_value: "grep -q '^status: PASS$' drift/dod_receipts/OMN-11513/dod-occ-pr-1886/command.yaml
&& grep -q '^pr_number: 1886$' drift/dod_receipts/OMN-11513/dod-occ-pr-1886/command.yaml"
- id: "dod-occ-pr-2166"
description: "onex_change_control PR #2166 carries the 2026-06-04 OMN-11513 sanctioned-live agent
evidence port."
source: "manual"
status: "verified"
checks:
- check_type: "command"
check_value: "grep -q '^status: PASS$' drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml
&& grep -q '^pr_number: 2166$' drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml"
11 changes: 11 additions & 0 deletions contracts/OMN-12664.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -94,3 +94,14 @@ dod_evidence:
check_value: >-
grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12664/dod-omnibase-infra-pr-1863-revert-1859/command.yaml"
&& grep -q '^pr_number: 1863$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12664/dod-omnibase-infra-pr-1863-revert-1859/command.yaml"
- id: "dod-occ-pr-2166-observation"
description: >-
onex_change_control PR #2166 carries the OMN-11513 evidence-port observation that the contractor
forced-escalation run still saw the OMN-12664 Gemini 404 signature on the live path after closure.
source: "manual"
status: "verified"
checks:
- check_type: "command"
check_value: >-
grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12664/dod-occ-pr-2166-observation/command.yaml"
&& grep -q '^pr_number: 2166$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12664/dod-occ-pr-2166-observation/command.yaml"
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ evidence_item_id: "dod-deploy-assessment-pr-1739"
check_type: "command"
check_value: "echo 'deploy-gate: OMN-11513 pricing manifest key alignment is configuration-only; no live
deploy before merge, post-merge deploy smoke remains the runtime validation surface'"
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
status: PASS
run_timestamp: "2026-05-25T15:08:00Z"
commit_sha: "a21892cf47c4aa7fe88771d6d5a564a7e575595a"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ actual_output: "PASS: full OCC test suite no longer fails on missing asyncpg; op
gaps are explicit skips."
exit_code: 0
pr_number: 1323
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
branch: "jonah/omn-11513-occ-receipt-evidence"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control"
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1323/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ probe_stdout: |
actual_output: "PASS: onex_change_control PR #1323 is open and binds OMN-11513 OCC evidence to head c5e191f7a4ad90d2f597e406802aad3b1eb562f5."
exit_code: 0
pr_number: 1323
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
branch: "jonah/omn-11513-occ-receipt-evidence"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control"
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1607/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-1607"
check_type: "command"
check_value: "gh pr view 1607 --repo OmniNode-ai/onex_change_control --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
status: PASS
run_timestamp: "2026-05-25T14:48:00Z"
commit_sha: "0aa641dc5d1cffd015d1a30dee2aad5cb6cc18d5"
Expand Down
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1608/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-1608"
check_type: "command"
check_value: "gh pr view 1608 --repo OmniNode-ai/onex_change_control --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
status: PASS
run_timestamp: "2026-05-25T15:08:00Z"
commit_sha: "1e0159288e3a3784163fd49f9fcb0ecd6a8d5236"
Expand Down
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-11513/dod-occ-pr-1886/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ actual_output: "PASS: onex_change_control PR #1886 carries the OMN-11513 Days 1-
bundle."
exit_code: 0
pr_number: 1886
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
branch: "clone45/omn-11513-integration-evidence-days-1-7"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control-pr1886"
21 changes: 21 additions & 0 deletions drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
---
schema_version: "1.0.0"
ticket_id: "OMN-11513"
evidence_item_id: "dod-occ-pr-2166"
check_type: "command"
check_value: "grep -q '^pr_number: 2166$' \"$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml\""
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
status: PASS
run_timestamp: "2026-06-04T17:36:00Z"
commit_sha: "6b52cec72b2f43685b1cd5cd78d56a80cdb8296d"
branch: "clone45/omn-11513-evidence-2026-06-04-agent-runs"
runner: "codex"
verifier: "codex-independent-review"
probe_command: "gh pr view 2166 --repo OmniNode-ai/onex_change_control --json number,headRefName,state"
probe_stdout: |
{"headRefName":"clone45/omn-11513-evidence-2026-06-04-agent-runs","number":2166,"state":"OPEN"}
actual_output: "PASS: onex_change_control PR #2166 carries the OMN-11513 2026-06-04 sanctioned-live agent
evidence port."
exit_code: 0
pr_number: 2166
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control-2166"
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@ actual_output: "PASS: omni_home PR #145 is open and carries the OMN-11513 plan/e
7f20351afd25fb58c2cd94f7b5be9a166b3b394b."
exit_code: 0
pr_number: 145
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
branch: "jonah/omn-11513-may-monthly-integration-testing-plan-may-1-22"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/omni_home"
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-omnibase-infra-pr-1735"
check_type: "command"
check_value: "gh pr view 1735 --repo OmniNode-ai/omnibase_infra --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
status: PASS
run_timestamp: "2026-05-25T14:45:00Z"
commit_sha: "fed67777c6034ee0f88496722ea1d88c46aef31a"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-11513"
evidence_item_id: "dod-omnibase-infra-pr-1739"
check_type: "command"
check_value: "gh pr view 1739 --repo OmniNode-ai/omnibase_infra --json number,state,headRefOid,headRefName,title"
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
status: PASS
run_timestamp: "2026-05-25T15:02:00Z"
commit_sha: "a21892cf47c4aa7fe88771d6d5a564a7e575595a"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,6 @@ probe_stdout: |
actual_output: "PASS: .201 stability runtime exposes /v1/introspection/manifest and OMN-11513 evidence
recorded synthetic delegation correlation 1efcd854-f2cf-49b2-8772-8e2595b58b1b."
exit_code: 0
contract_sha256: "sha256:714287db0a9975d90c928d0571187cdeb69885cdc65ee0a191a912f708b42e51"
contract_sha256: "sha256:4e27938739943fe0973da68d6234681188a5141db26ea35374122811df8bfe09"
branch: "jonah/omn-11513-may-monthly-integration-testing-plan-may-1-22"
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/omni_home"
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
---
schema_version: "1.0.0"
ticket_id: "OMN-12664"
evidence_item_id: "dod-occ-pr-2166-observation"
check_type: "command"
check_value: "grep -q '^pr_number: 2166$' \"$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12664/dod-occ-pr-2166-observation/command.yaml\""
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T17:36:00Z"
commit_sha: "6b52cec72b2f43685b1cd5cd78d56a80cdb8296d"
branch: "clone45/omn-11513-evidence-2026-06-04-agent-runs"
runner: "codex"
verifier: "codex-independent-review"
probe_command: "gh pr view 2166 --repo OmniNode-ai/onex_change_control --json number,headRefName,state"
probe_stdout: |
{"headRefName":"clone45/omn-11513-evidence-2026-06-04-agent-runs","number":2166,"state":"OPEN"}
actual_output: "PASS: PR #2166 records the OMN-12664 post-closure live-path 404 observation inside the
OMN-11513 evidence port."
exit_code: 0
pr_number: 2166
working_dir: "/Users/jonah/Code/omni_home/omni_worktrees/OMN-11513/onex_change_control-2166"
2 changes: 1 addition & 1 deletion drift/dod_receipts/OMN-12664/dod-occ-pr-self/command.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-12664"
evidence_item_id: "dod-occ-pr-self"
check_type: "command"
check_value: "gh pr view 2148 --repo OmniNode-ai/onex_change_control --json number,headRefName,baseRefName"
contract_sha256: "sha256:5590fb47a5945b9cea84fc610826fde8a462ab59694003c12236d2753445aa75"
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T09:10:00Z"
commit_sha: "063eb37dbd43ea82354100e1c296714766f93b81"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ evidence_item_id: "dod-omnibase-infra-pr-1859-final-url"
check_type: "command"
check_value: "uv run pytest tests/unit/nodes/node_llm_inference_effect/handlers/bifrost/test_bifrost_endpoint_preservation.py
-q"
contract_sha256: "sha256:5590fb47a5945b9cea84fc610826fde8a462ab59694003c12236d2753445aa75"
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T03:20:00Z"
commit_sha: "b60665cc96f95b4e1cf1a75e626d3a2feabd8cfd"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ evidence_item_id: "dod-omnibase-infra-pr-1859-non-gemini-unaffected"
check_type: "command"
check_value: "uv run pytest tests/unit/nodes/node_llm_inference_effect/handlers/bifrost/test_config_loader_bifrost.py
-q"
contract_sha256: "sha256:5590fb47a5945b9cea84fc610826fde8a462ab59694003c12236d2753445aa75"
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T03:21:00Z"
commit_sha: "b60665cc96f95b4e1cf1a75e626d3a2feabd8cfd"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ ticket_id: "OMN-12664"
evidence_item_id: "dod-omnibase-infra-pr-1863-revert-1859"
check_type: "command"
check_value: "uv run pytest tests/unit/nodes/node_llm_inference_effect/ -q"
contract_sha256: "sha256:5590fb47a5945b9cea84fc610826fde8a462ab59694003c12236d2753445aa75"
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T08:55:00Z"
commit_sha: "2be57777b22c8025da137a7a237e13194938d953"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ evidence_item_id: "dod-omnimarket-pr-1031-final-url"
check_type: "command"
check_value: "cd $OMNI_HOME/omni_worktrees/OMN-12664/omnimarket && uv run pytest tests/unit/nodes/node_generation_consumer/test_handler_generation_consumer.py
-k 'gemini or origin_only or endpoint_url_is_complete or old_base_url' -q"
contract_sha256: "sha256:5590fb47a5945b9cea84fc610826fde8a462ab59694003c12236d2753445aa75"
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T03:05:00Z"
commit_sha: "9535d3c6b"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ evidence_item_id: "dod-omnimarket-pr-1031-typed-failure"
check_type: "command"
check_value: "cd $OMNI_HOME/omni_worktrees/OMN-12664/omnimarket && uv run pytest tests/unit/nodes/node_generation_consumer/test_handler_generation_consumer.py::test_provider_error_remains_typed_failure_not_blank_success
-q"
contract_sha256: "sha256:5590fb47a5945b9cea84fc610826fde8a462ab59694003c12236d2753445aa75"
contract_sha256: "sha256:9d703691dc26d73cfeb3e1b4e619501045314bd038cd72afcd07d332b6e21a89"
status: PASS
run_timestamp: "2026-06-04T03:05:30Z"
commit_sha: "9535d3c6b"
Expand Down
24 changes: 22 additions & 2 deletions evidence/OMN-11513/EVIDENCE_MANIFEST.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@

**Ticket:** OMN-11513 (May Monthly Integration Testing Plan)
**Engagement:** OmniNode Hackathon Integration — contractor Bret (clone45@gmail.com)
**Period covered:** 2026-05-19 through 2026-05-24 (Days 1-7)
**Last updated:** 2026-05-24
**Period covered:** 2026-05-19 through 2026-06-04
**Last updated:** 2026-06-04

---

Expand All @@ -15,6 +15,9 @@
|---|---|---|---|
| `2026-05-21-first-integration-milestone.md` | Day 3 + Day 5 addendum | SOW §3.2 baseline report. Covers all 8 required line items + closing rubric (Top 3 blockers, Top 3 fixes, demo mode rubric, "what surprised you most?"). Day-5 addendum updates blockers + records full-chain achievement. | **Current** |
| `2026-05-24-integration-pass-report.md` | Day 7 | Fresh integration pass per Jonah's May 24 integration prompt plan. Covers A0-A3 + B + C + D workstreams on current main `62b87c2`. Most comprehensive single-session report of the engagement. | **Current** |
| `2026-05-26-day5-findings.md` | 2026-05-26 | Day-5 follow-on findings (previously merged; manifest row added 2026-06-04). | **Current** |
| `2026-05-29-bret-day7-findings.md` + `2026-05-29-bret-day7-evidence-manifest.json` | 2026-05-29 | Day-7 findings + typed evidence manifest (previously merged; manifest row added 2026-06-04). | **Current** |
| `2026-05-30-bret-obj1-token-registry-stability.md` | 2026-05-30 | Objective 1 evidence: SEA token + model-registry stability. SEA dev `13127a7`; registry blob `ca392b6f`; remote-live (Tailscale) + local. Authored 2026-05-30, ported to OCC 2026-06-04. | **Current** |

### proof-of-life/

Expand All @@ -23,6 +26,8 @@
| `2026-05-24-62b87c2-live-a1/` | Day 7 | Event chain from first successful `--agent` full chain on UNMODIFIED main. Correlation `7d997a95-...`. No patches. | **Current — canonical LIVE evidence** |
| `2026-05-24-0b2a477-live-full-chain/` | Day 5/6 | Event chain from first-ever full 5/5 chain (with 3 temporary patches, all reverted). Correlation `c5deda45-...`. | **Historical — superseded by Day-7 unpatched run** |
| `2026-05-22-0b2a477-replay-p2-replay/` | Day 4 | Replay-mode proof: validate → register → invoke on golden fixture. 5/5 honesty checks pass. No LLM call. | **Current — canonical REPLAY evidence** |
| `2026-06-04-93adf56-live-agent-pass/` | 2026-06-04 | First full sanctioned-live `--agent` PASS from the contractor environment: generate → validate → register → invoke (`SentimentClassifier`), stability lane, `transport=bus_backed` (#206 readiness artifact). Generation served at ladder tier 1 (local Qwen, SEA #205) — cloud tier not attempted. Correlation `d76664cb-…`. Classified **diagnostic** per packet (missing: runtime identity, topic offsets, projection state). | **Current — first full sanctioned-live PASS (diagnostic)** |
| `2026-06-04-93adf56-live-agent-forced-escalation/` | 2026-06-04 | Forced-escalation run (local tiers made unreachable via documented seams) to exercise the cloud tier post-OMN-12664-closure. Escalated to `cloud_gemini`; runtime round-trip live; failed with the **same two-URL 404 signature as 2026-06-03**: registered `…/v1beta/openai/chat/completions`, called `…/v1/chat/completions`. Typed `SeaGenerationError`. Correlations `fa8daa9e-…` / `aab65120-…`. This seat cannot distinguish fix-not-deployed from fix-not-on-live-path (see packet Interpretation boundary). | **Current — OMN-12664 post-closure observation (diagnostic)** |

### sea-demo-acceptance/

Expand All @@ -38,6 +43,21 @@ Currently empty in OCC. Demo risk findings are tracked via Linear tickets (OMN-1

Not ported to OCC. Daily standups live in the engagement workspace at `docs/projects/hackathon_prep/progress_reports/` and are posted to Slack `#standups` per engagement doctrine. They are process artifacts, not typed evidence.

### repros/

| Directory | Date | Description | Status |
|---|---|---|---|
| `OMN-12587-asyncio/` | 2026-05-31 | Minimal repro script for the F1 asyncio publish-path failure (`publish_and_wait` inside a running event loop), referenced from the OMN-12587 verification thread. Fixed by SEA #203; retained as regression reference. | **Historical — fix verified** |

---

## 2026-06-04 addendum (post-Day-7 status notes)

- **OMN-12664** (runtime drops Gemini `/v1beta/openai` path) moved Done 2026-06-04 09:26 UTC (omnimarket#1031; infra#1859 reverted by #1863). Same-day forced-escalation run from the contractor seat reproduced the two-URL 404 signature post-closure — see `proof-of-life/2026-06-04-93adf56-live-agent-forced-escalation/`. Observation only; deploy-state vs live-path ambiguity is documented in the packet.
- **OMN-12665** (silent direct-mode downgrade): SEA #206 merged — sanctioned-live now fails closed on unprovable Kafka readiness and writes durable readiness artifacts (`final_transport_mode`). Both 2026-06-04 runs carry these artifacts.
- **SEA #205** wired `--agent` scaffold generation to the escalate-on-failure ladder from `src/contracts/model_registry.yaml` (local-first; cloud only on local-tier failure). Consequence for verification: an unforced `--agent` run does not exercise the cloud/runtime Gemini path when a local endpoint is healthy.
- Evidence gap noted for SEA: executor delegation events (attempt/escalation/completed) are dropped when `scaffold_onex_node` raises `SeaGenerationError` — no durable per-tier escalation evidence on failure paths.

---

## Local artifacts NOT ported (engagement-process docs, remain in workspace)
Expand Down
Loading
Loading