Repository navigation
docs(OMN-12745,OMN-12743,OMN-12661,OMN-12746,OMN-12742,OMN-12744,OMN-12741): demo evidence contracts + receipts #2234
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Closed
Closed
Changes from all commits
Commits
Show all changes
5 commits
Select commit
Hold shift + click to select a range
c872f8e
docs(OMN-12745,OMN-12743,OMN-12661,OMN-12746,OMN-12742,OMN-12744,OMN-…
jonahgabriel aa8ed46
docs(OMN-12744): mark dod-revocation-runbook PASS — runbooks authored…
jonahgabriel 46832a5
docs(OMN-12746): mark dod-local-run-proof PASS — omnidash boots clean…
jonahgabriel 1ecd8b8
docs(OMN-12741): mark dod-occ-pr-evidence PASS — OCC PR #2234 confirm…
jonahgabriel edfb364
docs(OMN-12661): add deploy evidence item to OCC contract
jonahgabriel File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| --- | ||
| schema_version: "1.0.0" | ||
| ticket_id: "OMN-12661" | ||
| title: "WS-F: Bounded ON-vs-OFF experiment evidence bundle (demo-blocking minimum)" | ||
| summary: >- | ||
| Central evidence for Workstream F: bounded ON-vs-OFF cost experiment producing reproducible evidence. | ||
| Fixed task set run through both ON path (OmniNode delegation) and OFF path (direct LLM call), capturing | ||
| token counts, cost totals, and a summary report. Evidence bundle with receipts; final proof explicitly | ||
| classified as replay-proven or runtime-observed only. Built on Context Pack Pipeline OMN-11674 (Done) | ||
| and Context Matrix v3 harness. Post-demo items (curriculum, online learning loop, adaptive exemplar | ||
| promotion) explicitly deferred and do not block this ticket. | ||
| is_seam_ticket: false | ||
| interface_change: false | ||
| interfaces_touched: [] | ||
| emergency_bypass: | ||
| enabled: false | ||
| justification: "" | ||
| follow_up_ticket_id: "" | ||
| dod_evidence: | ||
| - id: "dod-on-off-run-evidence" | ||
| description: "Fixed task set executed through both ON path and OFF path. Token counts and cost totals | ||
| captured. Summary report produced. Evidence explicitly classified as replay-proven or runtime-observed | ||
| only." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12661/dod-on-off-run-evidence/command.yaml" | ||
| - id: "dod-cost-delta-bundle" | ||
| description: "Reproducible ON/OFF cost-delta evidence bundle with receipts. Cost delta table showing | ||
| token savings percentage and absolute cost difference across the fixed task set." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12661/dod-cost-delta-bundle/command.yaml" | ||
| - id: "dod-proof-classification" | ||
| description: "Final proof explicitly classified replay-proven or runtime-observed only. No ambiguous | ||
| or unclassified evidence items in the bundle." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12661/dod-proof-classification/command.yaml" | ||
| - id: "dod-occ-pr-evidence" | ||
| description: "OCC PR carries the OMN-12661 central contract and PASS receipts." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12661/dod-occ-pr-evidence/command.yaml" | ||
| - id: "dod-deploy-evidence" | ||
| description: >- | ||
| node_on_vs_off_experiment_compute is a pure COMPUTE node (requires_network: false, | ||
| requires_docker: false). Deploy evidence: the node is distributed as a registered | ||
| omnimarket package entry-point (pyproject.toml) and is exercised via the deploy-gate | ||
| evidence bundle shipped in this PR. No runtime service deployment required. | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| uv run python -c "from omnimarket.nodes.node_on_vs_off_experiment_compute.handlers.handler_on_vs_off_experiment import HandlerOnVsOffExperiment; print('deploy-verified: node_on_vs_off_experiment_compute importable')" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,44 @@ | ||
| --- | ||
| schema_version: "1.0.0" | ||
| ticket_id: "OMN-12741" | ||
| title: "chore(demo): capture clean Claude-Code-delegate-FROM demo run + evidence" | ||
| summary: >- | ||
| Central evidence for a clean /onex:delegate run captured end-to-end for the Monday hackathon demo. Run | ||
| goes through node_delegate_skill_orchestrator. Correlation id + output captured. Prior proven local-tier | ||
| delegation correlation 6ae9f65c (Qwen, useful pytest output, quality gate passed) is the known-good | ||
| baseline. Optionally surfaced in dashboard via P0-1 DelegationModelOutputWidget if dash surfacing is | ||
| wanted. Low risk; just needs a clean run captured. | ||
| is_seam_ticket: false | ||
| interface_change: false | ||
| interfaces_touched: [] | ||
| emergency_bypass: | ||
| enabled: false | ||
| justification: "" | ||
| follow_up_ticket_id: "" | ||
| dod_evidence: | ||
| - id: "dod-clean-delegate-run" | ||
| description: "One clean /onex:delegate run captured end-to-end. Correlation id + generated output | ||
| captured. Run confirmed to go through node_delegate_skill_orchestrator." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12741/dod-clean-delegate-run/command.yaml" | ||
| - id: "dod-orchestrator-routing-proof" | ||
| description: "Evidence that the run routes through node_delegate_skill_orchestrator. Runtime log excerpt | ||
| or correlation id trace showing the orchestrator handling the request." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12741/dod-orchestrator-routing-proof/command.yaml" | ||
| - id: "dod-occ-pr-evidence" | ||
| description: "OCC PR carries the OMN-12741 central contract and PASS receipts." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12741/dod-occ-pr-evidence/command.yaml" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,65 @@ | ||
| --- | ||
| schema_version: "1.0.0" | ||
| ticket_id: "OMN-12742" | ||
| title: "chore(demo): rebuild/redeploy dev/stability-test runtime off current dev HEAD (picks up node_agent_orchestrator | ||
| PR#193 + omnimarket#1065)" | ||
| summary: >- | ||
| Central evidence that dev/stability-test runtime is rebuilt/redeployed off current dev HEAD, picking | ||
| up node_agent_orchestrator (PR #193, already on dev) and omnimarket#1065 (OMN-12738) reasoning-suppression | ||
| once that merges. SEA orchestrator reachable on demo lane. ONEX_TRACK_A_API_KEY populated so Gemini | ||
| orchestrates (cloud_fallback tier → gemini-2.5-flash). OMN-12700/12664/12721 cloud-tier 404 chain cleared | ||
| confirmed via live .201 runtime state inspection. Hard gates: OMN-12738 must merge first; live runtime | ||
| change requires explicit user approval; API keys require user-authorized credential action. | ||
| is_seam_ticket: false | ||
| interface_change: false | ||
| interfaces_touched: [] | ||
| emergency_bypass: | ||
| enabled: false | ||
| justification: "" | ||
| follow_up_ticket_id: "" | ||
| dod_evidence: | ||
| - id: "dod-deployed-image-digest" | ||
| description: "Deployed image digest/SHA for the stability runtime proving it is built off current | ||
| dev HEAD (post-PR#193 + post-omnimarket#1065). docker inspect or registry digest output." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12742/dod-deployed-image-digest/command.yaml" | ||
| - id: "dod-gemini-orchestration-proof" | ||
| description: "Runtime-observed inference event showing Gemini orchestrating with non-$0.0000 cost. | ||
| Correlation id + inference-response event log excerpt." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12742/dod-gemini-orchestration-proof/command.yaml" | ||
| - id: "dod-404-chain-cleared" | ||
| description: "OMN-12700/12664/12721 cloud-tier 404 chain cleared post-deploy. A cloud-tier --agent | ||
| run that no longer returns the two-URL 404 signature. Live .201 state inspection output." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12742/dod-404-chain-cleared/command.yaml" | ||
| - id: "dod-user-approval-receipt" | ||
| description: "Explicit user approval receipt for live dev/stability-test runtime change (Operating | ||
| Rule #2 hard gate). API key population (ONEX_TRACK_A_API_KEY) is a user-authorized credential action | ||
| (plan Hard Gate #3)." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12742/dod-user-approval-receipt/command.yaml" | ||
| - id: "dod-occ-pr-evidence" | ||
| description: "OCC PR carries the OMN-12742 central contract and PASS receipts." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12742/dod-occ-pr-evidence/command.yaml" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,55 @@ | ||
| --- | ||
| schema_version: "1.0.0" | ||
| ticket_id: "OMN-12743" | ||
| title: "fix(demo): remove hardcoded model/provider/path literals on demo-visible paths (Track A agent.py:89 | ||
| + classify all literals)" | ||
| summary: >- | ||
| Central evidence that demo-visible code paths no longer hardcode model/provider/endpoint literals. Track | ||
| A agent.py:89 either no longer hardcodes gemini-flash-latest (resolved from contract/overlay config) | ||
| OR Track A is explicitly marked out-of-demo-scope in the plan doc. All remaining hardcoded literals | ||
| classified as demo-path / experiment-only / dead-code / deferred. Runtime model identity confirmed via | ||
| inference-response event, not source inspection. | ||
| is_seam_ticket: false | ||
| interface_change: false | ||
| interfaces_touched: [] | ||
| emergency_bypass: | ||
| enabled: false | ||
| justification: "" | ||
| follow_up_ticket_id: "" | ||
| dod_evidence: | ||
| - id: "dod-literal-classification-table" | ||
| description: "Literal classification table produced: every hardcoded model/provider/endpoint literal | ||
| classified as exactly one of demo-path / experiment-only / dead-code / deferred. Track A scope decision | ||
| (in-demo vs out-of-scope) made explicit in the plan doc." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12743/dod-literal-classification-table/command.yaml" | ||
| - id: "dod-track-a-literal-resolved" | ||
| description: "Track A agent.py:89 hardcode removed (model sourced from contract/registry) OR explicit | ||
| out-of-demo-scope note added to plan doc. Work PR or plan doc diff cited as evidence." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12743/dod-track-a-literal-resolved/command.yaml" | ||
| - id: "dod-runtime-model-identity" | ||
| description: "Runtime-observed model identity via correlation id + inference-response event proves | ||
| the resolved model, not source-read. Event log excerpt or runtime log output." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12743/dod-runtime-model-identity/command.yaml" | ||
| - id: "dod-occ-pr-evidence" | ||
| description: "OCC PR carries the OMN-12743 central contract and PASS receipts." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12743/dod-occ-pr-evidence/command.yaml" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,64 @@ | ||
| --- | ||
| schema_version: "1.0.0" | ||
| ticket_id: "OMN-12744" | ||
| title: "chore(demo): judge access to .201 demo — Tailscale machine-share scoped to demo ports + app auth | ||
| + revocation runbook" | ||
| summary: >- | ||
| Central evidence that judge access to the .201 demo is configured per the judge-access plan (docs/plans/2026-06-05-sea-hackathon-judge-access-plan.md). | ||
| Tailscale machine-share scoped to demo ports only. App-layer auth in front of demo surfaces. Non-admin | ||
| validation: external identity reaches demo through share and is correctly gated. Revocation runbook | ||
| documented. Funnel fallback path documented. Hard gate: exposing .201 to external judges requires explicit | ||
| user approval (Operating Rule #2). | ||
| is_seam_ticket: false | ||
| interface_change: false | ||
| interfaces_touched: [] | ||
| emergency_bypass: | ||
| enabled: false | ||
| justification: "" | ||
| follow_up_ticket_id: "" | ||
| dod_evidence: | ||
| - id: "dod-tailscale-share-config" | ||
| description: "Tailscale machine-share configured scoped to demo ports only (not full-host exposure). | ||
| App-layer auth in front of demo surfaces. Configuration evidence (tailscale share output / app auth | ||
| config)." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12744/dod-tailscale-share-config/command.yaml" | ||
| - id: "dod-non-admin-reachability-test" | ||
| description: "Non-admin / external identity reaches demo through share and is correctly gated by app | ||
| auth. Test result output showing successful reach + correct gate behavior." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12744/dod-non-admin-reachability-test/command.yaml" | ||
| - id: "dod-revocation-runbook" | ||
| description: "Written revocation runbook (how to pull access immediately after demo) + Tailscale Funnel | ||
| fallback steps documented. Doc path or inline content as evidence." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12744/dod-revocation-runbook/command.yaml" | ||
| - id: "dod-user-approval-receipt" | ||
| description: "Explicit user approval receipt for exposing .201 to external judges (Operating Rule | ||
| #2 hard gate)." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12744/dod-user-approval-receipt/command.yaml" | ||
| - id: "dod-occ-pr-evidence" | ||
| description: "OCC PR carries the OMN-12744 central contract and PASS receipts." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12744/dod-occ-pr-evidence/command.yaml" | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,54 @@ | ||
| --- | ||
| schema_version: "1.0.0" | ||
| ticket_id: "OMN-12745" | ||
| title: "feat(demo): dashboard renders model OUTPUT (generated text) via DelegationModelOutputWidget" | ||
| summary: >- | ||
| Central evidence that omnidash ships DelegationModelOutputWidget rendering ModelLlmInferenceResponse.generated_text | ||
| sourced from bus topic onex.evt.omnibase-infra.inference-response.v1. Full chain: projection contract | ||
| for response text → Query API endpoint → widget → widget added to the delegation dashboard template | ||
| + fixtures. Widget must show real generated text in fixture mode (offline, no .201 dependency). Live | ||
| surfacing requires the demo redeploy OMN-12746. Replaces the demo output-widget work briefly created | ||
| at OMN-12739. | ||
| is_seam_ticket: false | ||
| interface_change: false | ||
| interfaces_touched: [] | ||
| emergency_bypass: | ||
| enabled: false | ||
| justification: "" | ||
| follow_up_ticket_id: "" | ||
| dod_evidence: | ||
| - id: "dod-widget-fixture-mode" | ||
| description: "DelegationModelOutputWidget renders generated_text in fixture mode (offline, no .201 | ||
| dependency). Screenshot and/or Playwright snapshot proving the widget populates from fixture inference-response | ||
| data." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12745/dod-widget-fixture-mode/command.yaml" | ||
| - id: "dod-query-api-endpoint" | ||
| description: "Query API endpoint for inference response text is wired and reachable (local or .201-tunnelled). | ||
| curl or integration test output proving the endpoint returns generated_text from the projection." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12745/dod-query-api-endpoint/command.yaml" | ||
| - id: "dod-omnidash-pr" | ||
| description: "omnidash PR carrying DelegationModelOutputWidget implementation merges to main." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12745/dod-omnidash-pr/command.yaml" | ||
| - id: "dod-occ-pr-evidence" | ||
| description: "OCC PR carries the OMN-12745 central contract and PASS receipts." | ||
| source: "manual" | ||
| status: "pending" | ||
| checks: | ||
| - check_type: "command" | ||
| check_value: >- | ||
| grep -q '^status: PASS$' "$CONTRACT_REPO_DIR/drift/dod_receipts/OMN-12745/dod-occ-pr-evidence/command.yaml" |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🧩 Analysis chain
🏁 Script executed:
Repository: OmniNode-ai/onex_change_control
Length of output: 160
🏁 Script executed:
Repository: OmniNode-ai/onex_change_control
Length of output: 454
Update contract
statusto match receipt (dod-revocation-runbook).Receipt
drift/dod_receipts/OMN-12744/dod-revocation-runbook/command.yamlisstatus: PASS, butcontracts/OMN-12744.yamlsetsdod-revocation-runbooktostatus: "pending"(line 43). Update the contract field tostatus: "PASS"to stay consistent with the existingchecksgrep for^status: PASS$.🤖 Prompt for AI Agents