Skip to content

docs(OMN-11513): cloud-tier retest log through 2026-06-07 — post-deploy verification failed on runtime v0.38.3 - #2301

Merged
jonahgabriel merged 3 commits into
devfrom
clone45/omn-11513-evidence-2026-06-07-postdeploy-retest
Jun 8, 2026
Merged

jonahgabriel merged 3 commits into
devfrom
clone45/omn-11513-evidence-2026-06-07-postdeploy-retest

Conversation

@clone45

@clone45 clone45 commented Jun 7, 2026 •

Copy link
Copy Markdown
Collaborator

Evidence update (shape per #2166/#2203): appends retests #3 (2026-06-06, discarded — broker outage) and #4 (2026-06-07, post-deploy) to the cloud-tier retest log, plus manifest row update.

Retest #4 observation: runtime observed at v0.38.3 (healthy, :18085/health read at test time), and the identical two-URL 404 signature persists (registered .../v1beta/openai/chat/completions, called .../v1/chat/completions; correlation 1fbfd700-a4fa-46df-b265-a68a2ef167ba). A verification ticket with the full timeline and a topic-binding hypothesis is being filed and will reference this PR.

Process disclosure: manifest edit applied by script (local Plan Gate hook on ticket-pattern branches), consistent with prior evidence PRs.

Summary by CodeRabbit

  • Documentation
    • Coverage window and "last updated" refreshed to June 7, 2026.
    • Test artifacts updated with expanded retest run details (including two additional runs and a failed post-deploy verification).
    • Added new post-deploy retest evidence entry and multiple updated evidence receipts to reflect recent validations and their statuses.
    • Note confirming smoke tests now pass after routing changes.

Evidence-Ticket: OMN-11513
Evidence-Source: OCC#2301

@coderabbitai

coderabbitai Bot commented Jun 7, 2026 •

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 72276d73-78ae-412b-be68-c72e72ce704b

📥 Commits

Reviewing files that changed from the base of the PR and between e229b00 and c9b857e.

⛔ Files ignored due to path filters (1)
  • uv.lock is excluded by !**/*.lock
📒 Files selected for processing (16)
  • contracts/OMN-11513.yaml
  • drift/dod_receipts/OMN-11513/dod-deploy-assessment-pr-1739/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-cross-repo-test/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1323/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1607/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1608/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1886/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-2166/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-2176/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml
  • drift/dod_receipts/OMN-11513/dod-omni-home-pr-145/command.yaml
  • drift/dod_receipts/OMN-11513/dod-omnibase-infra-pr-1735/command.yaml
  • drift/dod_receipts/OMN-11513/dod-omnibase-infra-pr-1739/command.yaml
  • drift/dod_receipts/OMN-11513/dod-stability-runtime-proof/command.yaml
  • pyproject.toml
✅ Files skipped from review due to trivial changes (10)
  • drift/dod_receipts/OMN-11513/dod-occ-pr-2203/command.yaml
  • drift/dod_receipts/OMN-11513/dod-omnibase-infra-pr-1739/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1886/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1607/command.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-pr-1323/command.yaml
  • drift/dod_receipts/OMN-11513/dod-omnibase-infra-pr-1735/command.yaml
  • drift/dod_receipts/OMN-11513/dod-stability-runtime-proof/command.yaml
  • drift/dod_receipts/OMN-11513/dod-omni-home-pr-145/command.yaml
  • contracts/OMN-11513.yaml
  • drift/dod_receipts/OMN-11513/dod-occ-cross-repo-test/command.yaml

📝 Walkthrough

Walkthrough

Updates OMN-11513 evidence and DoD receipts: manifest dates and test-run documentation refreshed; new manual evidence requirement and verified dod entry for PR #2301 added; one new receipt created; deploy-assessment probe switched to GitHub CLI; multiple receipt contract_sha256 values updated; dependency rev bumped.

Changes

Evidence, receipts, and contract bindings

Layer / File(s) Summary
Contracts: add manual evidence requirement and verified dod entry
contracts/OMN-11513.yaml
Adds a manual evidence requirement pointing to onex_change_control PR #2301 receipts and a verified dod_evidence entry dod-occ-pr-2301 that checks status: PASS and pr_number: 2301 in the referenced receipt file.
Evidence manifest metadata and test-run documentation
evidence/OMN-11513/EVIDENCE_MANIFEST.md
Extends coverage period and Last updated to 2026-06-07; expands 2026-06-05-handoff-reproduction/ artifact to document four forced-escalation runs with outcomes for runs #3 (discarded) and #4 (post-deploy verification FAILED) and updates PM/status context.
Add new receipt for dod-occ-pr-2301
drift/dod_receipts/OMN-11513/dod-occ-pr-2301/command.yaml
Introduces full command evidence entry capturing schema, identifiers, contract hash, PASS status, probe command/stdout, actual_output, exit code, working directory, and pr_number: 2301.
Deploy assessment: GH-CLI based probe
drift/dod_receipts/OMN-11513/dod-deploy-assessment-pr-1739/command.yaml
Replaces static echo-based probe with gh pr view + gh pr checks, updates contract hash and actual_output to reflect PR+CI inspection while preserving PASS and non-deploy claims.
contract_sha256 updates across receipts
drift/dod_receipts/OMN-11513/*/command.yaml
Updated contract_sha256 digest values in multiple existing DoD receipt command.yaml files for OMN-11513 to new SHA-256 digests.
Dependency revision update
pyproject.toml
Updated omnibase-core git rev under [tool.uv.sources] to a different upstream commit.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

Poem

The rabbit notes each test and date,
Fresh ink for runs, both small and great.
A new receipt hops into the stack,
Checksums updated, no step gets slack.
🐇📜🌿

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The pull request title clearly and specifically summarizes the main change: documenting a cloud-tier retest with a post-deploy verification failure on a specific runtime version through a specific date.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch clone45/omn-11513-evidence-2026-06-07-postdeploy-retest

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@jonahgabriel
jonahgabriel added this pull request to the merge queue Jun 8, 2026
Merged via the queue into dev with commit 3a5b5b1 Jun 8, 2026
37 checks passed
@jonahgabriel
jonahgabriel deleted the clone45/omn-11513-evidence-2026-06-07-postdeploy-retest branch June 8, 2026 15:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants