Repository navigation
feat(lab): CL-03 bounded live-route probes #1352
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 7 commits
Commits
Show all changes
47 commits
Select commit
Hold shift + click to select a range
003f740
feat(lab): implement CL-03 bounded live-route probes
Wibias 472a1ba
docs(lab): record CL-03 PR #1352 and validation state
Wibias 09d2638
test(lab): cover CL-03 review blockers
Wibias 38e7824
fix(lab): make CL-03 live evidence fail closed
Wibias 422c168
fix(lab): reconcile CL-03 strict contracts
Wibias 41c5c1d
fix(lab): gate live evidence on trusted execution
Wibias ffc9958
fix(lab): separate test execution from live evidence
Wibias e064e4c
fix(lab): make installation salt creation atomic
Wibias 30f2df0
fix(lab): sanitize destination policy failures
Wibias 25cc54b
fix(lab): close live result classification type
Wibias 9b46613
fix(lab): enforce pinned connect timeout
Wibias 735beb2
fix(lab): constrain live response metadata
Wibias 98bfcf2
fix(lab): type live failure classification
Wibias 836be56
fix(lab): bind trusted live results to execution receipts
Wibias c05df3c
fix(lab): require trusted receipt before live persistence
Wibias 316eee6
fix(lab): enforce byte-identical live authority mirror
Wibias a175558
fix(lab): correct live manifest authority limits
Wibias 73b1381
chore(lab): prepare authority mirror sync
Wibias 69159b3
fix(lab): sync normative live authority bytes
Wibias 6fd8d4a
fix(lab): fail closed on live projection applicability
Wibias 6950e21
fix(lab): derive live applicability from ledger claims
Wibias 83c72db
fix(lab): remove forgeable executor authority factory
Wibias 6128f6f
fix(lab): issue live executor capabilities in host integration
Wibias b4e2798
test(lab): cover trusted live evidence boundaries
Wibias 1b3ea04
test(lab): reject forged live executor authority
Wibias fdc2a69
fix(lab): close expected failure classification
Wibias b6ef4ed
fix(lab): bound destination resolution by connect timeout
Wibias 62196b0
test(lab): cover destination timeout and canonicalization
Wibias ec89264
fix(lab): keep shared pinned connect timeout opt-in
Wibias 562555c
docs(structure): record CL-03 trust boundaries
Wibias 7eb76e6
fix(lab): classify destination connect timeout as blocker
Wibias ae590ec
fix(lab): publish installation salt after durable staging write
Wibias 161048c
test(lab): cover multiprocess salt publication
Wibias 8308c9f
docs(lab): correct CL-03 focused test totals
Wibias c6117a5
docs(lab): correct CL-03 implementation test totals
Wibias 07b40fe
docs(lab): restore CL-03 implementation record and test totals
Wibias a80f79a
docs(lab): restore PR stack status and test totals
Wibias e0a07e2
fix(lab): harden salt publication durability
Wibias 47ad32f
fix(lab): type pinned connect timeouts
Wibias c4e3ea9
fix(lab): preserve pinned connect timeout code
Wibias d53fde7
fix(lab): persist live retry policy
Wibias 081c372
fix(lab): bind trusted receipt to result payload
Wibias 5d2b494
test(lab): reject mutated trusted live results
Wibias 4ee6cda
test(lab): use public IPv6 sandbox fixture
Wibias 4446677
fix(lab): tolerate unsupported directory fsync
Wibias 998de8a
fix(lab): seal exact failure retry policy
Wibias 7db3e4b
fix(lab): persist sealed retry decision
Wibias File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
56 changes: 56 additions & 0 deletions
56
devlog/_plan/260807_compatibility_lab/023_live_v1_manifest_authority.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,56 @@ | ||
| # CL-03 live V1 manifest authority | ||
|
|
||
| This document closes the executable semantics for the initial | ||
| `live_route_compatibility` scenarios. It is normative for CL-03. | ||
|
|
||
| The machine-readable source of truth is | ||
| [`024_live_v1_cases.json`](./024_live_v1_cases.json). It contains 10 frozen | ||
| live-route scenarios with Lab-authored synthetic fixtures, literal expected | ||
| values, row-specific requirements, execution limits from the security contract, | ||
| artifact policy, failure rules, and domain-separated fixture digests. | ||
|
|
||
| ## 1. Manifest expansion | ||
|
|
||
| For each entry in `cases`, CL-03 constructs `CompatibilityScenarioV1` using the | ||
| same `fixtureRef` contract as protocol V1, with authority | ||
| `024_live_v1_cases.json`. Defaults include: | ||
|
|
||
| - `evidenceLayer`: `live_route_compatibility` | ||
| - `executionMode`: `live` | ||
| - `freshness.maxAgeMs`: `604800000` (7 days) | ||
| - `failureRuleSet`: `live-v1-default` | ||
|
|
||
| Environmental blockers (`authentication_blocked`, `quota_blocked`, | ||
| `network_failure`, `provider_transient`, `region_blocked`, `timeout`, | ||
| `budget_exhausted`) map to `verdictEffect: none` and never produce compatibility | ||
| degradation. | ||
|
|
||
| ## 2. Live suites | ||
|
|
||
| | Suite | Live scenario | | ||
| |---|---| | ||
| | `responses-core` | `responses-core.live.basic-turn` | | ||
| | `chat-core` | `chat-core.live.basic-turn` | | ||
| | `anthropic-core` | `anthropic-core.live.basic-turn` | | ||
| | `tools-core` | `tools-core.live.function-round-trip`, `tools-core.live.custom-freeform-round-trip` | | ||
| | `codex-core` | `codex-core.live.tool-turn`, `codex-core.live.custom-tool-turn` | | ||
| | `vision-core` | `vision-core.live.synthetic-ocr` | | ||
| | `reasoning-core` | `reasoning-core.live.replay` | | ||
| | `mcp-core` | `mcp-core.live.synthetic-tool` | | ||
|
|
||
| ## 3. Route subject and sandbox | ||
|
|
||
| Live evidence uses `RouteSubjectV1` with opaque `endpointFingerprint` and | ||
| `providerInstanceFingerprint` derived via `localFingerprint()` from immutable | ||
| destination snapshots. Raw URLs, credentials, and DNS results are never | ||
| persisted. | ||
|
|
||
| The live sandbox rejects proxy environment variables, permits only | ||
| `TZ=UTC` and `NO_COLOR=1`, enforces security-contract resource ceilings, and | ||
| uses injectable transport in tests. | ||
|
|
||
| ## 4. CL-03 boundary | ||
|
|
||
| CL-03 implements the live runner, sandbox, route subject builder, persistence | ||
| seam, and projection applicability for `live_route_compatibility`. It does not | ||
| implement CL-04 CLI/API. |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.