Repository navigation
fix(noema): enforce observed defect-class review evidence #1641
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Closed
seonghobae
wants to merge
59
commits into
main
from
fix/noema-observed-defect-corpus-current-main-20260902
Closed
Changes from 51 commits
Commits
Show all changes
59 commits
Select commit
Hold shift + click to select a range
fe17df9
test(noema): add observed defect false-negative corpus
seonghobae 95b66f9
ci(temp): apply and verify PR1641 review-corpus repair
seonghobae e27d5c8
fix(ci): repair PR1641 temporary writer workflow
seonghobae eae62d1
ci(temp): trigger repaired PR1641 writer
seonghobae f702789
ci(temp): gate PR1641 writer while fixing review findings
seonghobae fe9b6da
test(noema): add generic class-evidence relabel regression
seonghobae 468c450
fix(noema): stage concrete class-observation repair
seonghobae 6e766c0
ci(temp): execute repaired PR1641 writer
seonghobae 0dcfa8f
test(noema): reject vacuous class evidence
seonghobae d8eb254
test(noema): preserve workflow-trigger review regression
seonghobae 10f6d11
fix(noema): bind class evidence to exact source
seonghobae d0c8b1f
fix(noema): harden nonvacuous review evidence
seonghobae 8c1c82a
ci(temp): execute repaired PR1641 writer
seonghobae e1a4406
test(noema): avoid accidental source-token match
seonghobae b501d26
test(noema): keep duplicate observation regression precise
seonghobae b046568
ci(temp): execute repaired PR1641 writer
seonghobae 579d5a3
fix(noema): add exact-source follow-up repair
seonghobae 397d9d2
ci(temp): execute repaired PR1641 writer
seonghobae cc3c980
fix(noema): replace lexical causal admission with structural roles
seonghobae 33b6966
ci(temp): execute repaired PR1641 writer
seonghobae f3ae6d2
ci(temp): execute repaired PR1641 writer
seonghobae 8da5c3f
fix(noema): repair exact-source evidence fixtures
seonghobae 1c3346e
ci(temp): execute repaired PR1641 writer
seonghobae 33ec0a7
test(noema): isolate repair deadline from external DNS
seonghobae f33a22e
ci(temp): stage repaired PR1641 retrigger
seonghobae 39ae210
ci(temp): execute repaired PR1641 writer
seonghobae e8e08cc
test(noema): cover observed-evidence validator branches
seonghobae 02724d3
ci(temp): execute repaired PR1641 writer
seonghobae 6a4ff1d
test(noema): cover final class-evidence failure branches
seonghobae f5cf383
ci(temp): execute repaired PR1641 writer
seonghobae 0918cb3
ci(temp): execute repaired PR1641 writer
seonghobae 249f28c
ci(temp): execute repaired PR1641 writer
seonghobae 7c7e2fc
fix(noema): enforce structural observed-defect evidence
b196d3f
docs(noema): record successor-check proof
seonghobae 7b145bd
ci(temp): repair Noema source-evidence edge cases
seonghobae 0443565
ci: move PR 1641 edge repair off saturated runner pool
seonghobae 812853e
ci: add robust PR 1641 edge repair
seonghobae f445324
ci: add fail-closed PR 1641 exact-source edge repair
seonghobae 168f053
ci: add executable PR 1641 exact-source edge repair
seonghobae cdcd220
ci: make PR 1641 edge repair executable
seonghobae 361d9fb
ci(noema): execute and self-clean exact-source edge repair
seonghobae 2136826
chore(noema): remove superseded PR1641 repair workflow
seonghobae a78131a
chore(noema): remove superseded PR1641 edge workflow
seonghobae ec53e9c
chore(noema): remove superseded PR1641 repair helper
seonghobae 70bc213
ci(noema): retrigger exact-source edge repair
seonghobae 468d0ed
ci(noema): supersede flawed PR1641 source writer
seonghobae e4eeaa5
ci(noema): replace indentation-fragile PR1641 writer
seonghobae 2224c45
ci(noema): run robust PR1641 exact-source GREEN repair
seonghobae d73afbd
ci(noema): keep broad source-evidence regression suite causal
seonghobae ba2ee0a
fix(ci): make PR1641 GREEN writer executable
seonghobae c759f23
fix(noema): bind claimed verification to trusted receipts
seonghobae fbe2602
fix(noema): unify exact diff evidence parsing
seonghobae 2946017
fix(noema): close whitespace evidence provenance gaps
seonghobae 43a1fdc
fix(noema): align structured probe contracts
seonghobae 9df1ea4
test(noema): cover malformed provenance containers
seonghobae 409638a
Merge protected main into Noema evidence root
seonghobae 80fc255
fix(noema): align decision status schema and close HTTP errors
seonghobae ad48dd6
fix(noema): 응답 정리 오류와 원래 통신 실패를 분리
seonghobae b8c986e
test(noema): reproduce unreceipted Concept35 claim
seonghobae File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
17 changes: 17 additions & 0 deletions
17
docs/doctoring/noema-observed-defect-corpus-current-main.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| # Noema observed-defect review corpus | ||
|
|
||
| The trusted Noema review gate treats externally demonstrated review misses as executable regression evidence, not as benchmark claims. Material source/test reviews must exercise at least two distinct observed defect classes and every admitted class witness remains bound to an exact changed-side source coordinate. | ||
|
|
||
| The current closed taxonomy is: `mutable_alias`, `time_of_check_time_of_use`, `execution_identity`, `coercion_boundary`, `test_oracle`, `cross_contract`, `authority_boundary`, `dependency_context`, and `state_machine_race`. Each class has class-specific witness keys. Witness values are `{path,line,side,source_excerpt,observation}` records bound to the probe location. `source_excerpt` must equal the exact changed-side line, and `observation` must quote the exact source line (or `<blank>`) plus a causal/behavioral relation beyond taxonomy labels; ASCII token shape is not admission authority; repeated or differently worded generic labels do not satisfy the deterministic validator. | ||
|
|
||
| The model is explicitly asked to attack mutable/immutability escapes, changing getters/TOCTOU, request or tenant identity confusion, weak/vacuous oracles, cross-contract contradictions, authority overreach, missing causal dependency context, and reliability/security state-machine races. A falsified hypothesis is valid evidence and must not be promoted into a finding merely to satisfy taxonomy diversity. For CI/automation changes, the review prompt also requires checking whether the mutation credential can create the downstream events/checks the state machine depends on. | ||
|
|
||
| JSON booleans are rejected as line coordinates even though Python considers `True == 1`: changed-line evidence requires `type(line) is int` and a positive value. Production review calls always provide the complete changed-path manifest, which activates the observed taxonomy; direct validator unit tests may omit that manifest to exercise lower-level generic schema boundaries independently. | ||
|
|
||
| This repair is a narrow current-main successor to the heavily diverged PR #1589 evidence lineage. It does not copy CodeRabbitAI or Devin wording and makes no superiority claim. | ||
|
|
||
| Exact-head follow-up also makes bounded-diff omission markers ineligible as source evidence. Short identifiers, symbol-only lines, blank changed lines, and non-ASCII source remain admissible through exact string equality rather than lexical guessing. | ||
|
|
||
| The exact-head structural follow-up removes the fixed English relation-word list. Formal evidence now carries a schema-derived `claim_role` for each defect-class witness, while the deterministic gate verifies exact source identity, canonical coordinates, role identity, and distinct observations. Semantic causal adequacy remains a reviewer/evaluation responsibility; the validator does not pretend English keyword presence proves causality. | ||
|
|
||
| Workflow-local bootstrap or generated commits are not accepted as final review/check proof merely because their source transaction verified locally. The merge candidate must be a workflow-starting successor writer head produced through ordinary owner-side mutation, with the required review and quality checks observed on that exact unchanged head before merge. | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.