Add ASP.NET Core adversarial review skills - #1
Closed
PureWeen wants to merge 27 commits into
Closed
Conversation
Capture product intent separately from implementation evidence, preserve exact empirical assertions, detect relevant PR head drift, and translate findings into plain maintainer language. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Keep final evidence selection and synthesis outside the Anthropic candidate family, and add a regression eval for non-GPT invocation. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Add provenance-aware scoring, frozen held-out fixtures, deterministic validation, and cross-area transfer cases so PR-derived regressions remain useful without dominating quality measurements. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Prefer structural clarity for local mechanics, reserve comments for nonlocal rationale, and retain the distinction with a cross-area eval and monotonic provenance warnings. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Move conditional review and proof detail behind progressive-disclosure references, add bounded and full review paths, complete the try-fix Vally suite, and replace the reviewer Python harness with PowerShell tooling. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Keep exact targeted and production proof taxonomy in the shortened skill spine so bounded reviews and retained empirical results cannot over-promote incomplete evidence. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Distinguish candidate evidence labels from the caller's requested proof target and make the retained narrow-proof eval self-contained. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Classify complete retained empirical evidence from the core proof labels without unnecessary repository discovery or reference-path stalls. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Make retained-evidence labels auditable with a compact mechanism matrix and finish removing the parent branch's remaining Python Vally tooling. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Ensure every generated try-fix case loads the intended skill without altering frozen held-out prompts or exposing rubric answers. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Validate bounded reviews without full-path boilerplate while preserving targeted red/green evidence and the complete full-review contract. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
PureWeen
force-pushed
the
pureween-improve-pr-review-validation
branch
from
August 11, 2026 17:27
c8447e8 to
05755c3
Compare
Remove the duplicated JSON eval manifests and generation step. Read governance and score metadata directly from the canonical Vally suites while retaining held-out integrity and sanitized skill staging. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Separate API compatibility tracking from API approval, require honest red-green evidence for bug-fix verification claims, and document fresh Components worktree prerequisites. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:25 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:26 — with
GitHub Actions
Inactive
PureWeen
had a problem deploying
to
copilot-pat-pool
August 11, 2026 21:26 — with
GitHub Actions
Failure
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:28 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:29 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:29 — with
GitHub Actions
Inactive
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:34 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:34 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:34 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:52 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:53 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 21:54 — with
GitHub Actions
Inactive
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:00 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:00 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:00 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:27 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:28 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:29 — with
GitHub Actions
Inactive
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:41 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:41 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 22:42 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 23:10 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 23:11 — with
GitHub Actions
Inactive
PureWeen
temporarily deployed
to
copilot-pat-pool
August 11, 2026 23:12 — with
GitHub Actions
Inactive
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
- Exercise the actual interaction under test rather than bypassing it via direct injection/navigation. - Wait for observable DOM/viewport/callback conditions using Browser.True/Browser.Equal instead of relying only on fixed delays or requestAnimationFrame. - Note fixed delays remain valid for negative guarantees. - Check console errors and transient UI when relevant. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 0fb5ea3b-44bb-495b-99c5-93e753ca9ce1
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
aspnetcore-pr-reviewandaspnetcore-try-fixskillsHow this grows without overfitting
The eval corpus grows by adding durable failure mechanisms, not by encoding the expected review of every PR we inspect.
viewport-measurement-epoch-recoverymechanism. Near-duplicates should continue to be merged or removed when stronger independent coverage exists.A reviewed PR expands the skill only when it teaches a transferable rule, exposes an uncovered mechanism, or supplies independent transfer evidence.
Validation
@microsoft/vally-cli@0.13.0lint for all three canonical specifications0.750, no-defect control1.000; these are diagnostic runs, not official five-trial scores.py,python, orpython3files/invocations remain in reviewer, try-fix, or canonical eval wiring0.800vs old0.7331.000vs old0.8000.725vs old0.6250.850vs old0.5500.600vs old0.700Known limits
0.600vs0.700). The overall held-out macro improves, but this local loss is retained rather than hidden.Validate-ReviewArtifacts.ps1checks structural completeness, proof-label consistency, referenced evidence containment, and boundary roles. It cannot authenticate that a model-authored log came from the command it claims to represent without an external execution trust boundary.