Add exp-test-gap-analysis skill for pseudo-mutation test gap detection - #490
Conversation
New experimental skill that performs pseudo-mutation analysis on .NET production code to find gaps in existing test suites. Covers boundary, boolean/logic, return value, exception removal, arithmetic, and null-check mutation categories. Includes eval.yaml with 4 scenarios (boundary gaps, logic gaps, well-tested code recognition, non-activation) and fixture projects.
|
/evaluate |
Skill Validation Results
[1] (Plugin) Quality dropped but weighted score is +2.7% due to: tokens (355377 → 113804), tool calls (26 → 10), time (219.2s → 154.3s)
Model: claude-opus-4.6 | Judge: claude-opus-4.6
🔍 Full Results - additional metrics and failure investigation steps |
There was a problem hiding this comment.
Pull request overview
Adds a new experimental .NET skill (exp-test-gap-analysis) and accompanying evaluation scenarios/fixtures to perform pseudo-mutation style reasoning to identify test suite gaps.
Changes:
- Introduces
exp-test-gap-analysisskill documentation describing mutation-point detection and gap reporting. - Adds
eval.yamlwith 4 scenarios plus fixture projects covering boundary gaps, logic gaps, and a “well-tested” baseline. - Updates CODEOWNERS to route ownership for the new skill and tests.
Reviewed changes
Copilot reviewed 15 out of 15 changed files in this pull request and generated 8 comments.
| File | Description |
|---|---|
| plugins/dotnet-experimental/skills/exp-test-gap-analysis/SKILL.md | Defines the new skill’s purpose, workflow, and mutation categories. |
| tests/dotnet-experimental/exp-test-gap-analysis/eval.yaml | Adds evaluation scenarios validating boundary/logic gap detection and “well-tested” recognition. |
| tests/dotnet-experimental/exp-test-gap-analysis/fixtures/** | Adds .NET fixture projects + tests used by the eval scenarios. |
| .github/CODEOWNERS | Assigns ownership for the new skill + test area. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
dotnet#490) New experimental skill that performs pseudo-mutation analysis on .NET production code to find gaps in existing test suites. Covers boundary, boolean/logic, return value, exception removal, arithmetic, and null-check mutation categories. Includes eval.yaml with 4 scenarios (boundary gaps, logic gaps, well-tested code recognition, non-activation) and fixture projects.
New experimental skill that performs pseudo-mutation analysis on .NET production code to find gaps in existing test suites. Covers boundary, boolean/logic, return value, exception removal, arithmetic, and null-check mutation categories.
Includes eval.yaml with 4 scenarios (boundary gaps, logic gaps, well-tested code recognition, non-activation) and fixture projects.