Add blazor skills to dotnet-blazor plugin by javiercn · Pull Request #357 · dotnet/skills

javiercn · 2026-03-13T15:14:22Z

Summary

Adds a new dotnet-blazor plugin with 9 skills covering component authoring, state management, data fetching, authentication, prerendering, JS interop, and UI planning.

What's included

Plugin infrastructure

plugins/dotnet-blazor/plugin.json — plugin manifest
.github/plugin/marketplace.json and .claude-plugin/marketplace.json — marketplace entries
.github/CODEOWNERS — ownership for @lewing, @javiercn and @danroth27
README.md — plugin entry

Skill: author-component

Create Blazor components from scratch — parameters, events, render fragments, lifecycle, async patterns, disposal, CSS isolation.

Scenario	Baseline	Isolated	Plugin	Verdict
Data-loading search component	3.2	4.6	4.2	✅
Multi-step wizard with shared state	3.6	4.2	4.2	✅
Generic data table component	3.2	5.0	5.0	✅
Real-time notification badge	2.2	4.2	5.0	✅
Sortable list with code-behind	4.0	4.6	5.0	✅

5 runs per scenario

Skill: use-js-interop

JS interop patterns — collocated .razor.js modules, lifecycle timing, typed C# wrapper classes, DotNetObjectReference, ElementReference, disposal.

Scenario	Baseline	Isolated	Plugin	Verdict
Auto-saving notepad	2.8	4.2	3.6	✅
User activity tracker	2.6	4.8	4.2	✅
Drag-and-drop file upload zone	2.2	4.4	3.4	✅
Responsive layout (screen size)	3.0	4.8	5.0	✅
Infinite scroll (IntersectionObserver)	2.6	4.4	4.0	✅

+33.4% | 5 runs per scenario

Skill: plan-ui-change

5-step planning workflow that decomposes complex UI requests into focused, composable components instead of monolithic single-page components.

Scenario	Baseline	Isolated	Plugin	Verdict
Kanban board	1.0	4.0	4.0	✅
E-commerce product catalog	2.0	4.0	4.0	✅
Help desk ticket dashboard	1.0	5.0	4.0	✅
Team calendar scheduler	1.0	5.0	4.0	✅
Employee directory dashboard	1.0	5.0	4.0	✅

+59.7% | 1 run per scenario

Skill: create-blazor-project

Scaffold new Blazor Web Apps with the correct dotnet new blazor options for the target interactivity mode and scope. Writes AGENTS.md metadata for downstream skills.

Scenario	Baseline	Isolated	Plugin	Verdict
Per-page Server interactivity	3→5	3→5	✅ create-blazor-project	✅
Global WebAssembly app	3→5	3→5	✅ create-blazor-project	✅
Auto mode with per-page scope	3→5	3→5	✅ create-blazor-project	✅

1 run per scenario

Skill: support-prerendering

Fix prerendering problems — [PersistentState] with ??=, RendererInfo.IsInteractive guards, [ExcludeFromInteractiveRouting] for static SSR pages, disabling prerender.

Scenario	Baseline	Isolated	Plugin	Verdict
Equipment inventory loaded once	3→5	3→5	✅ support-prerendering	✅
Privacy page that reads cookies (global interactive)	3→5	3→5	✅ support-prerendering	✅
Notifications page with live polling	3→5	3→5	✅ support-prerendering	✅

1 run per scenario

Skill: collect-user-input

Build forms with EditForm, [SupplyParameterFromForm], validation, multi-form SSR patterns, and enhanced navigation.

Scenario	Baseline	Isolated	Plugin	Verdict
Conference talk submission (SSR)	2→5	2→5	✅ collect-user-input	✅
Inventory grid editor (interactive)	3→5	3→5	✅ collect-user-input	✅

1 run per scenario

Skill: fetch-and-send-data

Data fetching patterns across render modes — cancellation with CancellationTokenSource, OnParametersSetAsync for route-driven loads, error handling, retry UI, IAsyncDisposable.

Scenario	Baseline	Isolated	Plugin	Verdict
Recipe browser with resilient loading	3→5	3→5	✅ fetch-and-send-data	✅
Real-time shipment tracker	3→5	3→5	✅ fetch-and-send-data	✅

1 run per scenario

Skill: coordinate-components

Share state across components using CascadingValueSource<T> via DI, scoped services with change events, and NotifyChangedAsync protocol.

Scenario	Baseline	Isolated	Plugin	Verdict
Warehouse dashboard with site selector and live stock alerts	2→5	2→5	✅ coordinate-components	✅

+35.4% | Overfitting: 0.22 | 1 run per scenario

Skill: configure-auth

Authentication and authorization across render modes — Identity setup with roles/policies, AuthorizeRouteView, ExcludeFromInteractiveRouting for Identity pages, AddAuthenticationStateSerialization/Deserialization for WebAssembly/Auto.

Scenario	Baseline	Isolated	Plugin	Verdict
Company intranet with role-based access and policies	❌	5/5	5/5	✅
Login and account management (global interactive)	❌	5/5	5/5	✅
Multi-tier app with WebAssembly auth	3→5	3→5	✅ configure-auth	✅

+27.7% | Overfitting: 0.06 | 1 run per scenario

All evals run on claude-opus-4.6 with pairwise judging.

Copilot

Pull request overview

Adds a new dotnet-aspnet plugin entry to the repo and introduces an author-component skill intended to guide idiomatic Blazor component authoring, along with eval coverage for the new skill.

Changes:

Added dotnet-aspnet plugin manifest and registered it in both marketplace files + README.
Added author-component skill documentation and supporting reference guides (async rules, decomposition, disposal).
Added eval scenarios under tests/dotnet-aspnet/author-component/ to validate skill behavior.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
`plugins/dotnet-aspnet/plugin.json`	Introduces the new plugin manifest.
`.github/plugin/marketplace.json`	Registers `dotnet-aspnet` in the GitHub marketplace index.
`.claude-plugin/marketplace.json`	Mirrors the marketplace registration for Claude.
`README.md`	Adds `dotnet-aspnet` to the top-level plugin list.
`.github/CODEOWNERS`	Adds ownership rules for the new plugin/tests paths.
`plugins/dotnet-aspnet/skills/author-component/SKILL.md`	Main skill content: Blazor component authoring rules and patterns.
`plugins/dotnet-aspnet/skills/author-component/references/async-programming-rules.md`	Deep-dive reference for async patterns and pitfalls in Blazor.
`plugins/dotnet-aspnet/skills/author-component/references/breaking-down-components.md`	Reference for component decomposition patterns.
`plugins/dotnet-aspnet/skills/author-component/references/component-disposal.md`	Reference for disposal patterns and cleanup rules.
`tests/dotnet-aspnet/author-component/eval.yaml`	Adds eval scenarios/rubrics to measure the new skill.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

Copilot

Pull request overview

Adds a new dotnet-blazor plugin with an author-component skill intended to guide component authoring/review toward idiomatic Blazor patterns (parameters, EventCallback, RenderFragment, lifecycle, async, disposal), along with eval coverage.

Changes:

Introduces dotnet-blazor plugin manifest and registers it in both marketplaces, CODEOWNERS, and repo README.
Adds the author-component skill (SKILL.md) plus reference docs for async rules, decomposition, and disposal patterns.
Adds eval scenarios for the new skill under tests/dotnet-blazor/author-component.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
`plugins/dotnet-blazor/plugin.json`	New plugin manifest for `dotnet-blazor`.
`plugins/dotnet-blazor/skills/author-component/SKILL.md`	Primary skill guidance for authoring/reviewing Blazor components.
`plugins/dotnet-blazor/skills/author-component/references/async-programming-rules.md`	Deep-dive guidance for async patterns and anti-patterns in Blazor.
`plugins/dotnet-blazor/skills/author-component/references/breaking-down-components.md`	Reference patterns for decomposing UI into components and cascading context.
`plugins/dotnet-blazor/skills/author-component/references/component-disposal.md`	Reference patterns for disposal (`IAsyncDisposable`), timers, and JS interop cleanup.
`tests/dotnet-blazor/author-component/eval.yaml`	Adds evaluation scenarios/rubrics for the new skill.
`.github/plugin/marketplace.json`	Registers the new plugin in the GitHub marketplace list.
`.claude-plugin/marketplace.json`	Mirrors the marketplace registration for Claude Code.
`.github/CODEOWNERS`	Adds ownership entries for the new plugin and its tests.
`README.md`	Adds `dotnet-blazor` to the repo’s plugin list.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

Copilot

Pull request overview

Introduces a new dotnet-blazor plugin to the repo, intended to provide curated guidance/evals for Blazor component authoring patterns (and, as included in the changes, JS interop patterns as well).

Changes:

Adds the dotnet-blazor plugin manifest plus marketplace/README/CODEOWNERS wiring.
Adds the author-component skill (SKILL.md + reference docs) and authoring-focused eval scenarios.
Adds a use-js-interop skill and corresponding eval scenarios under tests/dotnet-blazor/use-js-interop/.

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
`plugins/dotnet-blazor/plugin.json`	Defines the new plugin manifest and skill root.
`plugins/dotnet-blazor/skills/author-component/SKILL.md`	New guidance for idiomatic Blazor component authoring.
`plugins/dotnet-blazor/skills/author-component/references/async-programming-rules.md`	Deep-dive reference for async patterns in Blazor components.
`plugins/dotnet-blazor/skills/author-component/references/breaking-down-components.md`	Deep-dive reference for component decomposition patterns.
`plugins/dotnet-blazor/skills/author-component/references/component-disposal.md`	Deep-dive reference for component disposal patterns.
`tests/dotnet-blazor/author-component/eval.yaml`	Adds eval scenarios validating author-component guidance.
`plugins/dotnet-blazor/skills/use-js-interop/SKILL.md`	New JS interop guidance for Blazor, including module/disposal patterns.
`tests/dotnet-blazor/use-js-interop/eval.yaml`	Adds JS interop eval scenarios.
`.github/plugin/marketplace.json`	Registers `dotnet-blazor` plugin in the GitHub marketplace manifest.
`.claude-plugin/marketplace.json`	Mirrors the marketplace registration for Claude plugin manifest.
`.github/CODEOWNERS`	Adds ownership entries for the new plugin and tests paths.
`README.md`	Adds `dotnet-blazor` to the repo’s plugin list.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.

Copilot

Pull request overview

Adds a new dotnet-blazor plugin to the repo’s skill ecosystem, with Blazor-focused SKILL.md guidance and corresponding eval scenarios, plus validator enhancements to support scenario filtering and improved work-dir handling.

Changes:

Introduces the plugins/dotnet-blazor plugin (skills + plan + MCP config) and registers it in marketplace + CODEOWNERS + README.
Adds tests/dotnet-blazor/**/eval.yaml suites for multiple Blazor skill areas (component authoring, JS interop, prerendering, auth, etc.).
Extends eng/skill-validator to support per-scenario environment, scenario name filtering, and configurable/readable work directories.

Reviewed changes

Copilot reviewed 40 out of 40 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
tests/dotnet-blazor/use-js-interop/eval.yaml	Eval scenarios asserting Blazor JS interop best practices.
tests/dotnet-blazor/support-prerendering/eval.yaml	Eval scenarios for prerender-to-interactive correctness patterns.
tests/dotnet-blazor/plan-ui-change/eval.yaml	Eval scenarios for UI decomposition/planning behaviors.
tests/dotnet-blazor/fetch-and-send-data/eval.yaml	Eval scenario for async data loading/cancellation/error handling patterns.
tests/dotnet-blazor/create-blazor-project/eval.yaml	Eval scenarios for choosing correct Blazor template/config for different requirements.
tests/dotnet-blazor/coordinate-components/eval.yaml	Eval scenario for cross-component state propagation patterns.
tests/dotnet-blazor/configure-auth/eval.yaml	Eval scenarios for Identity + auth routing patterns across render modes.
tests/dotnet-blazor/collect-user-input/eval.yaml	Eval scenarios for forms, validation, and file upload constraints.
tests/dotnet-blazor/author-component/eval.yaml	Eval scenarios for general component authoring + lifecycle/async/disposal rules.
plugins/dotnet-blazor/skills/use-js-interop/SKILL.md	New skill content for Blazor JS interop guidance.
plugins/dotnet-blazor/skills/support-prerendering/SKILL.md	New skill content for prerendering pitfalls + solutions.
plugins/dotnet-blazor/skills/plan-ui-change/SKILL.md	New skill content for structured component decomposition planning.
plugins/dotnet-blazor/skills/fetch-and-send-data/SKILL.md	New skill content for data fetching/submission lifecycle patterns.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/webassembly-per-page.md	AGENTS.md template asset for WASM per-page projects.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/webassembly-global.md	AGENTS.md template asset for WASM global projects.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/ssr-none.md	AGENTS.md template asset for static SSR-only projects.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/server-per-page.md	AGENTS.md template asset for Server per-page projects.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/server-global.md	AGENTS.md template asset for Server global projects.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/auto-per-page.md	AGENTS.md template asset for Auto per-page projects.
plugins/dotnet-blazor/skills/create-blazor-project/assets/agents-md/auto-global.md	AGENTS.md template asset for Auto global projects.
plugins/dotnet-blazor/skills/create-blazor-project/SKILL.md	New skill content for scaffolding/initial project choices.
plugins/dotnet-blazor/skills/coordinate-components/SKILL.md	New skill content for shared state patterns across components/render modes.
plugins/dotnet-blazor/skills/configure-auth/SKILL.md	New skill content for auth/Identity patterns across render modes.
plugins/dotnet-blazor/skills/collect-user-input/SKILL.md	New skill content for forms + SSR vs interactive input patterns.
plugins/dotnet-blazor/skills/author-component/references/component-disposal.md	Reference doc for correct disposal patterns (IAsyncDisposable).
plugins/dotnet-blazor/skills/author-component/references/breaking-down-components.md	Reference doc for decomposition patterns and cascading context.
plugins/dotnet-blazor/skills/author-component/references/async-programming-rules.md	Reference doc for Blazor async/sync-context rules.
plugins/dotnet-blazor/skills/author-component/SKILL.md	New/updated core component-authoring guidance.
plugins/dotnet-blazor/plugin.json	New plugin manifest for dotnet-blazor.
plugins/dotnet-blazor/PLAN.md	Dotnet-blazor plugin plan/structure document.
plugins/dotnet-blazor/.mcp.json	MCP server definitions intended for the plugin.
eng/skill-validator/src/Services/EvalSchema.cs	Adds `environment` field parsing for scenarios.
eng/skill-validator/src/Services/AgentRunner.cs	Adds configurable/readable work dirs + run indexing.
eng/skill-validator/src/Models/Models.cs	Adds scenario `Environment` and new validator CLI config flags.
eng/skill-validator/src/Commands/ValidateCommand.cs	Adds CLI flags: keep work dirs, work dir base, readable names, scenario/env filtering; threads RunIndex.
README.md	Adds dotnet-blazor entry to the plugin list.
.github/plugin/marketplace.json	Registers dotnet-blazor in GitHub marketplace catalog.
.github/CODEOWNERS	Adds ownership rules for dotnet-blazor plugin/tests.
.claude-plugin/marketplace.json	Registers dotnet-blazor in Claude marketplace catalog.
.agents/skills/create-skill-evaluation/SKILL.md	Documentation update describing new work-dir preservation workflow/flags.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot

Pull request overview

Copilot reviewed 33 out of 33 changed files in this pull request and generated 6 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

javiercn · 2026-05-25T14:17:02Z

/evaluate

github-actions · 2026-05-25T14:33:02Z

Skill Validation Results

Skill	Scenario	Quality	Skills Loaded	Overfit	Verdict
plan-ui-change	Project management Kanban board	2.0/5 → 4.3/5 🟢	✅ plan-ui-change; tools: skill, grep / ✅ plan-ui-change; author-component; tools: skill, grep, edit	✅ 0.10	✅
plan-ui-change	E-commerce product catalog with filters and pagination	2.7/5 → 4.3/5 🟢	✅ plan-ui-change; tools: skill, edit, grep, glob / ✅ plan-ui-change; tools: skill, grep, edit	✅ 0.10	✅
plan-ui-change	Multi-step job application wizard	2.0/5 → 4.0/5 🟢	✅ plan-ui-change; tools: skill	✅ 0.10	✅
plan-ui-change	Application settings page with nested tab panels	3.0/5 → 4.0/5 🟢	✅ plan-ui-change; tools: skill / ✅ plan-ui-change; tools: skill, grep	✅ 0.10	✅
plan-ui-change	Team chat interface with message threads	2.0/5 → 4.0/5 🟢	✅ plan-ui-change; tools: skill, edit / ✅ plan-ui-change; tools: skill, edit, grep	✅ 0.10	✅
create-blazor-project	University course catalog with enrollment form	3.0/5 → 4.7/5 🟢	✅ create-blazor-project; tools: skill, task, read_agent, read_bash, glob / ✅ create-blazor-project; tools: skill, read_bash	🟡 0.26	✅ [1]
create-blazor-project	Recipe community with interactive ratings on static pages	4.3/5 → 4.3/5	✅ create-blazor-project; tools: skill, glob / ✅ create-blazor-project; plan-ui-change; tools: skill, read_bash	🟡 0.26	✅ [2]
create-blazor-project	Global logistics tracking for worldwide users	3.3/5 → 4.7/5 🟢	✅ create-blazor-project; tools: skill, task, read_agent / ✅ create-blazor-project; tools: skill, task, glob, read_agent	🟡 0.26	✅ [3]
use-js-interop	Auto-saving notepad that survives page reloads	2.7/5 → 3.7/5 🟢	✅ use-js-interop; tools: skill	🟡 0.21	✅ [4]
use-js-interop	User activity tracker that detects idle timeout	4.0/5 → 4.7/5 🟢	✅ use-js-interop; tools: skill	🟡 0.21	✅
use-js-interop	Responsive layout that adapts to screen size	3.3/5 → 4.0/5 🟢	✅ use-js-interop; tools: skill / ✅ use-js-interop; tools: skill, glob	🟡 0.21	✅ [5]
use-js-interop	Infinite scroll list using IntersectionObserver	3.0/5 → 4.7/5 🟢	✅ use-js-interop; tools: skill, edit	🟡 0.21	✅ [6]
fetch-and-send-data	Recipe browser with resilient data loading	3.0/5 → 4.0/5 🟢	✅ fetch-and-send-data; tools: skill	✅ 0.18	✅
fetch-and-send-data	Real-time shipment tracker with Auto interactivity	4.0/5 → 4.3/5 🟢	✅ fetch-and-send-data; tools: skill	✅ 0.18	✅ [7]
configure-auth	Login and account management in a globally interactive app	5.0/5 → 5.0/5	✅ configure-auth; tools: skill	✅ 0.08	✅ [8]
configure-auth	Multi-tier app with WebAssembly auth	2.0/5 → 4.0/5 🟢	✅ configure-auth; tools: skill, glob	✅ 0.08	✅
collect-user-input	Event registration with custom validation	4.0/5 → 4.7/5 🟢	✅ collect-user-input; tools: skill	✅ 0.09	✅
collect-user-input	Multi-step booking form with cross-field validation	3.3/5 → 4.0/5 🟢	✅ collect-user-input; tools: skill	✅ 0.09	✅
convert-blazor-server-to-webapp	Blazor Server app with CascadingAuthenticationState	4.0/5 → 5.0/5 🟢	✅ convert-blazor-server-to-webapp; tools: report_intent, skill	✅ 0.04	✅
coordinate-components	Warehouse dashboard with site selector and live stock alerts	4.3/5 → 4.3/5	✅ coordinate-components; tools: skill	🟡 0.26	✅ [9]
coordinate-components	Multi-tenant notification hub with cross-component fan-out	1.3/5 → 4.0/5 🟢	✅ coordinate-components; tools: skill	🟡 0.26	✅ [10]
support-prerendering	Equipment inventory loaded once	3.3/5 → 4.0/5 🟢	✅ support-prerendering; tools: skill, view, edit	🟡 0.22	✅ [11]
support-prerendering	Notifications page with live polling	3.0/5 → 3.7/5 🟢	✅ support-prerendering; tools: skill	🟡 0.22	✅
author-component	Author a data-loading search component	3.3/5 → 4.0/5 🟢	✅ author-component; tools: skill, view	✅ 0.20	✅ [12]
author-component	Author a multi-step wizard with async validation and shared state	3.7/5 → 4.3/5 🟢	✅ author-component; tools: skill, view, bash / ✅ author-component; tools: skill, view	✅ 0.20	✅ [13]
author-component	Author a generic data table component	4.0/5 → 4.7/5 🟢	✅ author-component; tools: skill, view	✅ 0.20	✅
author-component	Author a real-time notification badge component	2.0/5 → 4.3/5 🟢	✅ author-component; tools: skill, view, bash / ✅ author-component; tools: skill, view	✅ 0.20	✅
author-component	Author a sortable list with code-behind pattern	3.7/5 → 5.0/5 🟢	✅ author-component; tools: skill, bash / ✅ author-component; tools: skill, view, bash	✅ 0.20	✅

[1] ⚠️ High run-to-run variance (CV=32870%) — consider re-running with --runs 5
[2] ⚠️ High run-to-run variance (CV=81%) — consider re-running with --runs 5
[3] ⚠️ High run-to-run variance (CV=114%) — consider re-running with --runs 5
[4] ⚠️ High run-to-run variance (CV=302%) — consider re-running with --runs 5
[5] ⚠️ High run-to-run variance (CV=68%) — consider re-running with --runs 5
[6] ⚠️ High run-to-run variance (CV=70%) — consider re-running with --runs 5
[7] ⚠️ High run-to-run variance (CV=92%) — consider re-running with --runs 5
[8] ⚠️ High run-to-run variance (CV=123%) — consider re-running with --runs 5
[9] ⚠️ High run-to-run variance (CV=62%) — consider re-running with --runs 5
[10] ⚠️ High run-to-run variance (CV=234%) — consider re-running with --runs 5
[11] ⚠️ High run-to-run variance (CV=86%) — consider re-running with --runs 5
[12] ⚠️ High run-to-run variance (CV=133%) — consider re-running with --runs 5
[13] ⚠️ High run-to-run variance (CV=63%) — consider re-running with --runs 5

Model: claude-opus-4.6 | Judge: claude-opus-4.6

🔍 Full Results - additional metrics and failure investigation steps

▶ Sessions Visualisation -- interactive replay of all evaluation sessions

Add the dotnet-blazor plugin with 9 skills covering Blazor Web App development: - plan-ui-change: Plan and scaffold UI features in Blazor Web Apps - create-blazor-project: Create new Blazor projects with proper render mode setup - author-component: Author Razor components with parameters, events, lifecycle - coordinate-components: Share state across components using CascadingValueSource/scoped services - use-js-interop: Call JavaScript from Blazor and vice versa - fetch-and-send-data: HTTP data access with proper service patterns - configure-auth: Set up ASP.NET Core Identity and authorization in Blazor - collect-user-input: Build forms with EditForm, validation, and file uploads - support-prerendering: Handle prerendering lifecycle and state persistence Add convert-blazor-server-to-webapp skill to the dotnet-aspnet plugin for migrating .NET 7 Blazor Server apps to .NET 8+ Blazor Web App architecture. All 10 skills pass evaluation with quality improvements ranging from 12-50% and overfitting scores within acceptable thresholds. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Evangelink · 2026-05-25T16:13:40Z

/evaluate

github-actions · 2026-05-25T16:29:36Z

Skill Validation Results

Skill	Scenario	Quality	Skills Loaded	Overfit	Verdict
plan-ui-change	Project management Kanban board	1.7/5 → 3.0/5 🟢	✅ plan-ui-change; tools: skill, report_intent, view, bash, create, grep, edit / ✅ plan-ui-change; tools: skill, report_intent, view, create, bash, grep, edit	✅ 0.16	✅ [1]
plan-ui-change	E-commerce product catalog with filters and pagination	2.3/5 → 4.3/5 🟢	✅ plan-ui-change; tools: skill, grep, report_intent, view, bash, create, edit, glob / ✅ plan-ui-change; tools: skill, grep, report_intent, view, bash, create	✅ 0.16	✅
plan-ui-change	Multi-step job application wizard	2.7/5 → 2.7/5	✅ plan-ui-change; tools: skill, bash, create, edit	✅ 0.16	❌ [2]
plan-ui-change	Application settings page with nested tab panels	2.0/5 → 3.0/5 🟢	✅ plan-ui-change; tools: skill / ✅ plan-ui-change; tools: report_intent, view, skill, grep, bash, create, edit	✅ 0.16	✅ [3]
plan-ui-change	Team chat interface with message threads	1.3/5 → 3.0/5 🟢	✅ plan-ui-change; tools: report_intent, skill, view, bash, create, edit / ✅ plan-ui-change; tools: report_intent, skill, view, bash, create, edit, grep	✅ 0.16	❌ [4]
create-blazor-project	University course catalog with enrollment form	2.0/5 → 4.7/5 🟢	✅ create-blazor-project; tools: skill	🟡 0.26	✅
create-blazor-project	Recipe community with interactive ratings on static pages	4.0/5 → 4.7/5 🟢	✅ create-blazor-project; tools: skill	🟡 0.26	✅
create-blazor-project	Global logistics tracking for worldwide users	2.7/5 → 4.3/5 🟢	✅ create-blazor-project; tools: skill / ✅ create-blazor-project; tools: skill, glob, task, read_agent	🟡 0.26	✅
use-js-interop	Auto-saving notepad that survives page reloads	3.0/5 → 3.7/5 🟢	✅ use-js-interop; tools: skill, edit	🟡 0.22	✅
use-js-interop	User activity tracker that detects idle timeout	4.0/5 → 4.3/5 🟢	✅ use-js-interop; tools: skill	🟡 0.22	✅ [5]
use-js-interop	Responsive layout that adapts to screen size	4.0/5 → 4.0/5	✅ use-js-interop; tools: skill / ✅ use-js-interop; tools: skill, glob	🟡 0.22	✅ [6]
use-js-interop	Infinite scroll list using IntersectionObserver	3.0/5 → 4.3/5 🟢	✅ use-js-interop; tools: skill, edit	🟡 0.22	✅ [7]
fetch-and-send-data	Recipe browser with resilient data loading	3.0/5 → 3.7/5 🟢	✅ fetch-and-send-data; tools: skill	🟡 0.23	✅ [8]
fetch-and-send-data	Real-time shipment tracker with Auto interactivity	4.0/5 → 4.0/5	✅ fetch-and-send-data; tools: skill	🟡 0.23	✅
configure-auth	Login and account management in a globally interactive app	5.0/5 → 5.0/5	✅ configure-auth; tools: skill	✅ 0.06	✅
configure-auth	Multi-tier app with WebAssembly auth	2.3/5 → 4.7/5 🟢	✅ configure-auth; tools: skill / ✅ configure-auth; tools: glob, skill	✅ 0.06	✅
collect-user-input	Event registration with custom validation	4.0/5 → 5.0/5 🟢	✅ collect-user-input; tools: skill	✅ 0.14	✅
collect-user-input	Multi-step booking form with cross-field validation	3.7/5 → 4.0/5 🟢	✅ collect-user-input; tools: skill	✅ 0.14	✅ [9]
convert-blazor-server-to-webapp	Blazor Server app with CascadingAuthenticationState	4.0/5 → 5.0/5 🟢	✅ convert-blazor-server-to-webapp; tools: report_intent, skill / ✅ convert-blazor-server-to-webapp; tools: skill, report_intent	✅ 0.06	✅
coordinate-components	Warehouse dashboard with site selector and live stock alerts	4.7/5 → 4.7/5	✅ coordinate-components; tools: skill	🟡 0.24	❌ [10]
coordinate-components	Multi-tenant notification hub with cross-component fan-out	1.0/5 → 5.0/5 🟢	✅ coordinate-components; tools: skill	🟡 0.24	✅
support-prerendering	Equipment inventory loaded once	4.3/5 → 5.0/5 🟢	✅ support-prerendering; tools: skill, view, edit / ✅ support-prerendering; tools: skill, view, stop_bash, edit	🟡 0.22	✅ [11]
support-prerendering	Notifications page with live polling	3.0/5 → 3.3/5 🟢	✅ support-prerendering; tools: skill	🟡 0.22	✅
author-component	Author a data-loading search component	3.3/5 → 4.0/5 🟢	✅ author-component; tools: skill, view, bash	🟡 0.20	✅ [12]
author-component	Author a multi-step wizard with async validation and shared state	4.0/5 → 4.3/5 🟢	✅ author-component; tools: skill, view / ✅ author-component; tools: skill, view, glob	🟡 0.20	✅ [13]
author-component	Author a generic data table component	4.0/5 → 4.7/5 🟢	✅ author-component; tools: skill, view	🟡 0.20	✅ [14]
author-component	Author a real-time notification badge component	2.0/5 → 4.3/5 🟢	✅ author-component; tools: skill, view, bash / ✅ author-component; tools: skill, view	🟡 0.20	✅
author-component	Author a sortable list with code-behind pattern	3.7/5 → 5.0/5 🟢	✅ author-component; tools: skill, bash, view / ✅ author-component; tools: skill, view, bash	🟡 0.20	✅

[1] ⚠️ High run-to-run variance (CV=513%) — consider re-running with --runs 5
[2] ⚠️ High run-to-run variance (CV=734%) — consider re-running with --runs 5. (Isolated) Quality unchanged but weighted score is -54.3% due to: quality, judgment, time (104.4s → 151.4s)
[3] ⚠️ High run-to-run variance (CV=103%) — consider re-running with --runs 5
[4] ⚠️ High run-to-run variance (CV=107%) — consider re-running with --runs 5. (Isolated) Quality improved but weighted score is -5.0% due to: tokens (49743 → 202526), tool calls (6 → 22), time (50.7s → 165.8s)
[5] ⚠️ High run-to-run variance (CV=110%) — consider re-running with --runs 5
[6] ⚠️ High run-to-run variance (CV=166%) — consider re-running with --runs 5
[7] ⚠️ High run-to-run variance (CV=52%) — consider re-running with --runs 5
[8] ⚠️ High run-to-run variance (CV=54%) — consider re-running with --runs 5
[9] ⚠️ High run-to-run variance (CV=164%) — consider re-running with --runs 5
[10] ⚠️ High run-to-run variance (CV=146%) — consider re-running with --runs 5. (Plugin) Quality unchanged but weighted score is -25.2% due to: judgment, quality, tokens (184361 → 255721)
[11] ⚠️ High run-to-run variance (CV=148%) — consider re-running with --runs 5
[12] ⚠️ High run-to-run variance (CV=150%) — consider re-running with --runs 5
[13] ⚠️ High run-to-run variance (CV=75%) — consider re-running with --runs 5
[14] ⚠️ High run-to-run variance (CV=105%) — consider re-running with --runs 5

Model: claude-opus-4.6 | Judge: claude-opus-4.6

🔍 Full Results - additional metrics and failure investigation steps

▶ Sessions Visualisation -- interactive replay of all evaluation sessions

javiercn requested review from dbreshears and timheuer as code owners March 13, 2026 15:14

Copilot AI review requested due to automatic review settings March 13, 2026 15:14

Copilot started reviewing on behalf of javiercn March 13, 2026 15:14 View session

Copilot AI reviewed Mar 13, 2026

View reviewed changes

javiercn changed the title ~~Add author-component skill to dotnet-aspnet plugin~~ Add author-component skill to dotnet-blazor plugin Mar 13, 2026

Copilot AI review requested due to automatic review settings March 13, 2026 15:20

javiercn force-pushed the javiercn/author-component branch from 4ad6c98 to 9637c51 Compare March 13, 2026 15:20

Copilot started reviewing on behalf of javiercn March 13, 2026 15:20 View session

Copilot AI reviewed Mar 13, 2026

View reviewed changes

Comment thread plugins/dotnet-blazor/skills/author-component/references/async-programming-rules.md Outdated

Comment thread plugins/dotnet-blazor/skills/author-component/references/component-disposal.md Outdated

Comment thread plugins/dotnet-blazor/skills/author-component/SKILL.md Outdated

javiercn requested review from Copilot, danroth27 and lewing March 13, 2026 16:06

Copilot started reviewing on behalf of javiercn March 14, 2026 17:09 View session

Copilot AI reviewed Mar 14, 2026

View reviewed changes

Comment thread plugins/dotnet-blazor/skills/use-js-interop/SKILL.md

Comment thread .github/CODEOWNERS Outdated

javiercn changed the title ~~Add author-component skill to dotnet-blazor plugin~~ Add blazor skills to dotnet-blazor plugin Mar 15, 2026

danmoseley added the area-aspnet label Mar 23, 2026

danroth27 added the skill label Mar 23, 2026

danmoseley mentioned this pull request Mar 24, 2026

Add convert-blazor-server-to-webapp skill #207

Closed

Copilot AI review requested due to automatic review settings March 24, 2026 09:12

javiercn requested review from JanKrivanek and ViktorHofer as code owners March 24, 2026 09:12

Copilot started reviewing on behalf of javiercn March 24, 2026 09:13 View session

Copilot AI reviewed Mar 24, 2026

View reviewed changes

Comment thread eng/skill-validator/src/Services/AgentRunner.cs Outdated

Comment thread plugins/dotnet-blazor/plugin.json Outdated

Comment thread tests/dotnet-blazor/support-prerendering/eval.yaml

javiercn force-pushed the javiercn/author-component branch from 46203b1 to a174bf4 Compare March 27, 2026 13:36

Copilot AI review requested due to automatic review settings March 27, 2026 13:41

Copilot started reviewing on behalf of javiercn March 27, 2026 13:41 View session

Copilot AI reviewed Mar 27, 2026

View reviewed changes

javiercn force-pushed the javiercn/author-component branch from 5b17cbd to 5aef6f4 Compare March 28, 2026 15:10

github-actions Bot mentioned this pull request Mar 30, 2026

🏥 Repository Health Dashboard #288

Closed

This comment has been minimized.

Sign in to view

github-actions Bot mentioned this pull request May 25, 2026

Add Codex-native plugin marketplace manifest #555

Merged

This comment has been minimized.

Sign in to view

This comment was marked as outdated.

Sign in to view

javiercn commented May 25, 2026

View reviewed changes

Comment thread plugins/dotnet-blazor/plugin.json Outdated

Comment thread eng/allowed-external-deps.txt Outdated

Comment thread .gitignore Outdated

javiercn and others added 3 commits May 25, 2026 18:05

Update eng/allowed-external-deps.txt

90bec2b

Update .gitignore

c791e40

lewing approved these changes May 25, 2026

View reviewed changes

github-actions Bot mentioned this pull request May 31, 2026

🏥 Repository Health Dashboard #695

Open

Uh oh!

Conversation

javiercn commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

What's included

Plugin infrastructure

Skill: author-component

Skill: use-js-interop

Skill: plan-ui-change

Skill: create-blazor-project

Skill: support-prerendering

Skill: collect-user-input

Skill: fetch-and-send-data

Skill: coordinate-components

Skill: configure-auth

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment was marked as outdated.

javiercn commented May 25, 2026

javiercn commented Mar 13, 2026 •

edited

Loading