Skip to content

Add static eval for repo skills/agents via skill-validator#13537

Merged
JanKrivanek merged 4 commits into
dotnet:mainfrom
JanKrivanek:dev/jankrivanek/skill-validator
Apr 15, 2026
Merged

Add static eval for repo skills/agents via skill-validator#13537
JanKrivanek merged 4 commits into
dotnet:mainfrom
JanKrivanek:dev/jankrivanek/skill-validator

Address review feedback: dynamic counts, issues:write, artifact error…

e7a453d
Select commit
Loading
Failed to load commit list.
Azure Pipelines / msbuild-pr succeeded Apr 15, 2026 in 51m 49s

Build #20260414.32 had test failures

Details

Tests

  • Failed: 3 (0.00%)
  • Passed: 109,991 (98.07%)
  • Other: 2,158 (1.92%)
  • Total: 112,152

Annotations

Check failure on line 1 in Microsoft.Build.UnitTests.ToolTask_Tests.ToolTaskThatTimeoutAndRetry(repeats: 3, timeoutOnFirstExecution: True)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / msbuild-pr

Microsoft.Build.UnitTests.ToolTask_Tests.ToolTaskThatTimeoutAndRetry(repeats: 3, timeoutOnFirstExecution: True)

Shouldly.ShouldAssertException : for (int attempt = 1; attempt <= repeats; attempt++)
            {
                bool shouldSucceed = attempt > 1 || !timeoutOnFirstExecution;
                bool result = task.Execute();

                _output.WriteLine(
                    $"Attempt {attempt}/{repeats}: expectedSuccess={shouldSucceed}, actualSuccess={result}, exitCode={task.ExitCode}.");

                if (!string.IsNullOrEmpty(engine.Log))
                {
                    _output.WriteLine(engine.Log);
                    engine.Log = string.Empty;
                }

                task.RepeatCount.ShouldBe(attempt);
                result.ShouldBe(shouldSucceed);

                if (shouldSucceed)
                {
                    task.ExitCode.ShouldBe(0);
                }
                else
                {
                    task.ExitCode
    should not be
0
    but was
Raw output
   at Microsoft.Build.UnitTests.ToolTask_Tests.ToolTaskThatTimeoutAndRetry(Int32 repeats, Boolean timeoutOnFirstExecution) in D:\a\_work\1\s\src\Utilities.UnitTests\ToolTask_Tests.cs:line 1045

Check failure on line 1 in Microsoft.Build.Engine.UnitTests.MSBuildTaskHostTests.CompileNet35WinFormsApp

See this annotation in the file changed.

@azure-pipelines azure-pipelines / msbuild-pr

Microsoft.Build.Engine.UnitTests.MSBuildTaskHostTests.CompileNet35WinFormsApp

System.TimeoutException : Test failed due to timeout: process 2684 is active for more than 30 sec.
Raw output
   at Microsoft.Build.UnitTests.Shared.RunnerUtilities.RunProcessAndGetOutput(String process, String parameters, Boolean& successfulExit, Boolean shellExecute, ITestOutputHelper outputHelper, Boolean attachProcessId, Int32 timeoutMilliseconds, Dictionary`2 environmentVariables) in /_/src/UnitTests.Shared/RunnerUtilities.cs:line 184
   at Microsoft.Build.UnitTests.Shared.RunnerUtilities.ExecBootstrapedMSBuild(String msbuildParameters, Boolean& successfulExit, Boolean shellExecute, ITestOutputHelper outputHelper, Boolean attachProcessId, Int32 timeoutMilliseconds) in /_/src/UnitTests.Shared/RunnerUtilities.cs:line 76
   at Microsoft.Build.Engine.UnitTests.MSBuildTaskHostTests.CompileNet35WinFormsApp() in D:\a\_work\1\s\src\Build.UnitTests\MSBuildTaskHostTests.cs:line 36

Check failure on line 1 in Microsoft.Build.UnitTests.FileLogger_Tests.DistributedFileLoggerParameters

See this annotation in the file changed.

@azure-pipelines azure-pipelines / msbuild-pr

Microsoft.Build.UnitTests.FileLogger_Tests.DistributedFileLoggerParameters

Microsoft.Build.Framework.LoggerException : Failed to write to log file "msbuild0.log". The process cannot access the file 'D:\a\_work\1\s\artifacts\bin\Microsoft.Build.Engine.UnitTests\Release\net472\msbuild0.log' because it is being used by another process.
Raw output
   at Microsoft.Build.Logging.FileLogger.InitializeFileLogger(IEventSource eventSource, Int32 nodeCount) in /_/src/Build/Logging/FileLogger.cs:line 128
   at Microsoft.Build.Logging.FileLogger.Initialize(IEventSource eventSource, Int32 nodeCount) in /_/src/Build/Logging/FileLogger.cs:line 137
   at Microsoft.Build.Logging.DistributedFileLogger.Initialize(IEventSource eventSource) in /_/src/Build/Logging/DistributedLoggers/DistributedFileLogger.cs:line 129
   at Microsoft.Build.UnitTests.FileLogger_Tests.DistributedFileLoggerParameters() in D:\a\_work\1\s\src\Build.UnitTests\FileLogger_Tests.cs:line 489