Sync eng/common directory with azure-sdk-tools for PR 13478 - #39497
Merged
Azure Pipelines / azure-rest-api-specs - copilot - eval
failed
Jan 7, 2026 in 4m 7s
Build #20260107.1 had test failures
Details
- Failed: 1 (16.67%)
- Passed: 5 (83.33%)
- Other: 0 (0.00%)
- Total: 6
Annotations
Check failure on line 101 in Build log
azure-pipelines / azure-rest-api-specs - copilot - eval
Build log #L101
Script failed with exit code: 1
azure-pipelines / azure-rest-api-specs - copilot - eval
Azure.Sdk.Tools.Cli.Evaluations.Scenarios.Scenario.Evaluate_ValidateTypespec
Expected metric.Interpretation!.Failed to be False because Result did not match the expected outcome. Provided LLM Result contained no tool call. Expected to call: azsdk_verify_setup,azsdk_run_typespec_validation, but found True.
Raw output
at AwesomeAssertions.Execution.LateBoundTestFramework.Throw(String message)
at AwesomeAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
at AwesomeAssertions.Execution.AssertionScope.AddPreFormattedFailure(String formattedFailureMessage)
at AwesomeAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
at AwesomeAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
at AwesomeAssertions.Execution.AssertionChain.FailWith(String message, Object[] args)
at AwesomeAssertions.Primitives.BooleanAssertions`1.BeFalse(String because, Object[] becauseArgs)
at Azure.Sdk.Tools.Cli.Evaluations.Helpers.EvaluationHelper.ValidateBooleanMetricEvaluator(EvaluationResult result, String metricName) in /mnt/vss/_work/1/s/azure-sdk-tools/tools/azsdk-cli/Azure.Sdk.Tools.Cli.Evaluations/Helpers/EvaluationHelper.cs:line 17
at Azure.Sdk.Tools.Cli.Evaluations.Helpers.EvaluationHelper.ValidateToolInputsEvaluator(EvaluationResult result) in /mnt/vss/_work/1/s/azure-sdk-tools/tools/azsdk-cli/Azure.Sdk.Tools.Cli.Evaluations/Helpers/EvaluationHelper.cs:line 24
at Azure.Sdk.Tools.Cli.Evaluations.Scenarios.Scenario.Evaluate_ValidateTypespec() in /mnt/vss/_work/1/s/azure-sdk-tools/tools/azsdk-cli/Azure.Sdk.Tools.Cli.Evaluations/Scenarios/AzureRestApiSpecs/Evaluate_ValidateTypespec.cs:line 43
at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
at NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter awaiter)
at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
at NUnit.Framework.Internal.Commands.DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)
Loading