[MTP] Improve performance of validating command line options#5655
Merged
Azure Pipelines / microsoft.testfx
succeeded
Apr 21, 2026 in 26m 33s
Build #20260420.16 had test failures
Details
- Failed: 3 (0.01%)
- Passed: 38,385 (99.09%)
- Other: 350 (0.90%)
- Total: 38,738
- 172134 of 255451 blocks covered (67.38%)
- 112496 of 170229 lines covered (66.09%)
Annotations
Check failure on line 32 in Build log
azure-pipelines / microsoft.testfx
Build log #L32
Artifact Logs_Build_Darwin_Debug already exists for build 1387596.
azure-pipelines / microsoft.testfx
MSTest.Acceptance.IntegrationTests.SoftAssertionTests.ScopeWithMultipleFailures_TestFailsWithAggregatedMessage
Assert.IsTrue failed. 'condition' expression: 'Regex.IsMatch(testHostResult.StandardOutput, pattern)'. Expression 'AssertOutputMatchesRegex' failed for member 'ScopeWithMultipleFailures_TestFailsWithAggregatedMessage' at line 43 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/SoftAssertionTests.cs'. Output of the test host is:
Command: /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/bin/Release/net10.0/SoftAssertionTests --filter ScopeWithMultipleFailures
====================
ExitCode: 2
====================
StandardOutput:
MSTest v4.3.0-ci (UTC 4/20/2026) [osx-x64 - .NET 10.0.6]
failed ScopeWithMultipleFailures (1s 264ms)
2 assertion(s) failed within the assert scope.
at Microsoft.VisualStudio.TestTools.UnitTesting.AssertScope.Dispose() in /_/src/TestFramework/TestFramework/Assertions/AssertScope.cs:77
at UnitTest1.ScopeWithMultipleFailures() in /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/UnitTest1.cs:33
at UnitTest1.ScopeWithMultipleFailures() in /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/UnitTest1.cs:29
at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Test run summary: Failed! - /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/bin/Release/net10.0/SoftAssertionTests.dll (net10.0|x64)
total: 1
failed: 1
succeeded: 0
skipped: 0
duration: 2s 468ms
====================
StandardError:
Raw output
at Microsoft.VisualStudio.TestTools.UnitTesting.Assert.IsTrue(Nullable`1 condition, String message, String conditionExpression) in /_/src/TestFramework/TestFramework/Assertions/Assert.IsTrue.cs:line 153
at Microsoft.Testing.Platform.Acceptance.IntegrationTests.Helpers.AcceptanceAssert.AssertOutputMatchesRegex(TestHostResult testHostResult, String pattern, String callerMemberName, String callerFilePath, Int32 callerLineNumber) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs:line 79
at MSTest.Acceptance.IntegrationTests.SoftAssertionTests.ScopeWithMultipleFailures_TestFailsWithAggregatedMessage() in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/SoftAssertionTests.cs:line 43
at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestMethodInfo.ExecuteInternalAsync(Object[] arguments, CancellationTokenSource timeoutTokenSource) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestMethodInfo.cs:line 391
azure-pipelines / microsoft.testfx
MSTest.Acceptance.IntegrationTests.SoftAssertionTests.ScopeWithSingleFailure_TestFails
Assert.IsTrue failed. 'condition' expression: 'Regex.IsMatch(testHostResult.StandardOutput, pattern)'. Expression 'AssertOutputMatchesRegex' failed for member 'ScopeWithSingleFailure_TestFails' at line 30 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/SoftAssertionTests.cs'. Output of the test host is:
Command: /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/bin/Release/net10.0/SoftAssertionTests --filter ScopeWithSingleFailure
====================
ExitCode: 2
====================
StandardOutput:
MSTest v4.3.0-ci (UTC 4/20/2026) [osx-x64 - .NET 10.0.6]
failed ScopeWithSingleFailure (1s 479ms)
Assert.AreEqual failed. Expected:<1>. Actual:<2>. 'expected' expression: '1', 'actual' expression: '2'.
at Microsoft.VisualStudio.TestTools.UnitTesting.AssertScope.Dispose() in /_/src/TestFramework/TestFramework/Assertions/AssertScope.cs:72
at UnitTest1.ScopeWithSingleFailure() in /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/UnitTest1.cs:23
at UnitTest1.ScopeWithSingleFailure() in /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/UnitTest1.cs:20
at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Test run summary: Failed! - /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/bin/Release/net10.0/SoftAssertionTests.dll (net10.0|x64)
total: 1
failed: 1
succeeded: 0
skipped: 0
duration: 2s 485ms
====================
StandardError:
Raw output
at Microsoft.VisualStudio.TestTools.UnitTesting.Assert.IsTrue(Nullable`1 condition, String message, String conditionExpression) in /_/src/TestFramework/TestFramework/Assertions/Assert.IsTrue.cs:line 153
at Microsoft.Testing.Platform.Acceptance.IntegrationTests.Helpers.AcceptanceAssert.AssertOutputMatchesRegex(TestHostResult testHostResult, String pattern, String callerMemberName, String callerFilePath, Int32 callerLineNumber) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs:line 79
at MSTest.Acceptance.IntegrationTests.SoftAssertionTests.ScopeWithSingleFailure_TestFails() in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/SoftAssertionTests.cs:line 30
at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestMethodInfo.ExecuteInternalAsync(Object[] arguments, CancellationTokenSource timeoutTokenSource) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestMethodInfo.cs:line 391
azure-pipelines / microsoft.testfx
MSTest.Acceptance.IntegrationTests.SoftAssertionTests.AssertFailIsHardFailure_ThrowsImmediately
Assert.IsTrue failed. 'condition' expression: 'Regex.IsMatch(testHostResult.StandardOutput, pattern)'. Expression 'AssertOutputMatchesRegex' failed for member 'AssertFailIsHardFailure_ThrowsImmediately' at line 56 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/SoftAssertionTests.cs'. Output of the test host is:
Command: /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/bin/Release/net10.0/SoftAssertionTests --filter AssertFailIsHardFailure
====================
ExitCode: 2
====================
StandardOutput:
MSTest v4.3.0-ci (UTC 4/20/2026) [osx-x64 - .NET 10.0.6]
failed AssertFailIsHardFailure (1s 484ms)
Assert.Fail failed. hard failure
at Microsoft.VisualStudio.TestTools.UnitTesting.Assert.Fail(String message) in /_/src/TestFramework/TestFramework/Assertions/Assert.Fail.cs:25
at UnitTest1.AssertFailIsHardFailure() in /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/UnitTest1.cs:41
at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Test run summary: Failed! - /Users/runner/work/1/s/artifacts/tmp/Debug/testsuite/L4co1/SoftAssertionTests/bin/Release/net10.0/SoftAssertionTests.dll (net10.0|x64)
total: 1
failed: 1
succeeded: 0
skipped: 0
duration: 2s 453ms
====================
StandardError:
Raw output
at Microsoft.VisualStudio.TestTools.UnitTesting.Assert.IsTrue(Nullable`1 condition, String message, String conditionExpression) in /_/src/TestFramework/TestFramework/Assertions/Assert.IsTrue.cs:line 153
at Microsoft.Testing.Platform.Acceptance.IntegrationTests.Helpers.AcceptanceAssert.AssertOutputMatchesRegex(TestHostResult testHostResult, String pattern, String callerMemberName, String callerFilePath, Int32 callerLineNumber) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs:line 79
at MSTest.Acceptance.IntegrationTests.SoftAssertionTests.AssertFailIsHardFailure_ThrowsImmediately() in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/SoftAssertionTests.cs:line 56
at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestMethodInfo.ExecuteInternalAsync(Object[] arguments, CancellationTokenSource timeoutTokenSource) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestMethodInfo.cs:line 391
Loading