❌Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.DoNotShowDeprecationMessage_WhenNewCommandIsUsed - Known Test Repository Issue Sometimes Misses Test Failures

❌Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.DoNotShowDeprecationMessage_WhenNewCommandIsUsed - Template Engine SSL Connection Issue

❌Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.DoNotShowDeprecationMessage_WhenNewCommandIsUsed - Tests Failing in Template Engine: Failed to update search cache. (The SSL connection could not be established, see inner exception.)

🔹 [All failing tests from dotnet-sdk-public-ci]

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest [Details] [12.46% failure rate]

[ 🚧 Report test infrastructure issue] [ 📄 Report test repository issue]

Failing Configuration

• TemplateEngine_macOS_x64_2

Data Driven SubResults

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest(testCase: \"console --search\")
Exception Message

Expected value to be 0 because Expected command to exit with 0 but it did not.\nWorking Directory:\nFile Name: /Users/runner/work/1/s/artifacts/bin/redist/Release/dotnet/dotnet\nArguments: new console --search --debug:custom-hive /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\nExit Code: 103\nStdOut:\nWarning: use of 'dotnet new --search' is deprecated. Use 'dotnet new search' instead.\nFor more information, run:\n   dotnet new search -h\n\nSearching for the templates...\nStdErr:\nMatches from template source: NuGet.org\nSearch failed: Failed to update search cache. (The SSL connection could not be established, see inner exception.) (The SSL connection could not be established, see inner exception.)\n\nFor details on the exit code, refer to https://aka.ms/templating-exit-codes#103\n, but found 103 (difference of 103). [Full log]

Stack Trace

   at FluentAssertions.Execution.LateBoundTestFramework.Throw(String message)
   at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
   at FluentAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
   at FluentAssertions.Numeric.NumericAssertionsBase`3.Be(T expected, String because, Object[] becauseArgs)
   at Microsoft.NET.TestFramework.Assertions.CommandResultAssertions.ExitWith(Int32 expectedExitCode) in /_/test/Microsoft.NET.TestFramework/Assertions/CommandResultAssertions.cs:line 21
   at Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest(String testCase) in /Users/runner/work/1/s/test/dotnet-new.IntegrationTests/DotnetNewSearchTests.cs:line 29
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)... [Full stack trace]

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest(testCase: \"--search console\")
Exception Message

Expected value to be 0 because Expected command to exit with 0 but it did not.\nWorking Directory:\nFile Name: /Users/runner/work/1/s/artifacts/bin/redist/Release/dotnet/dotnet\nArguments: new --search console --debug:custom-hive /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\nExit Code: 103\nStdOut:\nWarning: use of 'dotnet new --search' is deprecated. Use 'dotnet new search' instead.\nFor more information, run:\n   dotnet new search -h\n\nSearching for the templates...\nStdErr:\nMatches from template source: NuGet.org\nSearch failed: Failed to update search cache. (The SSL connection could not be established, see inner exception.) (The SSL connection could not be established, see inner exception.)\n\nFor details on the exit code, refer to https://aka.ms/templating-exit-codes#103\n, but found 103 (difference of 103). [Full log]

Stack Trace

   at FluentAssertions.Execution.LateBoundTestFramework.Throw(String message)
   at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
   at FluentAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
   at FluentAssertions.Numeric.NumericAssertionsBase`3.Be(T expected, String because, Object[] becauseArgs)
   at Microsoft.NET.TestFramework.Assertions.CommandResultAssertions.ExitWith(Int32 expectedExitCode) in /_/test/Microsoft.NET.TestFramework/Assertions/CommandResultAssertions.cs:line 21
   at Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest(String testCase) in /Users/runner/work/1/s/test/dotnet-new.IntegrationTests/DotnetNewSearchTests.cs:line 29
   at InvokeStub_DotnetNewSearchTests.BasicTest(Object, Span`1)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)... [Full stack trace]

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest(testCase: \"search console\")
Exception Message

Expected value to be 0 because Expected command to exit with 0 but it did not.\nWorking Directory:\nFile Name: /Users/runner/work/1/s/artifacts/bin/redist/Release/dotnet/dotnet\nArguments: new search console --debug:custom-hive /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\nExit Code: 103\nStdOut:\nSearching for the templates...\nStdErr:\nMatches from template source: NuGet.org\nSearch failed: Failed to update search cache. (The SSL connection could not be established, see inner exception.) (The SSL connection could not be established, see inner exception.)\n\nFor details on the exit code, refer to https://aka.ms/templating-exit-codes#103\n, but found 103 (difference of 103). [Full log]

Stack Trace

   at FluentAssertions.Execution.LateBoundTestFramework.Throw(String message)
   at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
   at FluentAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
   at FluentAssertions.Numeric.NumericAssertionsBase`3.Be(T expected, String because, Object[] becauseArgs)
   at Microsoft.NET.TestFramework.Assertions.CommandResultAssertions.ExitWith(Int32 expectedExitCode) in /_/test/Microsoft.NET.TestFramework/Assertions/CommandResultAssertions.cs:line 21
   at Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.BasicTest(String testCase) in /Users/runner/work/1/s/test/dotnet-new.IntegrationTests/DotnetNewSearchTests.cs:line 29
   at InvokeStub_DotnetNewSearchTests.BasicTest(Object, Span`1)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)... [Full stack trace]

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType [Details] [12.63% failure rate]

[ 🚧 Report test infrastructure issue] [ 📄 Report test repository issue]

Failing Configuration

• TemplateEngine_macOS_x64_2

Data Driven SubResults

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType(testCase: \"console --search --columns type --type item\")
Exception Message

Expected value to be 0 because Expected command to exit with 0 but it did not.\nWorking Directory:\nFile Name: /Users/runner/work/1/s/artifacts/bin/redist/Release/dotnet/dotnet\nArguments: new console --search --columns type --type item --debug:custom-hive /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\nExit Code: 103\nStdOut:\nUsing home directory '/Users/runner/work/1/s/artifacts/tmp/Release/testing' set by the 'DOTNET_CLI_HOME' environment variable.\nTelemetry is: Disabled\nGlobal Settings Location: /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\n[2026-01-30 19:19:05.346] [Debug] [Template Engine] => [Execute]: Execute started\nWarning: use of 'dotnet new --search' is deprecated. Use 'dotnet new search' instead.\nFor more information, run:\n   dotnet new search -h\n\nSearching for the templates...\n[2026-01-30 19:19:05.801] [Debug] [Microsof [Full log]

Stack Trace

   at FluentAssertions.Execution.LateBoundTestFramework.Throw(String message)
   at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
   at FluentAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
   at FluentAssertions.Numeric.NumericAssertionsBase`3.Be(T expected, String because, Object[] becauseArgs)
   at Microsoft.NET.TestFramework.Assertions.CommandResultAssertions.ExitWith(Int32 expectedExitCode) in /_/test/Microsoft.NET.TestFramework/Assertions/CommandResultAssertions.cs:line 21
   at Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType(String testCase) in /Users/runner/work/1/s/test/dotnet-new.IntegrationTests/DotnetNewSearchTests.cs:line 327
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHa... [Full stack trace]

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType(testCase: \"--search console --columns type --type item\")
Exception Message

Expected value to be 0 because Expected command to exit with 0 but it did not.\nWorking Directory:\nFile Name: /Users/runner/work/1/s/artifacts/bin/redist/Release/dotnet/dotnet\nArguments: new --search console --columns type --type item --debug:custom-hive /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\nExit Code: 103\nStdOut:\nUsing home directory '/Users/runner/work/1/s/artifacts/tmp/Release/testing' set by the 'DOTNET_CLI_HOME' environment variable.\nTelemetry is: Disabled\nGlobal Settings Location: /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\n[2026-01-30 19:19:07.534] [Debug] [Template Engine] => [Execute]: Execute started\nWarning: use of 'dotnet new --search' is deprecated. Use 'dotnet new search' instead.\nFor more information, run:\n   dotnet new search -h\n\nSearching for the templates...\n[2026-01-30 19:19:07.977] [Debug] [Microsof [Full log]

Stack Trace

   at FluentAssertions.Execution.LateBoundTestFramework.Throw(String message)
   at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
   at FluentAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
   at FluentAssertions.Numeric.NumericAssertionsBase`3.Be(T expected, String because, Object[] becauseArgs)
   at Microsoft.NET.TestFramework.Assertions.CommandResultAssertions.ExitWith(Int32 expectedExitCode) in /_/test/Microsoft.NET.TestFramework/Assertions/CommandResultAssertions.cs:line 21
   at Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType(String testCase) in /Users/runner/work/1/s/test/dotnet-new.IntegrationTests/DotnetNewSearchTests.cs:line 327
   at InvokeStub_DotnetNewSearchTests.CanFilterType(Object, Span`1)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)... [Full stack trace]

❌ Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType(testCase: \"search console --columns type --type item\")
Exception Message

Expected value to be 0 because Expected command to exit with 0 but it did not.\nWorking Directory:\nFile Name: /Users/runner/work/1/s/artifacts/bin/redist/Release/dotnet/dotnet\nArguments: new search console --columns type --type item --debug:custom-hive /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\nExit Code: 103\nStdOut:\nUsing home directory '/Users/runner/work/1/s/artifacts/tmp/Release/testing' set by the 'DOTNET_CLI_HOME' environment variable.\nTelemetry is: Disabled\nGlobal Settings Location: /Users/runner/work/1/s/artifacts/tmp/Release/testing/dotnet-new.IntegrationTests/SharedHomeDirectory/20260130191847251\n[2026-01-30 19:19:09.917] [Debug] [Template Engine] => [Execute]: Execute started\nSearching for the templates...\n[2026-01-30 19:19:10.364] [Debug] [Microsoft.TemplateSearch.Common.Providers.NuGetMetadataSearchProvider] => [Execute]: Initializing search cache...\n[2026-01-30 19:19:10.365] [Debug] [Mi [Full log]

Stack Trace

   at FluentAssertions.Execution.LateBoundTestFramework.Throw(String message)
   at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
   at FluentAssertions.Execution.AssertionChain.FailWith(Func`1 getFailureReason)
   at FluentAssertions.Numeric.NumericAssertionsBase`3.Be(T expected, String because, Object[] becauseArgs)
   at Microsoft.NET.TestFramework.Assertions.CommandResultAssertions.ExitWith(Int32 expectedExitCode) in /_/test/Microsoft.NET.TestFramework/Assertions/CommandResultAssertions.cs:line 21
   at Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewSearchTests.CanFilterType(String testCase) in /Users/runner/work/1/s/test/dotnet-new.IntegrationTests/DotnetNewSearchTests.cs:line 327
   at InvokeStub_DotnetNewSearchTests.CanFilterType(Object, Span`1)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)... [Full stack trace]