Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
2823644	dotnet-sdk	Build	Log	#54637
1183902	dotnet/sdk	🟣 Run FullFramework Tests	Log	#51373
1183118	dotnet/sdk	🟣 Build	Log	#51425
1182320	dotnet/sdk	🟣 Build	Log	#51414
2821880	dotnet-sdk	Build (fedora41)	Log	#54567
2821854	dotnet-sdk	Build (ubuntu2204DebPkg)	Log	#54568
2821852	dotnet-sdk	Build	Log	#54567
2821435	dotnet-sdk	Run Tests in Helix	Log	#54551
1180825	dotnet/sdk	Run TestBuild Tests	Log	#51394
2820896	dotnet-sdk	Initialize job	Log	#54528
1180500	dotnet/sdk	Build	Log
1180315	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51052
2820084	dotnet-sdk	Build (azureLinux30CrossArm)	Log
1178790	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51307
2818876	dotnet-sdk	Build	Log	#54384
2818840	dotnet-sdk	Checkout dotnet-sdk@refs/pull/54376/merge to s	Log	#54376
2818612	dotnet-sdk	Build	Log	#54379
1177705	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51207
2818051	dotnet-sdk	Build	Log	#54379
2817467	dotnet-sdk	Build	Log
2817410	dotnet-sdk	Build	Log
2817321	dotnet-sdk	Build	Log	#54376
2817132	dotnet-sdk	Run Tests in Helix	Log	#54377
2817077	dotnet-sdk	Build	Log	#54379
2817018	dotnet-sdk	Build	Log	#54376
1175262	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50761
2815953	dotnet-sdk	Build	Log	#54351
1174302	dotnet/sdk	Build	Log	#51245
1174292	dotnet/sdk	Build	Log	#51242
2815807	dotnet-sdk	Checkout dotnet-sdk@refs/pull/54237/merge to s	Log	#54237
1171183	dotnet/sdk	🟣 Build	Log	#51209
2813222	dotnet-sdk	Build	Log	#54230
2813133	dotnet-sdk	OneLocBuild	Log
2810745	dotnet-sdk	Run Tests in Helix	Log	#53892
1167839	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50946
1167823	dotnet/sdk	Build	Log
2809569	dotnet-sdk	Build	Log	#54034
2809573	dotnet-sdk	Build	Log	#54036
2808434	dotnet-sdk	Build	Log	#53891
2808432	dotnet-sdk	Build	Log	#53890
2808433	dotnet-sdk	Build	Log	#53892
1165384	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51074
1165227	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50946
1165012	dotnet/sdk	🟣 Build	Log	#51032
2807582	dotnet-sdk	🟣 Build	Log
1159610	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51020
1160940	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50999
1159285	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50992
1159209	dotnet/sdk	Checkout dotnet/sdk@refs/pull/51013/merge to s	Log	#51013

Build	Definition	Test	Pull Request
1183612	dotnet/sdk	dotnet.Tests.dll.18.WorkItemExecution	#51373
2821436	dotnet-sdk	Microsoft.DotNet.Cli.Sln.Add.Tests.GivenDotnetSlnAdd.WhenValidProjectIsPassedTheSlnBuilds	#54550
2813262	dotnet-sdk	Microsoft.NET.Publish.Tests.GivenThatWeWantToPublishAWebApp.PublishWebAppWithPublishProfile	#54230
1167138	dotnet/sdk	dotnet.Tests.dll.25.WorkItemExecution	#51036
1165061	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#51073
1165019	dotnet/sdk	Microsoft.NET.Build.Tests.dll.1.WorkItemExecution	#50946
1161459	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	#50946
1159860	dotnet/sdk	Microsoft.NET.Sdk.StaticWebAssets.Tests.dll.7.WorkItemExecution	#51039

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	15	57

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.