Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1165012	dotnet/sdk	🟣 Build	Log	#51032
2807582	dotnet-sdk	🟣 Build	Log
1159610	dotnet/sdk	🟣 Run TestBuild Tests	Log	#51020
1160940	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50999
1159285	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50992
1159209	dotnet/sdk	Checkout dotnet/sdk@refs/pull/51013/merge to s	Log	#51013
1158830	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50983
1158692	dotnet/sdk	Checkout dotnet/sdk@refs/pull/51013/merge to s	Log	#51013
2801933	dotnet-sdk	Run TestBuild Tests	Log	#53783
2801703	dotnet-sdk	Build	Log	#53537
1157737	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50998
2801063	dotnet-sdk	Run FullFramework Tests	Log	#53608
2801035	dotnet-sdk	Run Tests in Helix	Log	#53743
2801034	dotnet-sdk	Build	Log	#53741
1157177	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50977
2800950	dotnet-sdk	Build	Log	#53741
2800634	dotnet-sdk	Build	Log	#53551
2800633	dotnet-sdk	Build	Log	#53553
2800436	dotnet-sdk	Build	Log	#53551
1155916	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50885
2799801	dotnet-sdk	Build	Log	#53553
2799415	dotnet-sdk	Build	Log	#53552
2799414	dotnet-sdk	Build	Log	#53553
1155253	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50761
2799279	dotnet-sdk	Build	Log	#53553
2798282	dotnet-sdk	Build	Log	#53552
1153942	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50933
2797778	dotnet-sdk	Build	Log	#53551
2797647	dotnet-sdk	Build (centosStream9)	Log	#53544
2797639	dotnet-sdk	Build	Log	#53539
2797592	dotnet-sdk	Build	Log	#53511
2797461	dotnet-sdk	Build	Log	#53411
2797391	dotnet-sdk	Build	Log	#53522
2797209	dotnet-sdk	Build	Log	#53512
2797208	dotnet-sdk	Build	Log	#53511
2797089	dotnet-sdk	Checkout dotnet-sdk@refs/pull/53502/merge to s	Log	#53502
2797034	dotnet-sdk	Build	Log	#53500
2796467	dotnet-sdk	Build	Log	#53411
1151690	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50780
1150756	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50887
1150008	dotnet/sdk	🟣 Build	Log	#50616
1149216	dotnet/sdk	Run Tests in Helix	Log	#50847
1148964	dotnet/sdk	🟣 Build	Log	#50844
2793651	dotnet-sdk	🟣 Build	Log
2793370	dotnet-sdk	Build	Log
2793272	dotnet-sdk	🟣 Build	Log
1147681	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50814
1147174	dotnet/sdk	Build	Log	#50449
1147164	dotnet/sdk	Build	Log	#50774
1146624	dotnet/sdk	Build	Log	#50710
1146626	dotnet/sdk	Build	Log	#50708
1146005	dotnet/sdk	Run dotnet-format on dotnet/msbuild MSBuild.sln	Log	#50772
2791583	dotnet-sdk	Build	Log
2791581	dotnet-sdk	Build	Log
1145383	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50761
1144778	dotnet/sdk	Run Tests in Helix	Log	#50538
2790931	dotnet-sdk	Build	Log
1145060	dotnet/sdk	🟣 Build	Log	#50752
2790880	dotnet-sdk	🟣 Build	Log
2790869	dotnet-sdk	🟣 Build	Log
1144987	dotnet/sdk	🟣 Build	Log	#50735
2790731	dotnet-sdk	Build	Log
1144780	dotnet/sdk	Build	Log
1142736	dotnet/sdk	Run Tests in Helix	Log	#50539
1144049	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50727
1144037	dotnet/sdk	🟣 Run TestBuild Tests	Log	#50468
1140950	dotnet/sdk	🟣 Build	Log	#50553
1140256	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50639
1140089	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50650
1139956	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50633

Build	Definition	Test	Pull Request
1165019	dotnet/sdk	Microsoft.NET.Build.Tests.dll.1.WorkItemExecution	#50946
1161459	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	#50946
1159860	dotnet/sdk	Microsoft.NET.Sdk.StaticWebAssets.Tests.dll.7.WorkItemExecution	#51039
2800232	dotnet-sdk	Microsoft.DotNet.ShellShim.Tests.ShellShimRepositoryTests.GivenAShimItPassesThroughArguments	#53551
2797688	dotnet-sdk	Microsoft.DotNet.Cli.Sln.Add.Tests.GivenDotnetSlnAdd.WhenValidProjectIsPassedTheSlnBuilds	#53549
2795156	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#53398
1144576	dotnet/sdk	Microsoft.NET.Build.Tasks.UnitTests.dll.3.WorkItemExecution	#50694
2789962	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#52957
1142642	dotnet/sdk	dotnet.Tests.dll.2.WorkItemExecution	#50164

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
3	7	79

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.