AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

buyaa-n · 2023-05-09T16:58:47Z

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
297099	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87174
296730	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87162
296569	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87114
295996	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86983
295246	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87119
295222	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86391
294783	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87067
294672	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87093
294441	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85373
294326	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85945
294286	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86816
294036	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87055
293260	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86486
293106	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85373
292824	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86983
292543	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86975
292295	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87001
292181	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86997
289245	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86811
287068	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86578
286984	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86781
286491	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86731
285489	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
285469	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86737
285445	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86732
285411	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86733
285393	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86656
284164	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86675
283957	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86659
283906	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
283833	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85267
283767	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86657
283683	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86278
283073	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86602
282788	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#84821

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	18	35

ghost · 2023-05-09T16:58:56Z

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries
See info in area-owners.md if you want to be subscribed.

Issue Details

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "Tests failed: D:\a\_work\1\s\artifacts\TestResults\Debug\AppHost.Bundle.Tests_net8.0_x86.html",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Author:	buyaa-n
Assignees:	-
Labels:	`area-Infrastructure-libraries`, `blocking-clean-ci`, `untriaged`, `Known Build Error`
Milestone:	-

vitek-karas · 2023-05-09T17:57:02Z

Looks like encoding issue somewhere:

The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'
File Name: D:\a_work\1\s\artifacts\tests\Debug\ahb\b4xgpzxv.2h0\LocalizedApp\bundle\LocalizedApp.exe
Arguments:
Exit Code: 0
StdOut:
α▓¿α▓«α▓╕α│ìα▓òα▓╛α▓░! α«╡α«úα«òα»ìα«òα««α»ì! Hello!

I'm no aware of any changes in the host/related tests, so possibly something from the system around it?

@elinor-fung for ideas.

elinor-fung · 2023-05-10T13:58:49Z

We haven't changed anything there. It does seem to have been failing intermittently since mid-April based on our test data:

AzureDevOpsTests
| where Repository == "dotnet/runtime"
| where TestName == "AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds"
| where Outcome == "Failed"
| where Message contains "did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'"
| order by RunCompleted asc
| project BuildId, TestRunName, TestName, Message, StackTrace, RunCompleted

jkotas · 2023-05-23T13:40:56Z

Failed in #86602

ghost · 2023-05-24T20:24:46Z

Tagging subscribers to this area: @agocke, @vitek-karas, @VSadov
See info in area-owners.md if you want to be subscribed.

Issue Details

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
284164	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86675
283957	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86659
283906	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
283833	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85267
283767	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86657
283683	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86278
283073	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86602
282788	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#84821

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
3	8	8

Author:	buyaa-n
Assignees:	-
Labels:	`area-Single-File`, `blocking-clean-ci`, `untriaged`, `Known Build Error`
Milestone:	-

elinor-fung · 2023-06-05T17:33:49Z

Still not sure why exactly this is failing, but the test seems to depend on more external factors than it should (and maybe doesn't compensate for them). I'll try to rework it a bit.

buyaa-n added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels May 9, 2023

dotnet-issue-labeler bot added the area-Infrastructure-libraries label May 9, 2023

ghost added the untriaged New issue has not been triaged by the area owner label May 9, 2023

ericstj added area-Single-File and removed area-Infrastructure-libraries labels May 24, 2023

elinor-fung removed the untriaged New issue has not been triaged by the area owner label May 24, 2023

elinor-fung added this to the 8.0.0 milestone May 24, 2023

markples mentioned this issue May 26, 2023

Add timestamps to XUnitLogChecker output #86737

Merged

elinor-fung changed the title ~~Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing~~ AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing Jun 5, 2023

elinor-fung mentioned this issue Jun 5, 2023

AppHost.Bundle.Tests_net8.0_x86 test failed in CI #87102

Closed

elinor-fung mentioned this issue Jun 6, 2023

Make BundleLocalizedApp test stop requiring UTF8 output encoding #87176

Merged

ghost added the in-pr There is an active PR which will close this issue when it is merged label Jun 6, 2023

elinor-fung closed this as completed in #87176 Jun 7, 2023

ghost removed the in-pr There is an active PR which will close this issue when it is merged label Jun 7, 2023

ghost locked as resolved and limited conversation to collaborators Jul 7, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

buyaa-n commented May 9, 2023 •

edited by build-analysis bot

Loading

ghost commented May 9, 2023

Build Information

Error Message

vitek-karas commented May 9, 2023

elinor-fung commented May 10, 2023

jkotas commented May 23, 2023

ghost commented May 24, 2023

Build Information

Error Message

Report

Summary

elinor-fung commented Jun 5, 2023

AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing #85993

Comments

buyaa-n commented May 9, 2023 • edited by build-analysis bot Loading

Build Information

Error Message

Report

Summary

ghost commented May 9, 2023

Build Information

Error Message

vitek-karas commented May 9, 2023

elinor-fung commented May 10, 2023

jkotas commented May 23, 2023

ghost commented May 24, 2023

Build Information

Error Message

Report

Summary

elinor-fung commented Jun 5, 2023

buyaa-n commented May 9, 2023 •

edited by build-analysis bot

Loading