Skip to content

Fix flaky UI tests with retryTimeout, crash recovery, and improved diagnostics#33705

Merged
rmarinho merged 16 commits into
mainfrom
fix-main
Jan 28, 2026
Merged

Fix flaky UI tests with retryTimeout, crash recovery, and improved diagnostics#33705
rmarinho merged 16 commits into
mainfrom
fix-main

Add retryTimeout to Issue27730 and Issue26662 visual tests

199e29f
Select commit
Loading
Failed to load commit list.
Azure Pipelines / maui-pr-uitests succeeded Jan 28, 2026 in 4h 10m 48s

Build #10.0.40-ci+azdo.1270512 had test failures

Details

Tests

  • Failed: 5 (0.04%, 5 new, 0 recurring)
  • Passed: 12,407 (98.81%)
  • Other: 144 (1.15%)
  • Total: 12,556

Annotations

Check failure on line 1068 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L1068

PowerShell exited with code '1'.

Check failure on line 766 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L766

PowerShell exited with code '1'.

Check failure on line 1015 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L1015

PowerShell exited with code '1'.

Check failure on line 1591 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L1591

PowerShell exited with code '1'.

Check failure on line 1 in Microsoft.Maui.TestCases.Tests.Issues.Issue33034(Android).SafeAreaShouldWorkOnAllShellTabs

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Microsoft.Maui.TestCases.Tests.Issues.Issue33034(Android).SafeAreaShouldWorkOnAllShellTabs

OpenQA.Selenium.StaleElementReferenceException : Cached elements 'By.id: com.microsoft.maui.uitests:id/EdgeLabel' do not exist in DOM anymore; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#stale-element-reference-exception
Raw output
   at OpenQA.Selenium.WebDriver.UnpackAndThrowOnError(Response errorResponse, String commandToExecute)
   at OpenQA.Selenium.WebDriver.ExecuteAsync(String driverCommandToExecute, Dictionary`2 parameters)
   at OpenQA.Selenium.WebElement.Execute(String commandToExecute, Dictionary`2 parameters)
   at OpenQA.Selenium.WebElement.get_Location()
   at OpenQA.Selenium.Appium.AppiumElement.get_Rect()
   at UITest.Appium.AppiumGeneralActions.GetRect(IDictionary`2 parameters) in /_/src/TestUtils/src/UITest.Appium/Actions/AppiumGeneralActions.cs:line 51
   at UITest.Appium.AppiumGeneralActions.Execute(String commandName, IDictionary`2 parameters) in /_/src/TestUtils/src/UITest.Appium/Actions/AppiumGeneralActions.cs:line 33
   at UITest.Appium.AppiumCommandExecutor.Execute(String commandName, IDictionary`2 parameters) in /_/src/TestUtils/src/UITest.Appium/Actions/AppiumCommandExecutor.cs:line 20
   at UITest.Appium.HelperExtensions.GetRect(IUIElement element) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 150
   at Microsoft.Maui.TestCases.Tests.Issues.Issue33034.SafeAreaShouldWorkOnAllShellTabs() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/Issue33034.cs:line 28
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

Check failure on line 1 in Microsoft.Maui.TestCases.Tests.Issues.Issue2728(Android).Issue2728TestsItalicLabel

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Microsoft.Maui.TestCases.Tests.Issues.Issue2728(Android).Issue2728TestsItalicLabel

OneTimeSetUp: System.TimeoutException : [macOS] Label FontAttributes Italic is not working
Raw output
   at UITest.Appium.HelperExtensions.Wait(Func`1 query, Func`2 satisfactory, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2618
   at UITest.Appium.HelperExtensions.WaitForAtLeastOne(Func`1 query, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2633
   at UITest.Appium.HelperExtensions.WaitForElement(IApp app, String marked, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency, Nullable`1 postTimeout) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 771
   at Microsoft.Maui.TestCases.Tests._IssuesUITest.NavigateToIssue(String issue) in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/_IssuesUITest.cs:line 54
   at Microsoft.Maui.TestCases.Tests._IssuesUITest.TryToResetTestState() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/_IssuesUITest.cs:line 25
   at Microsoft.Maui.TestCases.Tests.UITest.FixtureSetup() in /_/src/Controls/tests/TestCases.Shared.Tests/UITest.cs:line 568
   at UITest.Appium.NUnit.UITestBase.OneTimeSetup() in /_/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 141
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

Check failure on line 1 in Microsoft.Maui.TestCases.Tests.Issues.Issue25836(Android).ExceptionShouldNotBeThrown

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Microsoft.Maui.TestCases.Tests.Issues.Issue25836(Android).ExceptionShouldNotBeThrown

OneTimeSetUp: System.TimeoutException : Span with tail truncation and paragraph breaks with exception
Raw output
   at UITest.Appium.HelperExtensions.Wait(Func`1 query, Func`2 satisfactory, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2618
   at UITest.Appium.HelperExtensions.WaitForAtLeastOne(Func`1 query, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2633
   at UITest.Appium.HelperExtensions.WaitForElement(IApp app, String marked, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency, Nullable`1 postTimeout) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 771
   at Microsoft.Maui.TestCases.Tests._IssuesUITest.NavigateToIssue(String issue) in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/_IssuesUITest.cs:line 54
   at Microsoft.Maui.TestCases.Tests._IssuesUITest.TryToResetTestState() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/_IssuesUITest.cs:line 25
   at Microsoft.Maui.TestCases.Tests.UITest.FixtureSetup() in /_/src/Controls/tests/TestCases.Shared.Tests/UITest.cs:line 568
   at UITest.Appium.NUnit.UITestBase.OneTimeSetup() in /_/src/TestUtils/src/UITest.NUnit/UITestBase.cs:line 141
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

Check failure on line 1 in Microsoft.Maui.TestCases.Tests.Issues.Issue23491(Android).ChildFlexLayoutContentShouldAppear

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Microsoft.Maui.TestCases.Tests.Issues.Issue23491(Android).ChildFlexLayoutContentShouldAppear

System.TimeoutException : Timed out waiting for element...
Raw output
   at UITest.Appium.HelperExtensions.Wait(Func`1 query, Func`2 satisfactory, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2618
   at UITest.Appium.HelperExtensions.WaitForAtLeastOne(Func`1 query, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2633
   at UITest.Appium.HelperExtensions.WaitForElement(IApp app, String marked, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency, Nullable`1 postTimeout) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 771
   at Microsoft.Maui.TestCases.Tests.Issues.Issue23491.ChildFlexLayoutContentShouldAppear() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/Issue23491.cs:line 17
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)