Skip to content

[Testing] Fix for flaky UITests in CI - 3 - #33689

Merged
jfversluis merged 5 commits into
dotnet:mainfrom
TamilarasanSF4853:fix-flaky-tests-8
Feb 17, 2026
Merged

[Testing] Fix for flaky UITests in CI - 3#33689
jfversluis merged 5 commits into
dotnet:mainfrom
TamilarasanSF4853:fix-flaky-tests-8

added android failing condition

bdfa677
Select commit
Loading
Failed to load commit list.
Azure Pipelines / maui-pr-uitests succeeded Jan 29, 2026 in 1h 55m 31s

Build #10.0.40-ci+pr.33689.azdo.1272104 had test failures

Details

Tests

  • Failed: 2 (0.02%)
  • Passed: 12,546 (98.89%)
  • Other: 139 (1.10%)
  • Total: 12,687

Annotations

Check failure on line 633 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L633

PowerShell exited with code '1'.

Check failure on line 772 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L772

PowerShell exited with code '1'.

Check failure on line 649 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L649

PowerShell exited with code '1'.

Check failure on line 73 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Build log #L73

PowerShell exited with code '1'.

Check failure on line 1 in Microsoft.Maui.TestCases.Tests.Issues.Issue26662(Android).DynamicFontImageSourceColorShouldApplyOnTabIcon

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Microsoft.Maui.TestCases.Tests.Issues.Issue26662(Android).DynamicFontImageSourceColorShouldApplyOnTabIcon

VisualTestUtils.VisualTestFailedException : 
Snapshot different than baseline: DynamicFontImageSourceColorShouldApplyOnTabIcon.png (2.91% difference)
If the correct baseline has changed (this isn't a a bug), then update the baseline image.
See test attachment or download the build artifacts to get the new snapshot file.

More info: https://aka.ms/visual-test-workflow
Raw output
   at Microsoft.Maui.TestCases.Tests.UITest.VerifyScreenshot(String name, Nullable`1 retryDelay, Nullable`1 retryTimeout, Int32 cropLeft, Int32 cropRight, Int32 cropTop, Int32 cropBottom, Double tolerance) in /_/src/Controls/tests/TestCases.Shared.Tests/UITest.cs:line 288
   at Microsoft.Maui.TestCases.Tests.Issues.Issue26662.DynamicFontImageSourceColorShouldApplyOnTabIcon() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/Issue26662.cs:line 27
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

Check failure on line 1 in Microsoft.Maui.TestCases.Tests.Issues.Issue1939(Mac).Issue1939Test

See this annotation in the file changed.

@azure-pipelines azure-pipelines / maui-pr-uitests

Microsoft.Maui.TestCases.Tests.Issues.Issue1939(Mac).Issue1939Test

System.TimeoutException : Timed out waiting for element...
Raw output
   at UITest.Appium.HelperExtensions.Wait(Func`1 query, Func`2 satisfactory, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2618
   at UITest.Appium.HelperExtensions.WaitForElement(IApp app, String marked, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency, Nullable`1 postTimeout) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 773
   at Microsoft.Maui.TestCases.Tests.Issues.Issue1939.Issue1939Test() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/XFIssue/Issue1939.cs:line 19
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)