[mobile] Enable NativeAOT library tests on Apple mobile platforms #125437
.NET Result Analysis
Details
Tip
To unconditionally bypass the build analysis check (turn it green), you can use the escape mechanism feature. The completion time may vary, potentially taking several minutes, depending on the build analysis workload at the moment.
⚠️ The following pipeline(s) will not be analyzed as has been explicited excluded from analysis
Known Repository Errors
Known Infrastructure Errors
-
❌20260507.3 / Build / maccatalyst-arm64 Release AllSubsets_Mono_RuntimeTests and 1 more hits - slow macOS - "##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes."
-
❌20260507.3 / Build / maccatalyst-arm64 Release AllSubsets_Mono_RuntimeTests / Send tests to Helix (Unix) and 1 more hits - The Operation will be canceled. The next steps may not contain expected logs.
Build Failures
runtime-extra-platforms / Build / tvos-arm64 Release AllSubsets_NativeAOT / Build product
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(163,30): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(193,18): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(195,18): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
- ❌ 7 more errors on this task
runtime-extra-platforms / Build / iossimulator-x64 Release AllSubsets_NativeAOT / Build product
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]-
❌artifacts/bin/coreclr/iossimulator.x64.Release/build/Microsoft.NETCore.Native.Publish.targets(89,5): error : The published project has a runtimeconfig.template.json that is not supported by PublishAot. Move the configuration to the project file using RuntimeHostConfigurationOption.
-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(163,30): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(193,18): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
- ❌ 7 more errors on this task
runtime-extra-platforms / Build / iossimulator-arm64 Release AllSubsets_NativeAOT / Build product
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]-
❌artifacts/bin/coreclr/iossimulator.arm64.Release/build/Microsoft.NETCore.Native.Publish.targets(89,5): error : The published project has a runtimeconfig.template.json that is not supported by PublishAot. Move the configuration to the project file using RuntimeHostConfigurationOption.
-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(163,30): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
-
❌src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs(193,18): error CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
- ❌ 6 more errors on this task
7 other jobs are failing and were not displayed due to space limitations.
Builds with failures: [runtime-extra-platforms] [runtime] [dotnet-linker-tests]
Known test errors
-
❌System.Net.NameResolution.Tests.GetHostAddressesTest.DnsGetHostAddresses_LocalhostSubdomainWithTrailingDot_ReturnsLoopback - NameResolution tests fail on tvos/Android devices - localhost resolves to non-loopback addresses
-
❌System.Net.NameResolution.Tests.GetHostAddressesTest.DnsGetHostAddresses_LocalhostSubdomainWithTrailingDot_ReturnsLoopback - Assertion failures: localhost resolves to non-loopback addresses on tvOS arm64
-
❌System.Net.Sockets.Tests.SocketAsyncEventArgsTest.Connect_Parallel_FailsOver - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.SocketAsyncEventArgsTest.Connect_Parallel_FailsOver - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectToHostString.DualModeConnect_LoopbackDnsToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToHostString.DualModeConnect_LoopbackDnsToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectAsync.DualModeConnectAsync_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectAsync.DualModeConnectAsync_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.NameResolution.Functional.Tests.WorkItemExecution - NameResolution tests fail on tvos/Android devices - localhost resolves to non-loopback addresses
-
❌System.Net.NameResolution.Functional.Tests.WorkItemExecution - Assertion failures: localhost resolves to non-loopback addresses on tvOS arm64
-
❌System.Net.Sockets.Tests.WorkItemExecution - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.WorkItemExecution - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.NameResolution.Tests.GetHostAddressesTest.DnsGetHostAddresses_LocalhostSubdomainWithTrailingDot_ReturnsLoopback - NameResolution tests fail on tvos/Android devices - localhost resolves to non-loopback addresses
-
❌System.Net.NameResolution.Tests.GetHostAddressesTest.DnsGetHostAddresses_LocalhostSubdomainWithTrailingDot_ReturnsLoopback - Assertion failures: localhost resolves to non-loopback addresses on tvOS arm64
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectToHostString.DualModeConnect_LoopbackDnsToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToHostString.DualModeConnect_LoopbackDnsToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectAsync.DualModeConnectAsync_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectAsync.DualModeConnectAsync_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.SocketAsyncEventArgsTest.Connect_Parallel_FailsOver - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.SocketAsyncEventArgsTest.Connect_Parallel_FailsOver - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.NameResolution.Functional.Tests.WorkItemExecution - NameResolution tests fail on tvos/Android devices - localhost resolves to non-loopback addresses
-
❌System.Net.NameResolution.Functional.Tests.WorkItemExecution - Assertion failures: localhost resolves to non-loopback addresses on tvOS arm64
-
❌System.Net.Sockets.Tests.WorkItemExecution - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.WorkItemExecution - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Formats.Nrbf.Tests.WorkItemExecution - System.Formats.Nrbf.Tests timeout occasionally in the CI
-
❌System.Formats.Nrbf.Tests.WorkItemExecution - System.Formats.Nrbf.Tests timeout occasionally in the CI
-
❌System.Formats.Nrbf.Tests.WorkItemExecution - [mono] `System.Formats.Nrbf.Tests.EdgeCaseTests.CanReadArrayOfAnySize` times out on x64 Release Mono library legs
-
❌System.Formats.Nrbf.Tests.WorkItemExecution - System.Formats.Nrbf.Tests timeout occasionally in the CI
-
❌System.Net.Sockets.Tests.DualModeConnectToHostString.DualModeConnect_LoopbackDnsToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToHostString.DualModeConnect_LoopbackDnsToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectAsync.DualModeConnectAsync_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectAsync.DualModeConnectAsync_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.WorkItemExecution - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.WorkItemExecution - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.DualModeConnectToDnsEndPoint.DualModeConnect_DnsEndPointToHost_Helper - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - [macOS] SendTo_.*.Datagram_UDP_AccessDenied_Throws_DoesNotBind cannot reach host
-
❌System.Net.Sockets.Tests.SocketBlockingModeTransitionTests.ConnectAsync_WithBuffer_Succeeds - Assertion failure in ConnectAsync_WithBuffer_Succeeds on Android/MacCatalyst/tvOS (Mono/CoreCLR/NativeAOT)
The following build(s) were only partially analyzed due to the number of test errors and helix logs:
- [runtime-extra-platforms]
Test Failures (247 tests failed)
🔹 [All failing tests from runtime]
❌ iOS.CoreCLR.Interpreter.Test.WorkItemExecution [Console] [Details] [Artifacts] [0.98% failure rate]
-
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]
This is a helix work item crash with status: DeadLetter. To investigate look the [Console log] / navigate to [Helix Artifacts]
Failing Configuration
🔹 [All failing tests from runtime-extra-platforms]
- Exception Message
================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/A92209AD/w/B45F09A9/e/baseservices/exceptions/baseservices-exceptions/../UnhandledExceptionHandler/Foreign/ForeignUnhandled/ForeignUnhandled.sh: line 425: 34647 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"Return code: 1
Raw output file: /datadisks/disk1/work/A92209AD/w/B45F09A9/uploads/UnhandledExceptionHandler/Foreign/ForeignUnhandled/output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A92209AD/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true ForeignUnhandled.dll ''
Failed to load AOT module '/datadisks/disk1/work/A92209AD/w/B45F09A9/e/baseservices/exceptions/UnhandledExceptionHandler/Foreign/ForeignUnhandled/ForeignUnhandled.dll.so' ('/data [Full log]- CallStack
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 136 at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 117 at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor23|0_24(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)... [Full call stack]
- Exception Message
================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/A92209AD/w/B45F09A9/e/baseservices/exceptions/baseservices-exceptions/../UnhandledExceptionHandler/PInvoke/PInvokeUnhandled/PInvokeUnhandled.sh: line 425: 34673 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"Return code: 1
Raw output file: /datadisks/disk1/work/A92209AD/w/B45F09A9/uploads/UnhandledExceptionHandler/PInvoke/PInvokeUnhandled/output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A92209AD/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true PInvokeUnhandled.dll ''
Failed to load AOT module '/datadisks/disk1/work/A92209AD/w/B45F09A9/e/baseservices/exceptions/UnhandledExceptionHandler/PInvoke/PInvokeUnhandled/PInvokeUnhandled.dll.so' ('/data [Full log]- CallStack
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 136 at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 117 at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor26|0_27(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)... [Full call stack]
- Exception Message
================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/A92209AD/w/B9C909AC/e/baseservices/baseservices/../TieredCompilation/TieredVtableMethodTests/TieredVtableMethodTests.sh: line 425: 12745 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"Return code: 1
Raw output file: /datadisks/disk1/work/A92209AD/w/B9C909AC/uploads/TieredCompilation/TieredVtableMethodTests/output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A92209AD/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true TieredVtableMethodTests.dll ''
Failed to load AOT module '/datadisks/disk1/work/A92209AD/w/B9C909AC/e/baseservices/TieredCompilation/TieredVtableMethodTests/TieredVtableMethodTests.dll.so' ('/datadisks/disk1/work/A92209AD/w/B9C909AC/e/ [Full log]- CallStack
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 136 at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 117 at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor19|0_20(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)... [Full call stack]
❌ AppleHybrid.Tests.WorkItemExecution [Console] [Details] [Artifacts] [7.92% failure rate]
-
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]
This is a helix work item crash with status: BadExit. To investigate look the [Console log] / navigate to [Helix Artifacts]
Failing Configuration
❌ baseservices/exceptions/UnhandledExceptionHandler/Foreign/ForeignUnhandled/ForeignUnhandled.cmd [Console] [Details] [Artifacts] [0.38% failure rate]
-
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]
Failing Configuration
❌ baseservices/exceptions/UnhandledExceptionHandler/PInvoke/PInvokeUnhandled/PInvokeUnhandled.cmd [Console] [Details] [Artifacts] [0.71% failure rate]
-
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]
Failing Configuration
❌ baseservices/TieredCompilation/TieredVtableMethodTests/TieredVtableMethodTests.cmd [Console] [Details] [Artifacts] [0.37% failure rate]
-
[ 🚧 Create issue against infrastructure team] [ 📄 Create issue in this repo]