MacCatalyst tests apps don't run on macOS 15, possibly missing some required entitlements

[matouskozak]

When testing possibly of migrating to newer macOS queue #1368 (comment), we encountered an issue where the precompiled MacCatalyst System.AppContext.Tests.app and iOS.Simulator.PInvoke.Test.app don't run on macOS 15 with error message:

_LSOpenURLsWithCompletionHandler() failed with error -54.

This could mean that the app is missing some required entitlements or might have to be rebuilt with newer XCode to work properly on newer macOS.

The queue seem to be configured properly as the dotnet/runtime MacCatalyst jobs are running as expected https://dev.azure.com/dnceng-public/public/_build/results?buildId=982758&view=results.

[matouskozak]

fyi: @rolfbjarne @ivanpovazan

[akoeplinger]

Hmm do you only see this on arm64 runs? the precompiled app is x64 only so the new mac might be missing Rosetta.

[matouskozak]

Hmm do you only see this on arm64 runs? the precompiled app is x64 only so the new mac might be missing Rosetta.

Both x64 and arm64 have the same issue.

[rolfbjarne]

What happens if you launch the executable directly, instead of using open ...?

So instead of this:

open -n -W /tmp/helix/working/99EA0909/w/A68008D5/e/iOS.Simulator.PInvoke.Test.app

do this:

/tmp/helix/working/99EA0909/w/A68008D5/e/iOS.Simulator.PInvoke.Test.app/Contents/MacOS/iOS.Simulator.PInvoke.Test

Also I'm assuming the name of the test app ("iOS.Simulator") doesn't mean anything?

[matouskozak]

What happens if you launch the executable directly, instead of using open ...?

So instead of this:

open -n -W /tmp/helix/working/99EA0909/w/A68008D5/e/iOS.Simulator.PInvoke.Test.app

do this:

/tmp/helix/working/99EA0909/w/A68008D5/e/iOS.Simulator.PInvoke.Test.app/Contents/MacOS/iOS.Simulator.PInvoke.Test

This works and the app is executed as expected (verified locally).

Also I'm assuming the name of the test app ("iOS.Simulator") doesn't mean anything?

Yes, it is just a name I believe.

[rolfbjarne]

This works and the app is executed as expected (verified locally).

Were you able to reproduce the previous error locally as well (by using open ...)?

[matouskozak]

This works and the app is executed as expected (verified locally).

Were you able to reproduce the previous error locally as well (by using open ...)?

Yes.

open iOS.Simulator.PInvoke.Test.app
_LSOpenURLsWithCompletionHandler() failed with error -54.

[rolfbjarne]

Which entitlements does the app currently have?

[matouskozak]

Which entitlements does the app currently have?

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
	<key>BuildMachineOSBuild</key>
	<string>21E258</string>
	<key>CFBundleDevelopmentRegion</key>
	<string>en-US</string>
	<key>CFBundleExecutable</key>
	<string>iOS.Simulator.PInvoke.Test</string>
	<key>CFBundleIdentifier</key>
	<string>net.dot.iOS.Simulator.PInvoke.Test</string>
	<key>CFBundleInfoDictionaryVersion</key>
	<string>6.0</string>
	<key>CFBundleName</key>
	<string>iOS.Simulator.PInvoke.Test</string>
	<key>CFBundlePackageType</key>
	<string>APPL</string>
	<key>CFBundleShortVersionString</key>
	<string>1.0</string>
	<key>CFBundleSupportedPlatforms</key>
	<array>
		<string>MacOSX</string>
	</array>
	<key>CFBundleVersion</key>
	<string>1</string>
	<key>DTCompiler</key>
	<string>com.apple.compilers.llvm.clang.1_0</string>
	<key>DTPlatformBuild</key>
	<string>13E113</string>
	<key>DTPlatformName</key>
	<string>macosx</string>
	<key>DTPlatformVersion</key>
	<string>12.3</string>
	<key>DTSDKBuild</key>
	<string>21E226</string>
	<key>DTSDKName</key>
	<string>macosx12.3</string>
	<key>DTXcode</key>
	<string>1330</string>
	<key>DTXcodeBuild</key>
	<string>13E113</string>
	<key>LSMinimumSystemVersion</key>
	<string>10.15.5</string>
	<key>NSSupportsAutomaticTermination</key>
	<true/>
	<key>NSSupportsSuddenTermination</key>
	<true/>
	<key>UIApplicationSceneManifest</key>
	<dict>
		<key>UIApplicationSupportsMultipleScenes</key>
		<false/>
	</dict>
	<key>UIDeviceFamily</key>
	<array>
		<integer>2</integer>
	</array>
	<key>UISupportedInterfaceOrientations</key>
	<array>
		<string>UIInterfaceOrientationPortrait</string>
	</array>
	<key>UISupportedInterfaceOrientations~ipad</key>
	<array>
		<string>UIInterfaceOrientationPortrait</string>
	</array>
</dict>
</plist>

[rolfbjarne]

That's the app manifest (Info.plist), and doesn't contain any entitlements.

In a Mac Catalyst or iOS project the entitlements would be in a file called Entitlements.plist, but I don't know how you're building your app - can you point me to your build logic / a build log?

[akoeplinger]

The test apps were compiled years ago and uploaded to blob storage, e.g. https://netcorenativeassets.blob.core.windows.net/resource-packages/external/ios/test-app/maccatalyst/System.AppContext.Tests.app.zip

[rolfbjarne]

Yes, that app doesn't have any entitlements, nor is it signed.

So I see two options:

1. Re-build the test app, adding entitlements + signing it.
2. Just execute the executable instead of doing open ... *.app