xcodebuild when using Xcode 15 ignores -destination

[simonmcl]

Select Topic Area

Bug

Body

I've recently upgraded my local machine to Sonoma and Xcode 15. I made some minor changes to a swift package based on warnings from Xcode 15 and wanted to update my github action to use Xcode 15 too. My Swift package is iOS only (due to a dependency), therefore it can't be built with Swift build, it must be built with xcodebuild forcing the destination to be iOS only. Something like this:

xcodebuild test -scheme xxxxx -destination "platform=iphonesimulator,OS=16.4,name=iPhone 14 Pro"

Otherwise it will attempt to build it for macos as well, which will cause the build to fail

This works fine on my machine for Xcode 13, 14 and 15. It works fine on github actions using Xcode 13 and 14. But when using 15, it seems to ignore this and trys to build for macos. This means i'm unable to make use of Xcode 15

Xcode 14 run using:

steps:
      - name: Select Xcode version
        run: sudo xcode-select -s '/Applications/Xcode_14.3.1.app/Contents/Developer'

.....

- name: Test
        run: xcodebuild test -scheme KukaiCoreSwift -destination "platform=iphonesimulator,OS=16.4,name=iPhone 14 Pro" -enableCodeCoverage YES -resultBundlePath "$PWD/xcode-$NOW.xcresult"

https://github.com/kukai-wallet/kukai-core-swift/actions/runs/7117775835

Passes without issue

Xcode 15 run using:

steps:
      - name: Select Xcode version
        run: sudo xcode-select -s '/Applications/Xcode_15.0.1.app/Contents/Developer'

.....

- name: Test
        run: xcodebuild test -scheme KukaiCoreSwift -destination "platform=iphonesimulator,OS=17.0,name=iPhone 15 Pro" -enableCodeCoverage YES -resultBundlePath "$PWD/xcode-$NOW.xcresult"

https://github.com/kukai-wallet/kukai-core-swift/actions/runs/7117800234

Fails due to an attempt to build on macos. Same command runs fine for me locally. ANy help would be appreciated

[samsymons]

Hey @simonmcl! I believe I've just gone through this same problem. I was getting this in the logs, where you can see macOS is being picked by default:

Run set -o pipefail && xcodebuild test \
--- xcodebuild: WARNING: Using the first of multiple matching destinations:
{ platform:macOS, arch:arm64, variant:Designed for [iPad,iPhone], id:0000FE00-94755927B8839656 }
{ platform:iOS, id:dvtdevice-DVTiPhonePlaceholder-iphoneos:placeholder, name:Any iOS Device }
{ platform:iOS Simulator, id:dvtdevice-DVTiOSDeviceSimulatorPlaceholder-iphonesimulator:placeholder, name:Any iOS Simulator Device }
{ platform:iOS Simulator, id:D68D3AD1-8649-42D3-A3CD-247A51403A7C, OS:17.0.1, name:iPad (10th generation) }
{ platform:iOS Simulator, id:D68D3AD1-8649-42D3-A3CD-247A51403A7C, OS:17.0.1, name:iPad (10th generation) }
...etc...

The thing that saved me here was noticing that the OS versions for the simulators is 17.0.1, not 17.0. I'd bet that changing your destination to platform=iOS Simulator,name=iPhone 15 Pro,OS=17.0.1 would fix this - it did for me. 🙂

[simonmcl]

Thanks for the tip, it says 17.0 on this list: https://github.com/actions/runner-images/blob/macos-13/20231025.2/images/macos/macos-13-Readme.md weird!.
Tried it and so far it timed-out failing to connect to simulator. Waiting for a re-run uh

Resolve Package Graph
2023-12-07T10:58:25.4464900Z 
2023-12-07T11:04:44.3892250Z 2023-12-07 11:04:44.387 xcodebuild[4725:40597]  iOSSimulator: 📱<DVTiPhoneSimulator (0x7fce60fd3040), iPhone 15 Pro, unknown class, 17.0.1 (21A342), 6DFAD023-11E3-46B2-8E0F-979E6D8C5D42> unable to connect to "com.apple.instruments.deviceservice.lockdown" - timed out after 120 seconds
2023-12-07T11:08:06.8385390Z 2023-12-07 11:08:06.807 xcodebuild[4725:40597]  iOSSimulator: 📱<DVTiPhoneSimulator (0x7fce60fd3040), iPhone 15 Pro, unknown class, 17.0.1 (21A342), 6DFAD023-11E3-46B2-8E0F-979E6D8C5D42> unable to connect to "com.apple.instruments.deviceservice.lockdown" - timed out after 120 seconds
2023-12-07T11:12:21.3334140Z 2023-12-07 11:12:21.319 xcodebuild[4725:44234]  iOSSimulator: 📱<DVTiPhoneSimulator (0x7fce60fd3040), iPhone 15 Pro, unknown class, 17.0.1 (21A342), 6DFAD023-11E3-46B2-8E0F-979E6D8C5D42> unable to connect to "com.apple.instruments.deviceservice.lockdown" - timed out after 120 seconds
2023-12-07T11:13:15.0240290Z 
2023-12-07T11:13:15.1241690Z 
2023-12-07T11:13:15.2246250Z *** If you believe this error represents a bug, please attach the result bundle at /Users/runner/work/kukai-core-swift/kukai-core-swift/xcode-2023-12-07T10:47:09.xcresult
2023-12-07T11:13:15.3244200Z 
2023-12-07T11:13:19.4314100Z Resolve Package Graph
2023-12-07T11:13:38.9086460Z 
2023-12-07T11:21:13.3044480Z Resolve Package Graph
2023-12-07T11:21:28.7823230Z 
2023-12-07T11:21:59.3671610Z Resolve Package Graph
2023-12-07T11:22:19.7034510Z 
2023-12-07T11:22:58.1559070Z Resolve Package Graph
2023-12-07T11:23:21.3884440Z 2023-12-07 11:23:21.378 xcodebuild[4725:52407]  IDETestOperationsObserverDebug: Failure collecting diagnostics from simulator: Timed out after 600.0 seconds while waiting for a response from the invoked process
2023-12-07T11:23:22.1026970Z 2023-12-07 11:23:22.068 xcodebuild[4725:26219] [MT] IDETestOperationsObserverDebug: 1499.007 elapsed -- Testing started completed.
2023-12-07T11:23:22.1031770Z 2023-12-07 11:23:22.069 xcodebuild[4725:26219] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
2023-12-07T11:23:22.1036050Z 2023-12-07 11:23:22.069 xcodebuild[4725:26219] [MT] IDETestOperationsObserverDebug: 1499.007 sec, +1499.007 sec -- end
2023-12-07T11:23:39.3240790Z 
2023-12-07T11:23:39.3400670Z Testing failed:
2023-12-07T11:23:39.3401500Z Test session results, code coverage, and logs:
2023-12-07T11:23:39.3486310Z 	xctest (9313) encountered an error (Test runner never began executing tests after launching)

[simonmcl]

Nope, multiple attempts to tweak various things, even trying to force the simulator to open first. All results in the above timeout

[samsymons]

Ah, that sounds like the simulator boot time issue that affects 15.0 and 15.0.1 - 15.1 is meant to fix this ostensibly.

There's an open source tool mentioned here that might help, but I haven't tried it.

[simonmcl]

Yeah the note on 15.1 from github actions is that its in beta so they won't be adding it yet. I've tried 2 recommendations from this thread: actions/runner-images#8651 enabling iOS 16 simulators for Xcode 15, and installing yeetd. Can't get either to work. Gonna down grade to Xcode 14, avoid anything new and deal with my new permanent Xcode 15 warnings until this mess is sorted out. Apparently bitrise is doing a much better job, 15.1 is generally available and working. Might look into switching some other time

Thanks for the links and support anyway though

[silverhammermba]

I ran into this issue too and fixed it just by deleting and re-adding the simulator.

Old simulator which xcodebuild couldn't find:

{ platform:iOS Simulator, id:5575F133-1565-4864-882C-78E3EA80F618, OS:17.0, name:iPhone 14 }

new one which it can find

{ platform:iOS Simulator, id:EDC4FDF6-1628-410E-87D0-61A5A74F0696, OS:17.0, name:iPhone 14 }