New Magic Keyboard (M4) Trackpad Unresponsive

[Nonary]

Describe the bug
The latest M4 Magic Keyboard trackpad does not appear to function once a stream has started, it works fine prior to starting the stream. Other applications such as Remote Desktop do not appear to have the same issues, so I suspect it has to do with API calls of some kind on Moonlights side.

Steps to reproduce
Have an M4 IPad with the New Magic Keyboard

Start a stream, attempt to move the mouse

Screenshots
Not necessary, mouse just gets stuck.

Affected games
All games impacted.

Other Moonlight clients

• Does the issue occur when using Moonlight on PC or Android? No, this is an iOS exclusive issue.

Moonlight settings (please complete the following information)

• Have any settings been adjusted from defaults? No
• If so, which settings have been changed?
• Does the problem still occur after reverting settings back to default?

Gamepad-related issues (please complete if problem is gamepad-related)

• Do you have any gamepads connected to your host PC directly?
• If gamepad input is not working, does it work if you use Moonlight's on-screen controls?
• Does the problem still remain if you stream the desktop and use https://html5gamepad.com to test your gamepad?
  • Instructions for streaming the desktop can be found here: https://github.com/moonlight-stream/moonlight-docs/wiki/Setup-Guide

Device details (please complete the following information)

• iOS/tvOS version: 17.5
• Device model: iPad Pro 13-inch (M4)

Server PC details (please complete the following information)

• OS: Windows 11 22H3

[myMartek]

Wanted to create this issue as well. I can confirm this issue on my side. With the previous Magic Keyboard it is still working, only the new M4 variant is not. The keyboard itself is working by the way. So it’s just the touchpad.

[justinbadal]

Adding in my issue here. I am using Sunshine as the host. Tried a number of configuration combinations and couldn't get it to work.

[rpheuts]

Confirmed here as well. The keyboard part works, but not the trackpad. As others mentioned, this is still working on my older M2 iPad and Magic Keyboard, but doesn't work on the new hardware anymore.

[DANTIGO]

As of 05/16/24 this problem still exists. I Just got the new Magic Keyboard for my M4 13-Inch and I'm also having this issue. Everything else on the keyboard is fully functional besides the function keys only reacting for the iPadOS itself, but other than that things are great. I should add that the escape key is the only function key that actually works as intended for Moonlight. This is strictly exclusive to the new Magic Keyboard as my older iPad and Magic Keyboard are working just fine.

[rootbeerdan]

I’m able to left click and right click on the trackpad (if you can call it that), just not move the mouse around.

[blackgold9]

Same, m4 ipad pro and magic keyboard.

[alotofentropy]

Typing this from the M4 magic keyboard, but also unable to use the trackpad to control the mouse :(

[myMartek]

At a first glance it might be an iPadOS bug.

It seems that mouse.mouseInput.mouseMovedHandler = ^(GCMouseInput * _Nonnull mouse, float deltaX, float deltaY) { is never called on mouse move. I only get an event when I stop moving the mouse but then with a deltaX and deltaY of 0.

I am not sure if we can fix anything here

[DANTIGO]

Is there any recommended route of action to contact apple and inform them with the appropriate information for them to diagnose and patch this issue? It can't be something that's intended if it works fine on their previous keyboard. All the did was add a few buttons and make the trackpad bigger.

I use moonlight and my iPad a lot to access my computer since I'm not home as often as I wish, so this severely affects me.

[julianq]

Adding to the chorus here - M4 magic keyboard typing works, trackpad does not.

[myMartek]

Is there any recommended route of action to contact apple and inform them with the appropriate information for them to diagnose and patch this issue? It can't be something that's intended if it works fine on their previous keyboard. All the did was add a few buttons and make the trackpad bigger.

I use moonlight and my iPad a lot to access my computer since I'm not home as often as I wish, so this severely affects me.

Yes using the apple feedback app. I did enter a bug report there and it seems like there are at least 10 similar bug reports posted recently. Usually apple responds to those bug ticket in 2-5 days. I will keep you posted when apple responds to my ticket.

[myMartek]

Since iPadOS 17.5.1 was released today I gave it another try. Unfortunately the issue still is not fixed.

[moyer]

@myMartek Is the same issue occurring in other Remote Desktop applications? I tested with Jump desktop and trackpad support was fine.

I also just submitted a Feedback to Apple. Hope they get this fixed 🤞

[rpheuts]

Not sure how helpful this is, but I did confirm it still works with the AWS Workspaces client which has not seen an update for like a year. They must be using a different way to capture the pointer.

[myMartek]

I have not used AWS Workplace, but I guess this is the main difference: Most apps do not „Capture“ the pointer.
Mouse support was added in iPadOS 13.4 but did not have an API to capture the mouse. With capturing I refer to using the pointer exklusive for the opened app. So a captured mouse will not interact with the home indicator bar at the bottom or trigger any other things in the OS.

Starting with iPadOS 14 Apple added GCMouse APIs in order to fully capture the mouse. This is eg. needed for FPS games. This API seems to be broken for the current magic keyboard.

Best example for this is Steam Link. This app will allow the usage of the trackpad in Windows or Steam Big Picture mode, but when you open a FPS game Steam changes the input method to GCMouse to allow for real capturing and then the mouse does not work anymore as with moonlight in general. Steams philosophy is that when no FPS game is open it uses the „old“ APIs to not capture the mouse in order to allow easier interaction with iPadOS.

So currently the issue is only present when you want to use the mouse inputs exclusively.

[Ysabelle12]

Not working for me as well. works with external mouse but not the trackipad for m4

[Doeca]

maybe there will be big change after wwdc2024 so Apple changed the api for m4 ipad

[joetessy]

Still nothing? :(

[pilot-luch]

I would like to report my use case. Even without any media playing device keyboard will become unresponsive. No input detection from the trackpad or keyboard, even though it’s illuminated. The device seems to “respring” the last time this happened to correct itself.

[systox]

New iPad 13 Magic Keyboard touchpad doesn’t work with moonlight. It can scroll and it can click. But it can’t move the mouse.

[Ysabelle12]

I’ve got some temporary fixes: enable AssistiveTouch in accessibility. It works for me and it should in theory work for every M4 iPad users that use Magic Keyboard M4. However the downside of this is disable some input acceleration. You may or may not like that.

[joetessy]

Confirming @Ysabelle12’s workaround worked for me

[myMartek]

For me this makes no difference. Is there any specific option you enabled in the assistive touch section besides the main toggle?

[alotofentropy]

I’ve got some temporary fixes: enable AssistiveTouch in accessibility. It works for me and it should in theory work for every M4 iPad users that use Magic Keyboard M4. However the downside of this is disable some input acceleration. You may or may not like that.

Yep, this works for me. I only just needed to enable it and it started working. I really do hate the acceleration curve it uses though. Not sure if its habitual or just err designed to be annoying.

[rpheuts]

For me this makes no difference. Is there any specific option you enabled in the assistive touch section besides the main toggle?

It didn’t work for me initially, but after fiddling with it for a while (I believe adjusting the speed of the pointer finally fixed it) it did start working. I was able to adjust the speed to pretty much match my regular touchpad input. I also added a shortcut button to my home screen that toggle assistive touch on/off right next to the moonlight app. So I can leave it off for most of the time, but just quickly flick it on when I launch moonlight.

[moyer]

I’ve got some temporary fixes: enable AssistiveTouch in accessibility. It works for me and it should in theory work for every M4 iPad users that use Magic Keyboard M4. However the downside of this is disable some input acceleration. You may or may not like that.

This worked for me. I'm assuming turning on AssistiveTouch switches the mouse API used, so it's no longer using GCMouse, which is where the bug is. Direct mouse capture is still something you want for gaming (and low input lag in general) so hopefully it still gets fixed.

[hxssgaa]

I turned on the AssistiveTorch but didn’t work for me for m4 iPad Pro. Hope it gets fixed soon as I really to use trackpad.

[alotofentropy]

Try play with the different settings in assistive touch. I think it will cause it to change ios back to a working API.  I do agree though and hope it does get fixed soon though. I dont like the mapping curves with assistive touch. So hoping I can turn it off.

[Nonary]

Can confirm assistive touch workaround does work, but only after changing the sensitivity. You also need to make sure Moonlight is set to touchpad mode and not touch screen, otherwise the cursor resets every time you click

[myMartek]

Unfortunately iPadOS 18 Beta 1 does not fix the issue

[Leask]

same here

[itschendai]

same here

[theJayTea]

i have the same issue too! i hope apple fixes this, welp.

[n0brainer]

Unfortunately iPadOS 18 Beta 1 does not fix the issue

Thanks, I haven’t been brave enough to install on my iPad. Log feedback with Apple if you’re in the betas. The squeaky wheel gets the grease.

Also, be careful discussing non-public Beta information… prior experience has taught me that they are watching, no matter how obscure the references or post locations are.

[myMartek]

Has anyone tried 17.6 Beta yet?

[TheMaxXHD]

Has anyone tried 17.6 Beta yet?

Probably doesn't work either based on the dev release notes for it. https://developer.apple.com/documentation/ios-ipados-release-notes/ios-ipados-17_6-release-notes

Also might not be a bad idea to post about the bug on the apple dev forums, maybe get some traction on it. Not seeing anything relating to it under the gamekit forum section.

[n0brainer]

I guess now that it’s public beta I can safely comment. I tried it and it did work for me. It’s still beta so ymmv.

[khant14]

Did not work for me on 18 beta

[n0brainer]

Did not work for me on 18 beta

The 18 betas came out before the 17.6, hopefully in the next 18 beta it will be included.

[khant14]

Can confirm, 18 beta 2 fixes the mouse issue.

[Leask]

I just upgraded, and it works! The only remaining issue is background streaming. 😄

[joetessy]

works for me!

[alotofentropy]

Agreed. Issue is fixed iOs 18 beta 2 👍

[Colindm8]

Any news if this is fixed in 17.6 beta 2? Hoping it’s fixed in that as I don’t want to put the 18 beta on my iPad.

[Doeca]

Any news if this is fixed in 17.6 beta 2? Hoping it’s fixed in that as I don’t want to put the 18 beta on my iPad.

tested fixed in ipados 17.6 public beta(it seems to be developer beta 1)