Patch selection change performance

[84634E1A607A]

Brief Description of What This PR Does

Increased performance when changing shown patch.

Related Issues
Closes #3660
Closes #3674

Progress Checklist

Note: before starting this checklist the PR should be marked as non-draft.

• PR author has checked that this PR works as intended and doesn't
  break existing features:
  https://wiki.revolutionarygamesstudio.com/wiki/Testing_Checklist
  (this is important as to not waste the time of Thrive team
  members reviewing this PR)
• Initial code review passed (this and further items should not be checked by the PR author)
• Functionality is confirmed working by another person (see above checklist link)
• Final code review is passed and code conforms to the
  styleguide.

Before merging all CI jobs should finish on this PR without errors, if
there are automatically detected style issues they should be fixed by
the PR author. Merging must follow our
styleguide.

[hhyyrylainen]

Does this not close #3660 ? If this addresses the other points but not the input remap registering, I think it's still fine to mark this as closing that issue.

[84634E1A607A]

Lag is still observable although better than before.

[hhyyrylainen]

Is the lag caused by #1085 ? If so I think #3660 could be closed.

[84634E1A607A]

Caused by #3674 (It hits me that #3660 can be closed)

[hhyyrylainen]

I playtested and didn't see any glaring bugs with this and the patch change performance was definitely better. Code's now also been hammered into shape.