ci : build-msys job slimming [no ci]

[danbev]

Overview

This PR attempts to slim down the dependencies for build-msys jobs making the same changes that we applied in whisper.cpp to reduce the size of the github actions cache, and should also improve the run time due to fewer dependencies that need to be installed.

Additional information

I realize this is a scheduled job but I think it would still make sense to apply these changes.

I ran this on my fork and it passed. The github cache for this job are the following:

msys2-pkgs-upd:true-conf:c3b1d407-files:faa0dba24e8d2f387eaee8e3f624e2b2b6b806a5c47086e16c5f9d2c55e6e667
200 MB 
msys2-pkgs-upd:true-conf:f43c365f-files:c6629634f6d038bbc3fd3c1c9273a1c8e61ffdec95b6d71cd5a20d6f06dfccba
140 MB

Refs: ggml-org/whisper.cpp#3858

Requirements

• I have read and agree with the contributing guidelines
• AI usage disclosure: No