[gdal] Add features for hdf5, netcdf, postgresql

[dg0yt]

• What does your PR fix?

  Adds feature control for hdf5, netcdf, postgresql.
  Unblocks builds for arm64-windows and uwp. (However, not successful in CI.) (UWP not supported due to comsupp lib.)
  Fixes finding expat debug lib on mingw.

• Which triplets are supported/not supported? Have you updated the CI baseline?

  all, yes

• Does your PR follow the maintainer guide?

  yes

• If you have added/updated a port: Have you run ./vcpkg x-add-version --all and committed the result?

  yes

[longhuan2018]

Can you add a SPATIALITE_412_OR_LATER macro definition to libspatialite?
dependency_win.cmake

  if ("libspatialite" IN_LIST FEATURES)
    ........
    set(HAVE_SPATIALITE "-DHAVE_SPATIALITE -DSPATIALITE_412_OR_LATER")
  endif()

The description of SPATIALITE_412_OR_LATER is in the nmake.opt file

# Uncomment following line if spatialite is 4.1.2 or later
#SPATIALITE_412_OR_LATER=yes

[dg0yt]

Can you add a SPATIALITE_412_OR_LATER macro definition to libspatialite?

Thanks for the hint!
I will update the PR when the prerequisite PRs are merged. I get no response for #20480.

[JackBoosY]

Oh, libcrypto from openssl needs User32.lib now?

libcrypto.lib(cryptlib.obj) : error LNK2019: unresolved external symbol __imp_GetProcessWindowStation referenced in function OPENSSL_isservice
libcrypto.lib(cryptlib.obj) : error LNK2019: unresolved external symbol __imp_GetUserObjectInformationW referenced in function OPENSSL_isservice
libcrypto.lib(cryptlib.obj) : error LNK2019: unresolved external symbol __imp_MessageBoxW referenced in function OPENSSL_showfatal
spatialite.dll : fatal error LNK1120: 3 unresolved externals

I remember openssl's cmake wrapper doing this stuff. But why this regression happened?

[dg0yt]

I remember openssl's cmake wrapper doing this stuff. But why this regression happened?

There are two other libs, but not user32.lib. I think this is okay for cmake because of the implicit link libraries which do contain user32.lib (but not the other two libs).
The new issue is with a nmake build, probably the first which uses libcrypto transitively (via proj and curl, this PR) basedf on pkgconfig data, for a library (libspatialite). That's why user32.lib isn't already present in the port' link libs.

[dg0yt]

Wait, I made that error note to the wrong PR initially, and forgot to hide it. Sorry for the noise. My comments apply to #20443.

[dg0yt]

@BillyONeal vcpkg ci exception again on agent vcpkg-eg-mac-02, https://dev.azure.com/vcpkg/public/_build/results?buildId=64286&view=logs&j=7b75bd19-17d3-53d4-00fd-23f1a49a8ba4.

[JackBoosY]

@BillyONeal Should we add these Visual Studio Components on our CI?

[BillyONeal]

I don't believe comsupp supports UWP at all.

[JackBoosY]

@dg0yt Can you double confirm that?
If gdal doesn't support arm or uwp, please move them to supports.

[dg0yt]

I can't say much about gdal usage about uwp. I don't care if uwp is supported at all.
But gdal works well on all types of Android, including ARM.

[dg0yt]

What I really don't understand is how the MSVC toolchains manage to pull in libs which are not installed or supported for the given platform. Why not fail early?

[JackBoosY]

Ping @BillyONeal for reply.

[BillyONeal]

@BillyONeal The open question was: Is ATLS.LIB for arm64-windows (not UWP!) missing intentionally, or doesn't it exist?

For desktop there is an ATL available for all the things:

Checking these boxes gives me:

"C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30133\atlmfc\lib\arm64\atls.lib"

[dg0yt]

So it is missing in the CI image only. This PR handles this correctly by the CI baseline entry.

[BillyONeal]

I think this means gdal:arm64-windows should be in ci.baseline.txt but there should be supports:!uwp since there seems to be no attempt by upstream to support that (if they need comsupp.lib and ATL)

[BillyONeal]

Oh I see you already did that

[dg0yt]

x64-linux error is unrelated:

CMake Error at /mnt/vcpkg-ci/installed/x64-linux/share/ffmpeg/FindFFMPEG.cmake:68 (find_library):
  Could not find FFMPEG_DEPENDENCY_asound_RELEASE using the following names:
  asound
Call Stack (most recent call first):
  /mnt/vcpkg-ci/installed/x64-linux/share/ffmpeg/FindFFMPEG.cmake:148 (append_dependencies)
  /mnt/vcpkg-ci/installed/x64-linux/share/ffmpeg/vcpkg-cmake-wrapper.cmake:6 (_find_package)
  /agent/_work/1/s/scripts/buildsystems/vcpkg.cmake:742 (include)
  modules/videoio/cmake/detect_ffmpeg.cmake:6 (find_package)
  modules/videoio/cmake/init.cmake:7 (include)
  modules/videoio/cmake/init.cmake:11 (add_backend)
  cmake/OpenCVModule.cmake:298 (include)
  cmake/OpenCVModule.cmake:361 (_add_modules_1)
  cmake/OpenCVModule.cmake:385 (ocv_glob_modules)
  CMakeLists.txt:917 (ocv_register_modules)

[JackBoosY]

libasound is provided by port alsa.

usr@usr:/home/usr/work/vcpkg# ./vcpkg depend-info opencv4[ade,contrib,core,default-features,dnn,eigen,ffmpeg,gdcm,gtk,ipp,jasper,jpeg,lapack,nonfree,openexr,opengl,openmp,png,python,qt,quirc,sfm,tiff,vtk,webp]:x64-linux
zlib:
vcpkg-cmake-config:
vcpkg-cmake:
libiconv:
brotli:
bzip2:
libpng: vcpkg-cmake, vcpkg-cmake-config, zlib
pthreads:
libffi: vcpkg-cmake, vcpkg-cmake-config
json-c:
libuuid:
gettext: libiconv
pcre: vcpkg-cmake, vcpkg-cmake-config
freetype[png, bzip2, zlib, brotli]: brotli, bzip2, libpng, vcpkg-cmake, vcpkg-cmake-config, zlib
pthread: pthreads
expat:
vcpkg-tool-meson:
dirent:
lzo:
libjpeg-turbo:
liblzma: vcpkg-cmake, vcpkg-cmake-config
fontconfig: dirent, expat, freetype, gettext, json-c, libiconv, libuuid, pthread, vcpkg-tool-meson
glib: dirent, gettext, libffi, libiconv, pcre, vcpkg-tool-meson, zlib
openblas: pthread, vcpkg-cmake, vcpkg-cmake-config
szip: vcpkg-cmake, vcpkg-cmake-config
openssl: vcpkg-cmake, vcpkg-cmake-config
egl-registry:
pixman: libpng, vcpkg-tool-meson
opengl:
opengl-registry: egl-registry
openjpeg: vcpkg-cmake, vcpkg-cmake-config
lz4: vcpkg-cmake, vcpkg-cmake-config
libxml2: libiconv, liblzma, vcpkg-cmake, vcpkg-cmake-config, zlib
libwebp[simd, nearlossless]: vcpkg-cmake, vcpkg-cmake-config
libsass:
tiff[lzma, jpeg, zip]: libjpeg-turbo, liblzma, vcpkg-cmake, zlib
vcpkg-pkgconfig-get-modules:
libogg:
sqlite3[tool]: vcpkg-cmake, vcpkg-cmake-config
zstd: vcpkg-cmake, vcpkg-cmake-config
hdf5[szip, zlib]: szip, vcpkg-cmake, vcpkg-cmake-config, zlib
giflib: vcpkg-cmake
blas: openblas
gflags:
getopt:
cairo[x11, gobject, freetype, fontconfig]: dirent, expat, fontconfig, freetype, glib, libpng, lzo, pixman, pthread, vcpkg-tool-meson, zlib
harfbuzz: freetype, vcpkg-tool-meson
fribidi:
curl[openssl, ssl, non-http]: openssl, vcpkg-cmake, vcpkg-cmake-config, zlib
proj4[tiff, net]: curl, sqlite3, tiff, vcpkg-cmake, vcpkg-cmake-config
pegtl-2:
double-conversion:
freeglut:
pcre2: vcpkg-cmake, vcpkg-cmake-config
utfcpp:
pango: cairo, fontconfig, freetype, fribidi, gettext, glib, harfbuzz, vcpkg-tool-meson
gdk-pixbuf: gettext, glib, libpng, tiff, vcpkg-tool-meson, zlib
pugixml:
sassc: getopt, libsass
eigen3:
glew: opengl, vcpkg-cmake, vcpkg-cmake-config
netcdf-c[netcdf-4, nczarr, hdf5, platform-default-features, dap]: curl, hdf5, vcpkg-cmake, vcpkg-cmake-config, vcpkg-pkgconfig-get-modules
glog: gflags
graphene: gettext, glib, vcpkg-tool-meson
atk: gettext, glib, vcpkg-tool-meson
libtheora: libogg
icu:
angle: egl-registry, opengl-registry, zlib
libarchive[lzma, lz4, openssl, libxml2, zstd, bzip2]: bzip2, liblzma, libxml2, lz4, openssl, vcpkg-cmake, zlib, zstd
jsoncpp: vcpkg-cmake, vcpkg-cmake-config
libepoxy: vcpkg-tool-meson
lapack-reference[noblas, blas-select]: blas, vcpkg-cmake-config
leptonica: giflib, libjpeg-turbo, libpng, libwebp, openjpeg, tiff, vcpkg-cmake, vcpkg-cmake-config, zlib
libharu[notiffsymbols]: libpng, tiff, vcpkg-cmake, zlib
ade:
tesseract: leptonica, libarchive, vcpkg-cmake, vcpkg-cmake-config
ceres: eigen3, glog
vtk: double-conversion, eigen3, expat, freetype, glew, hdf5, jsoncpp, libharu, libjpeg-turbo, liblzma, libogg, libpng, libtheora, libxml2, lz4, netcdf-c, pegtl-2, proj4, pugixml, sqlite3, tiff, utfcpp, vcpkg-cmake, vcpkg-cmake-config, zlib
quirc:
qt5-base: angle, double-conversion, egl-registry, fontconfig, freetype, harfbuzz, icu, libjpeg-turbo, libpng, openssl, pcre2, sqlite3, vcpkg-pkgconfig-get-modules, zlib, zstd
ffmpeg[swscale, swresample, avdevice, avformat, avfilter, avcodec]: vcpkg-cmake, vcpkg-pkgconfig-get-modules
protobuf:
gdcm: expat, openjpeg, vcpkg-cmake, vcpkg-cmake-config, zlib
openexr: zlib
gtk: atk, cairo, gdk-pixbuf, gettext, glib, graphene, libepoxy, pango, sassc, vcpkg-tool-meson
jasper: freeglut, libjpeg-turbo, opengl, vcpkg-cmake, vcpkg-cmake-config
lapack: lapack-reference
opencv4[webp, sfm, quirc, python, qt, png, opengl, openexr, openmp, lapack, jpeg, vtk, jasper, ipp, tiff, nonfree, gtk, ffmpeg, eigen, dnn, default-features, contrib, gdcm, ade]: ade, blas, ceres, eigen3, ffmpeg, gdcm, gflags, glog, gtk, hdf5, jasper, lapack, libjpeg-turbo, libpng, libwebp, openexr, opengl, protobuf, qt5-base, quirc, tesseract, tiff, vcpkg-cmake, vcpkg-cmake-config, vtk, zlib

alsa is not in opencv4's dependency list. Even not in ffmpeg's dependency list.

[JackBoosY]

/azp run

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[dg0yt]

Please merge this soon. The next GDAL release is waiting.

[BillyONeal]

Thanks for the update!