Add support for nvcomp-2.3 in java build

[jbrennan333]

Closes #10681.

Add support to the Java build to use nvcomp-2.3 instead of nvcomp-2.2. The main difference is that nvcomp-2.2 was included as a static library built by CUDF CPP while nvcomp-2.3 is only available as shared libraries that must be downloaded separately.

I'm putting this up as a draft pr so I can get feedback, and also because merging this without additional changes to pull in nvcomp-2.3 automatically in CUDF are needed. If we merge this without those changes, the java build will succeed, but java unit tests will fail and the resulting jars will not work. This is primarily because of the changes to the NativeDepsLoader, which will fail if it does not find the nvcomp-2.3 shared libs.

Note that @robertmaynard is working on rapids_cpm_nvcomp. Once that is available, we should be able to update the changes here and combine them with the changes needed in CUDF CPP so we can do everything in one PR.

The spark-rapids-jni project will also require a corresponding change. I will file PR in that project as well.

Another reason to hold off on making this change is that nvcomp-2.3 shared libs are not compiled with CUDA_API_PER_THREAD_DEFAULT_STREAM. This is a performance issue for spark-rapids - see previous issue: #9534

[jbrennan333]

I tried using cmake install to do the copies with code like this:

if(TARGET nvcomp::nvcomp)
  install(
    IMPORTED_RUNTIME_ARTIFACTS nvcomp::nvcomp nvcomp::nvcomp_gdeflate nvcomp::nvcomp_bitcomp
    LIBRARY DESTINATION "${PROJECT_BINARY_DIR}"
  )
endif()

But IMPORTED_RUNTIME_ARTIFACTS requires cmake 3.21 or greater, and the spark-rapids-jni docker image currently has cmake version 3.20..5. So for now I went back to the copy method.

cc: @robertmaynard

[robertmaynard]

I have opened a PR to add rapids_cpm_nvcomp rapidsai/rapids-cmake#190

[jbrennan333]

I don't understand what that checkstyle issue is?

[jlowe]

I don't understand what that checkstyle issue is?

It's CMake formatting:

cmake-format.............................................................Failed
- hook id: cmake-format
- files were modified by this hook

You probably need to run cpp/scripts/run-cmake-format.sh cmake-format java/src/main/native/CMakeLists.txt.

[jbrennan333]

These changes were pulled into #10851, so this draft PR can be closed.