This repository has been archived by the owner on Nov 17, 2023. It is now read-only.
[Scala][macOS] Trying to build from source #12568
Comments
|
Thanks for submitting the issue @mariussoutier |
|
As for CUDA, installing older Developer Command Line Tools with clang 9.0, the compilation advances much further, but then the linker fails with
|
|
So far, we have not been testing or designing our build systems to work with GPU on a Mac. So yes, it might be possible that the path is hardcoded for Unix (not apple) based systems. Are you using cmake or make to compile? |
|
I'm using make. I added a softlink to make the warning go away, but the compile error persists. |
|
Actually, I'm using When I switch the script to cmake, I get the following error: |
|
Yes unfortunately soft-links won't fix the problem. NVCC doesn't support modern Clang. The best path forward to get it to compile would be to install GCC from brew, and then use it to compile your code. |
|
Can you give me a pointer to how I can switch the build from clang to gcc? |
|
Absolutely! So first install brew and do a "brew install gcc". Then if you're building with make you'd just have to do something like export CXX=/path/to/g++
export CC=/path/to/gccWith cmake you could add this before generating your build files: "-DCMAKE_CXX_COMPILER=/path/to/g++ -DCMAKE_C_COMPILER=/path/to/gcc" |
|
Thanks, that worked perfectly! Now during What this's |
|
Looks like it's almost working. Just to double check, would you be able to run a quick echo $LD_LIBRARY_PATHand paste it here? Also a otool -L libmxnet.soThose two commands should let us know what version of libcudart it's linked against and if it's on the library path. |
|
@mariussoutier Thanks for your effort by making MXNet Scala GPU working on Mac OSX. The issue you have should be the linking issue. You should include them before you build the MXNet backend. Please check |
and |
|
How about the |
|
|
I've tried these suggestions from the links: but to no avail. Maybe |
|
@mariussoutier So if you add this, will the build package pass? I would also like to encourage you to join our devlist. We also hold a small MXNet-Scala slack channel there. You will get fast response with the people working on Scala package. |
|
@lanking520 Not sure how I can add this in Maven, I mostly use sbt for Scala builds. Will try to investigate. How can I join the Slack channel? |
|
@mariussoutier - To join the slack channel, post to the dev list a message that you would be like to be added to the slack channel and someone will invite you. There is also a @mxnet-scala slack room that we can use for faster chatting |
|
@mariussoutier Is your issue resolved now ? |
|
@piyushghai no it isn't. I also didn't have the time to further investigate and am not sure if it's worth the effort. |
|
@mariussoutier Since the last time you looked at this, we have greatly improved the scala build process (#13493 and #13626). It now just dynamically links against the libmxnet.so. All you should need to do is build the engine for osx gpu and then the maven build shouldn't have a problem with it. |
|
@mariussoutier Close this issue for now since this is fixed. Please feel free to reopen this if you are still facing this problem |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
I'm trying to build the Scala package from source on macOS with MXNet 1.3.0.
Here is what I found:
nvcc fatal : The version ('9.1') of the host compiler ('Apple clang') is not supportedThe size of NDArray doesn't match the requested MKLDNN memory desc.The text was updated successfully, but these errors were encountered: