Skip to content

Conversation

@afsanjar
Copy link
Contributor

@afsanjar afsanjar commented Feb 8, 2022

Alluxio build fails on ppc64le

@afsanjar afsanjar requested a review from iwasakims February 9, 2022 05:08
@iwasakims iwasakims changed the title Alluxio build fails on ppc64le BIGTOP-3639: Alluxio build fails on ppc64le Feb 16, 2022
. `dirname $0`/bigtop.bom

if [ $HOSTTYPE = "powerpc64le" ] ; then
mvn install:install-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.28.1 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/usr/src/grpc-java-1.28.0/compiler/build/exe/java_plugin/protoc-gen-grpc-java
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The binary of grpc 1.28.0 should be installed as io.grpc:protoc-gen-grpc-java:1.28.0 rather than 1.28.1. Then adding -Dgrpc.version=1.28.0 to mvn options could be an option?

If grpc-1.28.0 does not work with Alluxio, you can upgrade the version of grpc added by BIGTOP-3560 (#813). You need to modify bigtop-packages/src/common/zeppelin/patch1-arm64-build.diff too since it refers to the 1.28.0.

@sekikn
Copy link
Contributor

sekikn commented Mar 23, 2022

We're facing this problem during the 3.0.1 build.
https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.1/11/

@afsanjar May I address Masatake's comment based on your work, or could you update this PR?

@afsanjar
Copy link
Contributor Author

afsanjar commented Mar 23, 2022 via email

@afsanjar
Copy link
Contributor Author

@sekikn, please review the changes. Thanks

@afsanjar afsanjar requested a review from sekikn March 25, 2022 15:06
@sekikn
Copy link
Contributor

sekikn commented Mar 25, 2022

Thank you for updating the PR @afsanjar!
I just tried to test it on the ppc64 CI node, but it seems unavailable now. Would you take a look? (Sorry if it's just a intermittent failure)

@afsanjar
Copy link
Contributor Author

afsanjar commented Mar 25, 2022 via email

@sekikn
Copy link
Contributor

sekikn commented Mar 25, 2022

+1, tested on ppc64 and it worked. Thanks a lot @afsanjar!

@sekikn sekikn merged commit b296ae6 into apache:master Mar 25, 2022
sekikn pushed a commit that referenced this pull request Mar 25, 2022
@sekikn
Copy link
Contributor

sekikn commented Mar 27, 2022

I found that only this PR leads to a build failure on Debian or Ubuntu.
(This problem may be specific for our CI environment, because we're doing some tricky things to avoid the uid inconsistency between host and docker container)

https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.1/12/DISTRO=debian-10,PLATFORM=ppc64le-slave/console
https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.1/12/DISTRO=ubuntu-18.04,PLATFORM=ppc64le-slave/console
https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.1/12/DISTRO=ubuntu-20.04,PLATFORM=ppc64le-slave/console

+ '[' powerpc64le = powerpc64le ']'
+ mvn install:install-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.28.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/usr/src/grpc-java-1.28.0/compiler/build/exe/java_plugin/protoc-gen-grpc-java
[ERROR] Could not create local repository at /root/.m2/repository -> [Help 1]

...

[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/LocalRepositoryNotAccessibleException
make[1]: *** [debian/rules:31: override_dh_auto_build] Error 1
make[1]: Leaving directory '/ws/output/alluxio/alluxio-2.4.1'
make: *** [debian/rules:27: binary] Error 2
dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
debuild: fatal error at line 1182:
dpkg-buildpackage -us -uc -ui -b
 failed

> Task :alluxio-deb FAILED

FAILURE: Build failed with an exception.

I'm going to submit an addendum PR for it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants