HADOOP-19019: Parallel Maven Build Support for Apache Hadoop (#6373).…

[ayushtkn]

… Contributed by JiaLiangC.

Description of PR

Backport of
#6373 (comment)

How was this patch tested?

Relying on CI

For code changes:

• Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
• Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
• If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
• If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 19s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ branch-3.4 Compile Tests _
+0 🆗	mvndep	4m 2s		Maven dependency ordering for branch
-1 ❌	mvninstall	30m 37s	/branch-mvninstall-root.txt	root in branch-3.4 failed.
-1 ❌	compile	9m 38s	/branch-compile-root-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	root in branch-3.4 failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.
+1 💚	compile	8m 29s		branch-3.4 passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05
+1 💚	mvnsite	2m 58s		branch-3.4 passed
-1 ❌	javadoc	2m 3s	/branch-javadoc-hadoop-yarn-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	hadoop-yarn-project in branch-3.4 failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.
-1 ❌	javadoc	1m 54s	/branch-javadoc-hadoop-yarn-project-jdkPrivateBuild-1.8.0_422-8u422-b05-1~20.04-b05.txt	hadoop-yarn-project in branch-3.4 failed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05.
+1 💚	shadedclient	81m 20s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 22s		Maven dependency ordering for patch
+1 💚	mvninstall	2m 12s		the patch passed
+1 💚	compile	8m 49s		the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04
+1 💚	javac	8m 49s		the patch passed
+1 💚	compile	8m 9s		the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05
+1 💚	javac	8m 9s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	2m 40s		the patch passed
-1 ❌	javadoc	1m 59s	/results-javadoc-javadoc-hadoop-yarn-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	hadoop-yarn-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 generated 6 new + 349 unchanged - 0 fixed = 355 total (was 349)
-1 ❌	javadoc	2m 0s	/results-javadoc-javadoc-hadoop-yarn-project-jdkPrivateBuild-1.8.0_422-8u422-b05-1~20.04-b05.txt	hadoop-yarn-project-jdkPrivateBuild-1.8.0_422-8u422-b05-120.04-b05 with JDK Private Build-1.8.0_422-8u422-b05-120.04-b05 generated 6 new + 576 unchanged - 0 fixed = 582 total (was 576)
+1 💚	shadedclient	29m 5s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	135m 42s		hadoop-mapreduce-project in the patch passed.
+1 💚	unit	208m 41s		hadoop-yarn-project in the patch passed.
+1 💚	asflicense	0m 55s		The patch does not generate ASF License warnings.
		477m 2s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7027/4/artifact/out/Dockerfile
GITHUB PR	#7027
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint
uname	Linux f7c34246bc38 5.15.0-117-generic #127-Ubuntu SMP Fri Jul 5 20:13:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.4 / 54da8b1
Default Java	Private Build-1.8.0_422-8u422-b05-1~20.04-b05
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~20.04-b05
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7027/4/testReport/
Max. process+thread count	2627 (vs. ulimit of 5500)
modules	C: hadoop-mapreduce-project hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7027/4/console
versions	git=2.25.1 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 19s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ branch-3.4 Compile Tests _
+0 🆗	mvndep	4m 15s		Maven dependency ordering for branch
-1 ❌	mvninstall	5m 12s	/branch-mvninstall-root.txt	root in branch-3.4 failed.
+1 💚	compile	15m 50s		branch-3.4 passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04
+1 💚	compile	8m 15s		branch-3.4 passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05
-1 ❌	mvnsite	0m 28s	/branch-mvnsite-hadoop-mapreduce-project.txt	hadoop-mapreduce-project in branch-3.4 failed.
-1 ❌	mvnsite	0m 41s	/branch-mvnsite-hadoop-yarn-project.txt	hadoop-yarn-project in branch-3.4 failed.
-1 ❌	javadoc	0m 27s	/branch-javadoc-hadoop-mapreduce-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	hadoop-mapreduce-project in branch-3.4 failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.
-1 ❌	javadoc	0m 42s	/branch-javadoc-hadoop-yarn-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	hadoop-yarn-project in branch-3.4 failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.
-1 ❌	javadoc	0m 25s	/branch-javadoc-hadoop-mapreduce-project-jdkPrivateBuild-1.8.0_422-8u422-b05-1~20.04-b05.txt	hadoop-mapreduce-project in branch-3.4 failed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05.
-1 ❌	javadoc	0m 37s	/branch-javadoc-hadoop-yarn-project-jdkPrivateBuild-1.8.0_422-8u422-b05-1~20.04-b05.txt	hadoop-yarn-project in branch-3.4 failed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05.
+1 💚	shadedclient	57m 47s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 12s		Maven dependency ordering for patch
-1 ❌	mvninstall	0m 10s	/patch-mvninstall-hadoop-mapreduce-project.txt	hadoop-mapreduce-project in the patch failed.
-1 ❌	mvninstall	0m 26s	/patch-mvninstall-hadoop-yarn-project.txt	hadoop-yarn-project in the patch failed.
+1 💚	compile	8m 30s		the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04
+1 💚	javac	8m 30s		the patch passed
+1 💚	compile	8m 12s		the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05
+1 💚	javac	8m 12s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
-1 ❌	mvnsite	0m 25s	/patch-mvnsite-hadoop-mapreduce-project.txt	hadoop-mapreduce-project in the patch failed.
-1 ❌	mvnsite	0m 39s	/patch-mvnsite-hadoop-yarn-project.txt	hadoop-yarn-project in the patch failed.
-1 ❌	javadoc	0m 25s	/patch-javadoc-hadoop-mapreduce-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	hadoop-mapreduce-project in the patch failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.
-1 ❌	javadoc	0m 37s	/patch-javadoc-hadoop-yarn-project-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt	hadoop-yarn-project in the patch failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.
-1 ❌	javadoc	0m 25s	/patch-javadoc-hadoop-mapreduce-project-jdkPrivateBuild-1.8.0_422-8u422-b05-1~20.04-b05.txt	hadoop-mapreduce-project in the patch failed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05.
-1 ❌	javadoc	0m 37s	/patch-javadoc-hadoop-yarn-project-jdkPrivateBuild-1.8.0_422-8u422-b05-1~20.04-b05.txt	hadoop-yarn-project in the patch failed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05.
+1 💚	shadedclient	24m 59s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	0m 26s	/patch-unit-hadoop-mapreduce-project.txt	hadoop-mapreduce-project in the patch failed.
-1 ❌	unit	2m 25s	/patch-unit-hadoop-yarn-project.txt	hadoop-yarn-project in the patch failed.
+1 💚	asflicense	0m 38s		The patch does not generate ASF License warnings.
		105m 19s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7027/5/artifact/out/Dockerfile
GITHUB PR	#7027
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint
uname	Linux 29417fd944d3 5.15.0-117-generic #127-Ubuntu SMP Fri Jul 5 20:13:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.4 / 54da8b1
Default Java	Private Build-1.8.0_422-8u422-b05-1~20.04-b05
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~20.04-b05
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7027/5/testReport/
Max. process+thread count	647 (vs. ulimit of 5500)
modules	C: hadoop-mapreduce-project hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7027/5/console
versions	git=2.25.1 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.