HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image #7932

pan3793 · 2025-09-05T10:28:41Z

Description of PR

Fix the issue that kill command is not found

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
[ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.950 s <<< FAILURE! -- in org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
[ERROR] org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree.testProcessTree -- Time elapsed: 7.534 s <<< ERROR!
java.io.IOException: Cannot run program "kill": error=2, No such file or directory
	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1128)
	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1071)
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:1000)
	at org.apache.hadoop.util.Shell.run(Shell.java:959)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1284)
	at org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree.sendSignal(TestProcfsBasedProcessTree.java:857)
	at org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree.destroyProcessTree(TestProcfsBasedProcessTree.java:257)
	at org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree.testProcessTree(TestProcfsBasedProcessTree.java:196)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
Caused by: java.io.IOException: error=2, No such file or directory
	at java.base/java.lang.ProcessImpl.forkAndExec(Native Method)
	at java.base/java.lang.ProcessImpl.<init>(ProcessImpl.java:340)
	at java.base/java.lang.ProcessImpl.start(ProcessImpl.java:271)
	at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1107)
	... 10 more

How was this patch tested?

./start-build-env.sh debian_11

$ mvn clean install -DskipShade -DskipTests -Pnative
$ mvn -pl :hadoop-yarn-common test -Dtest=hadoop.yarn.util.TestProcfsBasedProcessTree
...
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.064 s -- in org.apache.hadoop.yarn.util.TestProcfsBasedProcessTree
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  24.306 s
[INFO] Finished at: 2025-09-05T10:14:12Z
[INFO] ------------------------------------------------------------------------

For code changes:

Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

hadoop-yetus · 2025-09-05T10:34:15Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 0s		Docker mode activated.
-1 ❌	docker	3m 0s		Docker failed to build run-specific yetus/hadoop:tp-500}.

Subsystem	Report/Notes
GITHUB PR	#7932
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/1/console
versions	git=2.34.1
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-05T11:37:38Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 0s		Docker mode activated.
-1 ❌	docker	2m 35s		Docker failed to build run-specific yetus/hadoop:tp-8139}.

Subsystem	Report/Notes
GITHUB PR	#7932
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/2/console
versions	git=2.34.1
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-05T12:04:00Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 0s		Docker mode activated.
-1 ❌	docker	2m 35s		Docker failed to build run-specific yetus/hadoop:tp-26905}.

Subsystem	Report/Notes
GITHUB PR	#7932
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/3/console
versions	git=2.34.1
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-06T15:43:10Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 0s		Docker mode activated.
-1 ❌	docker	2m 40s		Docker failed to build run-specific yetus/hadoop:tp-22814}.

Subsystem	Report/Notes
GITHUB PR	#7932
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/4/console
versions	git=2.34.1
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

… image

slfan1989 · 2025-09-12T06:15:30Z

@pan3793 Thanks for the contribution! LGTM. I plan to merge this PR shortly.

hadoop-yetus · 2025-09-12T08:09:43Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	30m 3s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	jsonlint	0m 0s		jsonlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ trunk Compile Tests _
+0 🆗	mvndep	8m 16s		Maven dependency ordering for branch
+1 💚	shadedclient	50m 57s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 45s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shadedclient	41m 9s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	asflicense	0m 58s		The patch does not generate ASF License warnings.
		125m 49s

Subsystem	Report/Notes
Docker	ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/5/artifact/out/Dockerfile
GITHUB PR	#7932
Optional Tests	dupname asflicense codespell detsecrets jsonlint
uname	Linux 43d6fc34e5bc 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `df78520`
Max. process+thread count	529 (vs. ulimit of 5500)
modules	C: U:
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/5/console
versions	git=2.43.7 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-12T09:41:12Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	27m 0s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	jsonlint	0m 0s		jsonlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ trunk Compile Tests _
+0 🆗	mvndep	0m 26s		Maven dependency ordering for branch
+1 💚	shadedclient	30m 36s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 22s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shadedclient	31m 5s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	asflicense	0m 33s		The patch does not generate ASF License warnings.
		91m 20s

Subsystem	Report/Notes
Docker	ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/5/artifact/out/Dockerfile
GITHUB PR	#7932
Optional Tests	dupname asflicense codespell detsecrets jsonlint
uname	Linux 74aa9d50bdcb 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `df78520`
modules	C: U:
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/5/console
versions	git=2.30.2 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-12T11:06:06Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 50s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	jsonlint	0m 0s		jsonlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ trunk Compile Tests _
+0 🆗	mvndep	0m 32s		Maven dependency ordering for branch
+1 💚	shadedclient	40m 46s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 32s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shadedclient	40m 23s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		84m 46s

Subsystem	Report/Notes
Docker	ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/5/artifact/out/Dockerfile
GITHUB PR	#7932
Optional Tests	dupname asflicense codespell detsecrets jsonlint
uname	Linux a725f8615e43 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `df78520`
Max. process+thread count	530 (vs. ulimit of 5500)
modules	C: U:
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7932/5/console
versions	git=2.25.1 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

slfan1989 · 2025-09-14T07:13:34Z

@pan3793 Thanks for the contribution!

… image (apache#7932) Contributed by Cheng Pan. * HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image. Signed-off-by: Shilun Fan <[email protected]>

…ch (#8105) * HADOOP-19495. Add JDK 24 to Ubuntu 20.04 docker development images. * HADOOP-19540. [JDK17] Add ubuntu:noble as a build platform with JDK-17 as default (#7608) 1. Added "ubuntu:noble" to supported docker platforms. 2. Modified `start-build-env.sh` to use expected Dockerfiles dynamically. ex: `bash start-build-env.sh ubuntu_24` where `ubuntu_24` is the extra suffix in the name of the Dockerfile. 3. Added `jdk17++` profile activated when jdk17 is available. Successfully built the entire Hadoop tar with native support on env created using `bash start-build-env.sh ubuntu_24` * HADOOP-19570. Upgrade libxxhash to 0.8.3 in Windows 10 (#7689) * The current version of libxxhash - 0.8.1 isn't available on the msys repo. * This is causing the Hadoop Jenkins CI for Windows to fail while building the docker image for Windows 10. * This PR upgrades libxxhash to 0.8.3 to fix this issue. * HADOOP-19636. [JDK17] Remove CentOS 7 Support and Clean Up Dockerfile. (#7822) * HADOOP-19636. [JDK17] Remove CentOS 7 Support and Clean Up Dockerfile. Co-authored-by: Cheng Pan <[email protected]> Co-authored-by: Istvan Toth <[email protected]> Reviewed-by: Xiaoqiao He <[email protected]> Reviewed-by: Steve Loughran <[email protected]> Reviewed-by: Chris Nauroth <[email protected]> Reviewed-by: Cheng Pan <[email protected]> Reviewed-by: Istvan Toth <[email protected]> Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19661. Migrate CentOS 8 to Rocky Linux 8 in build env Dockerfile Closes #7900 Signed-off-by: Shilun Fan <[email protected]> Signed-off-by: Chris Nauroth <[email protected]> * HADOOP-19661. (Follow-up) Rename Dockerfile_centos_8 to Dockerfile_rockylinux_8 (#7917) HADOOP-19661. (Follow-up) Rename Dockerfile_centos_8 to Dockerfile_rockylinux_8. Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile (#7898) Contributed by Cheng Pan. * HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image (#7931) Contributed by Cheng Pan. * HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image Reviewed-by: Shilun Fan <[email protected]> Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image (#7932) Contributed by Cheng Pan. * HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image. Signed-off-by: Shilun Fan <[email protected]> --------- Signed-off-by: Shilun Fan <[email protected]> Signed-off-by: Chris Nauroth <[email protected]> Co-authored-by: Istvan Toth <[email protected]> Co-authored-by: Vinayakumar B <[email protected]> Co-authored-by: Gautham B A <[email protected]> Co-authored-by: Cheng Pan <[email protected]>

… image (#7932) Contributed by Cheng Pan. * HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image. Signed-off-by: Shilun Fan <[email protected]>

github-actions bot added trunk Infra labels Sep 5, 2025

slfan1989 approved these changes Sep 11, 2025

View reviewed changes

HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker…

df78520

… image

pan3793 force-pushed the HADOOP-19659-followup branch from b2a65b2 to df78520 Compare September 12, 2025 06:02

slfan1989 merged commit 23121f9 into apache:trunk Sep 14, 2025
4 checks passed

slfan1989 mentioned this pull request Nov 24, 2025

HADOOP-19605. (3.4) Upgrade Protobuf 3.25.5 for docker images (#7780) #8078

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image #7932

HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image #7932

pan3793 commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 6, 2025

Uh oh!

slfan1989 commented Sep 12, 2025

Uh oh!

hadoop-yetus commented Sep 12, 2025

Uh oh!

hadoop-yetus commented Sep 12, 2025

Uh oh!

hadoop-yetus commented Sep 12, 2025

Uh oh!

Uh oh!

slfan1989 commented Sep 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image #7932

HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image #7932

Conversation

pan3793 commented Sep 5, 2025

Description of PR

How was this patch tested?

For code changes:

Uh oh!

hadoop-yetus commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 5, 2025

Uh oh!

hadoop-yetus commented Sep 6, 2025

Uh oh!

slfan1989 commented Sep 12, 2025

Uh oh!

hadoop-yetus commented Sep 12, 2025

Uh oh!

hadoop-yetus commented Sep 12, 2025

Uh oh!

hadoop-yetus commented Sep 12, 2025

Uh oh!

Uh oh!

slfan1989 commented Sep 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants