HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image #7931

pan3793 · 2025-09-04T12:29:50Z

Description of PR

The issue is identified by https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7760/

00:08:13                Reason | Tests
00:08:13   Failed junit tests  |  hadoop.fs.compat.common.TestHdfsCompatShellCommand 
00:08:13                       |  hadoop.fs.compat.common.TestHdfsCompatDefaultSuites 
00:08:13                       |  hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints

How was this patch tested?

Manually checked the failed tests after installing the missing deps inside the dev container.

$ ./start-build-env.sh rockylinux_8

$ mvn clean install -DskipTests -Pnative

$ mvn test -pl :hadoop-compat-bench -Dtest=hadoop.fs.compat.common.TestHdfsCompatShellCommand
...
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.compat.common.TestHdfsCompatShellCommand
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.64 s -- in org.apache.hadoop.fs.compat.common.TestHdfsCompatShellCommand
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  21.200 s
[INFO] Finished at: 2025-09-04T12:16:55Z
[INFO] ------------------------------------------------------------------------

$ mvn test -pl :hadoop-compat-bench -Dtest=hadoop.fs.compat.common.TestHdfsCompatDefaultSuites
...
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.compat.common.TestHdfsCompatDefaultSuites
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 126.2 s -- in org.apache.hadoop.fs.compat.common.TestHdfsCompatDefaultSuites
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:14 min
[INFO] Finished at: 2025-09-04T12:27:35Z
[INFO] ------------------------------------------------------------------------

$ mvn test -pl :hadoop-hdfs -Dtest=hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
...
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 229.4 s -- in org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO]
[INFO] --- antrun:1.7:run (hdfs-test-bats-driver) @ hadoop-hdfs ---
[INFO] Executing tasks

main:
     [exec] Running bats -t hadoop_shell_execname.bats
     [exec] 1..1
     [exec] ok 1 hadoop_shell_execname
     [exec] Running bats -t hdfs_subcommands.bats
     [exec] 1..4
     [exec] ok 1 hdfs_subcommand (addition)
     [exec] ok 2 hdfs_subcommand (substitute)
     [exec] ok 3 hdfs_subcommand (envcheck)
     [exec] ok 4 hdfs_subcommand (multiparams)
[INFO] Executed tasks
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  04:25 min
[INFO] Finished at: 2025-09-04T12:41:57Z
[INFO] ------------------------------------------------------------------------

For code changes:

Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

…er image

hadoop-yetus · 2025-09-04T14:17:18Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	24m 9s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	jsonlint	0m 0s		jsonlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ trunk Compile Tests _
+0 🆗	mvndep	8m 52s		Maven dependency ordering for branch
+1 💚	shadedclient	44m 17s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 46s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shadedclient	34m 16s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	asflicense	0m 58s		The patch does not generate ASF License warnings.
		106m 24s

Subsystem	Report/Notes
Docker	ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7931/1/artifact/out/Dockerfile
GITHUB PR	#7931
Optional Tests	dupname asflicense codespell detsecrets jsonlint
uname	Linux e8aea56e1b0c 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `2ba5889`
Max. process+thread count	554 (vs. ulimit of 5500)
modules	C: U:
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7931/1/console
versions	git=2.43.7 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-04T15:36:35Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	23m 55s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	jsonlint	0m 0s		jsonlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ trunk Compile Tests _
+0 🆗	mvndep	0m 24s		Maven dependency ordering for branch
+1 💚	shadedclient	26m 23s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 22s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shadedclient	25m 16s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	asflicense	0m 33s		The patch does not generate ASF License warnings.
		79m 7s

Subsystem	Report/Notes
Docker	ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7931/1/artifact/out/Dockerfile
GITHUB PR	#7931
Optional Tests	dupname asflicense codespell detsecrets jsonlint
uname	Linux 912e624ed05f 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `2ba5889`
modules	C: U:
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7931/1/console
versions	git=2.30.2 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2025-09-04T16:48:59Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 35s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	jsonlint	0m 0s		jsonlint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ trunk Compile Tests _
+0 🆗	mvndep	0m 33s		Maven dependency ordering for branch
+1 💚	shadedclient	34m 45s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 33s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shadedclient	34m 5s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	asflicense	0m 35s		The patch does not generate ASF License warnings.
		72m 16s

Subsystem	Report/Notes
Docker	ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7931/1/artifact/out/Dockerfile
GITHUB PR	#7931
Optional Tests	dupname asflicense codespell detsecrets jsonlint
uname	Linux 53ab742d41d0 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `2ba5889`
Max. process+thread count	561 (vs. ulimit of 5500)
modules	C: U:
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7931/1/console
versions	git=2.25.1 maven=3.6.3
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

slfan1989 · 2025-09-05T06:54:53Z

@pan3793 Thanks for the contribution! Merged into trunk.

…er image (apache#7931) Contributed by Cheng Pan. * HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image Reviewed-by: Shilun Fan <[email protected]> Signed-off-by: Shilun Fan <[email protected]>

…ch (#8105) * HADOOP-19495. Add JDK 24 to Ubuntu 20.04 docker development images. * HADOOP-19540. [JDK17] Add ubuntu:noble as a build platform with JDK-17 as default (#7608) 1. Added "ubuntu:noble" to supported docker platforms. 2. Modified `start-build-env.sh` to use expected Dockerfiles dynamically. ex: `bash start-build-env.sh ubuntu_24` where `ubuntu_24` is the extra suffix in the name of the Dockerfile. 3. Added `jdk17++` profile activated when jdk17 is available. Successfully built the entire Hadoop tar with native support on env created using `bash start-build-env.sh ubuntu_24` * HADOOP-19570. Upgrade libxxhash to 0.8.3 in Windows 10 (#7689) * The current version of libxxhash - 0.8.1 isn't available on the msys repo. * This is causing the Hadoop Jenkins CI for Windows to fail while building the docker image for Windows 10. * This PR upgrades libxxhash to 0.8.3 to fix this issue. * HADOOP-19636. [JDK17] Remove CentOS 7 Support and Clean Up Dockerfile. (#7822) * HADOOP-19636. [JDK17] Remove CentOS 7 Support and Clean Up Dockerfile. Co-authored-by: Cheng Pan <[email protected]> Co-authored-by: Istvan Toth <[email protected]> Reviewed-by: Xiaoqiao He <[email protected]> Reviewed-by: Steve Loughran <[email protected]> Reviewed-by: Chris Nauroth <[email protected]> Reviewed-by: Cheng Pan <[email protected]> Reviewed-by: Istvan Toth <[email protected]> Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19661. Migrate CentOS 8 to Rocky Linux 8 in build env Dockerfile Closes #7900 Signed-off-by: Shilun Fan <[email protected]> Signed-off-by: Chris Nauroth <[email protected]> * HADOOP-19661. (Follow-up) Rename Dockerfile_centos_8 to Dockerfile_rockylinux_8 (#7917) HADOOP-19661. (Follow-up) Rename Dockerfile_centos_8 to Dockerfile_rockylinux_8. Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile (#7898) Contributed by Cheng Pan. * HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image (#7931) Contributed by Cheng Pan. * HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image Reviewed-by: Shilun Fan <[email protected]> Signed-off-by: Shilun Fan <[email protected]> * HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image (#7932) Contributed by Cheng Pan. * HADOOP-19659. (Follow-up) Install missing procps for Debian 11 docker image. Signed-off-by: Shilun Fan <[email protected]> --------- Signed-off-by: Shilun Fan <[email protected]> Signed-off-by: Chris Nauroth <[email protected]> Co-authored-by: Istvan Toth <[email protected]> Co-authored-by: Vinayakumar B <[email protected]> Co-authored-by: Gautham B A <[email protected]> Co-authored-by: Cheng Pan <[email protected]>

…er image (#7931) Contributed by Cheng Pan. * HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image Reviewed-by: Shilun Fan <[email protected]> Signed-off-by: Shilun Fan <[email protected]>

HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 dock…

2ba5889

…er image

github-actions bot added trunk Infra labels Sep 4, 2025

slfan1989 approved these changes Sep 4, 2025

View reviewed changes

slfan1989 merged commit 6ed6d95 into apache:trunk Sep 5, 2025
4 checks passed

slfan1989 mentioned this pull request Nov 24, 2025

HADOOP-19605. (3.4) Upgrade Protobuf 3.25.5 for docker images (#7780) #8078

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image #7931

HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image #7931

Uh oh!

pan3793 commented Sep 4, 2025 •

edited

Loading

Uh oh!

hadoop-yetus commented Sep 4, 2025

Uh oh!

hadoop-yetus commented Sep 4, 2025

Uh oh!

hadoop-yetus commented Sep 4, 2025

Uh oh!

Uh oh!

slfan1989 commented Sep 5, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image #7931

HADOOP-19661. (Follow-up) Install missing deps for Rocky Linux 8 docker image #7931

Uh oh!

Conversation

pan3793 commented Sep 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description of PR

How was this patch tested?

For code changes:

Uh oh!

hadoop-yetus commented Sep 4, 2025

Uh oh!

hadoop-yetus commented Sep 4, 2025

Uh oh!

hadoop-yetus commented Sep 4, 2025

Uh oh!

Uh oh!

slfan1989 commented Sep 5, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

pan3793 commented Sep 4, 2025 •

edited

Loading