Skip to content

Conversation

@haiyang1987
Copy link
Contributor

Description of PR

Consider that make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable and rapid rollback in case this feature HDFS-16076 unexpected things happen in production environment

Details: HDFS-16314

huhaiyang added 2 commits November 12, 2021 16:49
@haiyang1987
Copy link
Contributor Author

@tomscut Thank you for your reply. sorry, the previous PR exception was closed and created a new PR.
As you suggested fixed and updated PR.

@hadoop-yetus

This comment has been minimized.

@hadoop-yetus

This comment has been minimized.

@haiyang1987
Copy link
Contributor Author

Hi @tomscut Is there anything else that needs to be improved in the current code?
Thanks.

@haiyang1987
Copy link
Contributor Author

@ferhui @tomscut Could you please take a look? Thanks.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 4s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 34m 49s trunk passed
+1 💚 compile 1m 27s trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 compile 1m 18s trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 checkstyle 0m 59s trunk passed
+1 💚 mvnsite 1m 28s trunk passed
+1 💚 javadoc 1m 1s trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 29s trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 spotbugs 3m 22s trunk passed
+1 💚 shadedclient 25m 29s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 17s the patch passed
+1 💚 compile 1m 21s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javac 1m 21s the patch passed
+1 💚 compile 1m 13s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 javac 1m 13s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 52s the patch passed
+1 💚 mvnsite 1m 18s the patch passed
+1 💚 javadoc 0m 52s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 22s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 spotbugs 3m 27s the patch passed
+1 💚 shadedclient 25m 5s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 332m 34s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 43s The patch does not generate ASF License warnings.
439m 38s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3664/3/artifact/out/Dockerfile
GITHUB PR #3664
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname Linux d197564af722 4.15.0-153-generic #160-Ubuntu SMP Thu Jul 29 06:54:29 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 3b1de16
Default Java Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3664/3/testReport/
Max. process+thread count 2050 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3664/3/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

Copy link
Contributor

@tomscut tomscut left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Comment on lines +273 to +275
public abstract void setExcludeSlowNodesEnabled(boolean enable);

public abstract boolean getExcludeSlowNodesEnabled();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This interface is marked as @Private, so adding abstract methods is okay.

@aajisaka aajisaka merged commit c0f405a into apache:trunk Dec 3, 2021
@aajisaka
Copy link
Member

aajisaka commented Dec 3, 2021

Merged. Thank you @haiyang1987 for your contribution and thank you @ferhui @tomscut for your review.

aajisaka pushed a commit that referenced this pull request Dec 3, 2021
…de-slow-nodes.enabled reconfigurable (#3664)

Reviewed-by: Fei Hui <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
(cherry picked from commit c0f405a)
sunchao pushed a commit that referenced this pull request Jan 4, 2022
…de-slow-nodes.enabled reconfigurable (#3664)

Reviewed-by: Fei Hui <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
(cherry picked from commit c0f405a)
HarshitGupta11 pushed a commit to HarshitGupta11/hadoop that referenced this pull request Nov 28, 2022
…de-slow-nodes.enabled reconfigurable (apache#3664)

Reviewed-by: Fei Hui <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants