HADOOP-17669. Backport HADOOP-17079, HADOOP-17505 to branch-3.3

[jojochuang]

HADOOP-17079 in branch-3.3 has a number of trivial conflicts.
HADOOP-17505 is a clean cherrypick.

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	21m 27s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 15 new or modified test files.
			_ branch-3.3 Compile Tests _
+0 🆗	mvndep	15m 31s		Maven dependency ordering for branch
+1 💚	mvninstall	20m 46s		branch-3.3 passed
+1 💚	compile	17m 13s		branch-3.3 passed
+1 💚	checkstyle	2m 52s		branch-3.3 passed
+1 💚	mvnsite	7m 42s		branch-3.3 passed
+1 💚	javadoc	7m 24s		branch-3.3 passed
+1 💚	spotbugs	12m 27s		branch-3.3 passed
+1 💚	shadedclient	16m 11s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 27s		Maven dependency ordering for patch
+1 💚	mvninstall	5m 0s		the patch passed
+1 💚	compile	16m 44s		the patch passed
-1 ❌	javac	16m 44s	/results-compile-javac-root.txt	root generated 84 new + 1898 unchanged - 3 fixed = 1982 total (was 1901)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	2m 45s		root: The patch generated 0 new + 904 unchanged - 7 fixed = 904 total (was 911)
+1 💚	mvnsite	7m 38s		the patch passed
+1 💚	javadoc	7m 22s		the patch passed
+1 💚	spotbugs	13m 51s		the patch passed
+1 💚	shadedclient	16m 24s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	17m 13s		hadoop-common in the patch passed.
-1 ❌	unit	188m 37s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt	hadoop-hdfs in the patch passed.
+1 💚	unit	5m 44s		hadoop-hdfs-httpfs in the patch passed.
-1 ❌	unit	15m 18s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt	hadoop-hdfs-rbf in the patch passed.
+1 💚	unit	23m 44s		hadoop-yarn-server-nodemanager in the patch passed.
-1 ❌	unit	88m 10s	/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt	hadoop-yarn-server-resourcemanager in the patch passed.
+1 💚	unit	4m 26s		hadoop-mapreduce-client-hs in the patch passed.
+1 💚	asflicense	1m 6s		The patch does not generate ASF License warnings.
		540m 0s

Reason	Tests
Failed junit tests	hadoop.hdfs.TestReconstructStripedFile
	hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
	hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys
	hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy
	hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
	hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
	hadoop.hdfs.TestReconstructStripedFileWithValidator
	hadoop.hdfs.server.federation.router.TestRouterRpcMultiDestination
	hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption
	hadoop.yarn.server.resourcemanager.TestRMHATimelineCollectors

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2959/1/artifact/out/Dockerfile
GITHUB PR	#2959
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname	Linux 26e0ce48c23a 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.3 / c65022c
Default Java	Private Build-1.8.0_282-8u282-b08-0ubuntu1~18.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2959/1/testReport/
Max. process+thread count	3225 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-hdfs-project/hadoop-hdfs-rbf hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2959/1/console
versions	git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 46s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 15 new or modified test files.
			_ branch-3.3 Compile Tests _
+0 🆗	mvndep	11m 51s		Maven dependency ordering for branch
+1 💚	mvninstall	20m 41s		branch-3.3 passed
+1 💚	compile	17m 23s		branch-3.3 passed
+1 💚	checkstyle	2m 44s		branch-3.3 passed
+1 💚	mvnsite	7m 48s		branch-3.3 passed
+1 💚	javadoc	7m 24s		branch-3.3 passed
+1 💚	spotbugs	12m 36s		branch-3.3 passed
+1 💚	shadedclient	16m 22s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 28s		Maven dependency ordering for patch
+1 💚	mvninstall	5m 9s		the patch passed
+1 💚	compile	16m 37s		the patch passed
-1 ❌	javac	16m 37s	/results-compile-javac-root.txt	root generated 84 new + 1952 unchanged - 3 fixed = 2036 total (was 1955)
+1 💚	blanks	0m 1s		The patch has no blanks issues.
+1 💚	checkstyle	2m 43s		root: The patch generated 0 new + 904 unchanged - 7 fixed = 904 total (was 911)
+1 💚	mvnsite	7m 45s		the patch passed
+1 💚	javadoc	7m 29s		the patch passed
+1 💚	spotbugs	13m 53s		the patch passed
+1 💚	shadedclient	16m 26s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	16m 54s		hadoop-common in the patch passed.
-1 ❌	unit	188m 38s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt	hadoop-hdfs in the patch passed.
+1 💚	unit	6m 2s		hadoop-hdfs-httpfs in the patch passed.
+1 💚	unit	15m 52s		hadoop-hdfs-rbf in the patch passed.
+1 💚	unit	23m 17s		hadoop-yarn-server-nodemanager in the patch passed.
-1 ❌	unit	90m 31s	/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt	hadoop-yarn-server-resourcemanager in the patch passed.
+1 💚	unit	4m 29s		hadoop-mapreduce-client-hs in the patch passed.
+1 💚	asflicense	1m 3s		The patch does not generate ASF License warnings.
		518m 37s

Reason	Tests
Failed junit tests	hadoop.hdfs.server.datanode.TestBPOfferService
	hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics
	hadoop.hdfs.TestStripedFileAppend
	hadoop.hdfs.TestDFSInotifyEventInputStreamKerberized
	hadoop.yarn.server.resourcemanager.placement.TestUserGroupMappingPlacementRule
	hadoop.yarn.server.resourcemanager.TestRMHATimelineCollectors

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2959/2/artifact/out/Dockerfile
GITHUB PR	#2959
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname	Linux 835870b24c46 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	branch-3.3 / c65022c
Default Java	Private Build-1.8.0_292-8u292-b10-0ubuntu1~18.04-b10
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2959/2/testReport/
Max. process+thread count	3422 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-hdfs-project/hadoop-hdfs-rbf hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2959/2/console
versions	git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

[jojochuang]

All failed tests do not repro. I'll merge this PR.