Skip to content

sync #8

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
GuoPhilipse merged 46 commits into from
Dec 7, 2021
Merged

sync #8

GuoPhilipse merged 46 commits into from
Dec 7, 2021

Conversation

@GuoPhilipse
Copy link
Owner

@GuoPhilipse GuoPhilipse commented Dec 7, 2021

sync

GuoPhilipse and others added 30 commits November 22, 2021 07:41
@GuoPhilipse
HDFS-16334. Correct NameNode ACL description (#3678)
3d1ca6f 
Signed-off-by: Akira Ajisaka <[email protected]>
@ferhui
Revert "HADOOP-17995. Stale record should be remove when DataNodePeer…
8e9ad2d 
…Metrics#dumpSendPacketDownstreamAvgInfoAsJson (#3630)" (#3697)
@tomscut
HDFS-16335. Fix HDFSCommands.md (#3681)
20b78c8
@symious
HDFS-16320. Datanode retrieve slownode information from NameNode (#3654)
c88640c
@smarthanwang
HADOOP-17998. Allow get command to run with multi threads. (#3645)
63018dc
@tomscut
HDFS-16337. Show start time of Datanode on Web (#3682)
0ed817b 
Reviewed-by: Inigo Goiri <[email protected]>
@virajjasani
HADOOP-18018. unguava: remove Preconditions from hadoop-tools modules (…
c7ec189 
…#3688)
@virajjasani
HADOOP-18017. unguava: remove Preconditions from hadoop-yarn-project …
c0bdba8 
…modules (#3687)
@mukul1987
HDFS-16343. Add some debug logs when the dfsUsed are not used during …
faa4eea 
…Datanode startup. (#3694)
@afchung
YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated…
5b1b2c8 
… resources (#3646)
@afchung
YARN-10760. Number of allocated OPPORTUNISTIC containers can dip belo…
d3f0b7e 
…w 0 (#3642)
@mehakmeet
HADOOP-18016. Make certain methods LimitedPrivate in S3AUtils.java (#…
a35f7de 
…3685)


Contributed By: Mehakmeet Singh
@hotcodemacha
YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…
08f3df3 
…ResourcesString method (#3592)

Signed-off-by: Akira Ajisaka <[email protected]>
@fapifta
HADOOP-17975. Fallback to simple auth does not work for a secondary D…
ae3ba45 
…istributedFileSystem instance. (#3579)
@virajjasani
HDFS-16336. De-flake TestRollingUpgrade#testRollback (#3686)
e8566b3 
Signed-off-by: Akira Ajisaka <[email protected]>
@steveloughran
HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses…
98fe0d0 
… to provide etags (#3633)


Contributed by Steve Loughran
@haiyang1987
HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#…
99b161d 
…dumpSendPacketDownstreamAvgInfoAsJson (#3708)
@virajjasani
HDFS-16350. Datanode start time should be set after RPC server starts…
cdc13e9 
… successfully (#3711)
@tasanuma
HADOOP-18014. CallerContext should not include some characters. (#3698)
9c887e5 
Reviewed-by: Viraj Jasani <[email protected]>
Reviewed-by: Mingliang Liu <[email protected]>
Reviewed-by: Hui Fei <[email protected]>
@GuoPhilipse
YARN-11007. Correct words in YARN documents (#3680)
c9d64ba 
Reviewed-by: cxorm <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
@tomscut
HDFS-16339. Show the threshold when mover threads quota is exceeded (#…
86705ed 
…3689)

Reviewed-by: Viraj Jasani <[email protected]>
Reviewed-by: Hui Fei <[email protected]>
@virajjasani
HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditi…
215388b 
…ons and remove remaining usages (#3712)

Reviewed-by: Akira Ajisaka <[email protected]>
Signed-off-by: Takanobu Asanuma <[email protected]>
@tomscut
HDFS-16344. Improve DirectoryScanner.Stats#toString (#3695)
829af89 
Reviewed-by: Viraj Jasani <[email protected]>
Reviewed-by: Ayush Saxena <[email protected]>
Reviewed-by: Hui Fei <[email protected]>
@smarthanwang
HADOOP-18023. Allow cp command to run with multi threads. (#3721)
932a78f
@GuoPhilipse
HADOOP-18026. Fix default value of Magic committer (#3723)
c65c87f 
Contributed by guophilipse
@Sushmasree-28
YARN-10975 EntityGroupFSTimelineStore#ActiveLogParser parses already …
7b840f2 
…processed files (#3735)

Contributed by  sravuri <[email protected]> and reviewed by Prabhu Joseph
@tomscut
HDFS-16361. Fix log format for QueryCommand (#3732). Contributed by t…
1ebdac2 
…omscut.
@virajjasani
HADOOP-18027. Include static imports in the maven plugin rules (#3733)
4dea4a7 
Reviewed-by: Steve Loughran <[email protected]>
Signed-off-by: Takanobu Asanuma <[email protected]>
@Desmeister
HADOOP-18029: Update CompressionCodecFactory to handle uppercase file…
df41975 
… extensions (#3739)

Co-authored-by: Desmond Sisson <[email protected]>
@virajjasani
HADOOP-18025. Upgrade HBase version to 1.7.1 for hbase1 profile (#3722)
b34dcb5
tomscut and others added 16 commits December 2, 2021 19:10
@tomscut
HDFS-16359. RBF: RouterRpcServer#invokeAtAvailableNs does not take ef…
196935a 
…fect when retrying (#3731). Contributed by  tomscut.

Reviewed-by: Inigo Goiri <[email protected]>
Signed-off-by: Ayush Saxena <[email protected]>
@virajjasani
HDFS-16358. HttpFS implementation for getSnapshotDiffReportListing (#…
0c62a51 
…3730)
@tomscut
HDFS-16331. Make dfs.blockreport.intervalMsec reconfigurable (#3676)
52ec65f 
Signed-off-by: Takanobu Asanuma <[email protected]>
@wzhallright
HDFS-16364. Remove unnecessary brackets in NameNodeRpcServer#L453 (#3742
0cb6c28 
)
@bitterfox
HDFS-16332. Handle invalid token exception in sasl handshake (#3677)
dd6b987 
Signed-off-by: Akira Ajisaka <[email protected]>
@9uapaw
HADOOP-18021. Provide a public wrapper of Configuration#substituteVars (
47ea0d7 
#3710)


Contributed by Andras Gyori
@haiyang1987
HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclu…
c0f405a 
…de-slow-nodes.enabled reconfigurable (#3664)

Reviewed-by: Fei Hui <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
@ayushtkn
HDFS-16369. RBF: Fix the retry logic of RouterRpcServer#invokeAtAvail…
cab7086 
…ableNs. (#3745). Contributed by Ayush Saxena.

Reviewed-by: litao <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
@GuoPhilipse
HDFS-16357. Fix log format in DFSUtilClient (#3729). Contributed by g…
2f55a6c 
…uophilipse.

Signed-off-by: Ayush Saxena <[email protected]>
@tomscut
HDFS-16370. Fix assert message for BlockInfo (#3747). Contributed by …
c2afb6a 
…tomscut.

Signed-off-by: Ayush Saxena <[email protected]>
@tasanuma
HDFS-16293. Client sleeps and holds 'dataQueue' when DataNodes are co…
e8e69de 
…ngested. Contributed by Yuanxin Zhu.
@GuoPhilipse
HDFS-16338. Correct fsimage error configuration message (#3684). Cont…
1509ea5 
…ributed by guophilipse.

Reviewed-by: cxorm <[email protected]>
Reviewed-by: tomscut <[email protected]>
Signed-off-by: Ayush Saxena <[email protected]>
@hotcodemacha
YARN-9063. ATS 1.5 fails to start if RollingLevelDb files are corrupt…
5a950b8 
… or missing (#3728)

Signed-off-by: Akira Ajisaka <[email protected]>
@szilard-nemeth
YARN-11014. YARN incorrectly validates maximum capacity resources on …
d75f2db 
…the validation API. Contributed by Benjamin Teke
@szilard-nemeth
YARN-11020. [UI2] No container is found for an application attempt wi…
7a8c2e0 
…th a single AM container. Contributed by Andras Gyori
@GuoPhilipse
HDFS-16351. Add path exception information in FSNamesystem (#3713). C…
80cccc5 
…ontributed by guophilipse.

Reviewed-by: Viraj Jasani <[email protected]>
Signed-off-by: Ayush Saxena <[email protected]>
@GuoPhilipse GuoPhilipse merged commit 9375f21 into GuoPhilipse:trunk Dec 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.