Skip to content

sync #17

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
GuoPhilipse merged 202 commits into from
Sep 17, 2022
Merged

sync #17

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
202 commits
Select commit Hold shift + click to select a range
ea46f49
HDFS-16638. Add isDebugEnabled check for debug blockLogs in BlockMana…
cxzl25 Jul 3, 2022
161b1fa
YARN-11169. Support moveApplicationAcrossQueues, getQueueInfo API's f…
slfan1989 Jul 5, 2022
a432925
HADOOP-18321.Fix when to read an additional record from a BZip2 text …
hotcodemacha Jul 6, 2022
3ec4b93
HADOOP-18313: AliyunOSSBlockOutputStream should not mark the temporar…
wujinhu Jul 6, 2022
8e39e35
HDFS-16466. Implement Linux permission flags on Windows (#4526)
GauthamBanasandra Jul 8, 2022
96f8e5b
HADOOP-15789. DistCp does not clean staging folder if class extends D…
ayushtkn Jul 8, 2022
fac8958
MAPREDUCE-7388. Remove unused variable _eof in GzipCodec.cc (#4429)
cfg1234 Jul 8, 2022
9b1d357
Revert "MAPREDUCE-7388. Remove unused variable _eof in GzipCodec.cc (…
aajisaka Jul 8, 2022
e11ba59
HADOOP-18074 - Partial/Incomplete groups list can be returned in LDAP…
lmccay Jul 11, 2022
4e8c0b9
MAPREDUCE-7201.Make Job History File Permissions configurable (#4507)
hotcodemacha Jul 11, 2022
0ca4868
HADOOP-18294. Ensure build folder exists before writing checksum file…
hotcodemacha Jul 12, 2022
4c4a940
HADOOP-18217. ExitUtil synchronized blocks reduced. #4255
HerCath Jul 13, 2022
f1bd4e1
HADOOP-18336.Tag FSDataInputStream.getWrappedStream() @Public/@Stable…
hotcodemacha Jul 13, 2022
6f9c435
HDFS-16283. RBF: reducing the load of renewLease() RPC (#4524). Contr…
ZanderXu Jul 14, 2022
84ce592
YARN-11198. clean up numa resources from statestore (#4546)
Samrat002 Jul 14, 2022
2835174
HDFS-16652. Upgrade jquery datatable version references to v1.10.19 (…
dmmkr Jul 14, 2022
9376b65
HDFS-16566 Erasure Coding: Recovery may causes excess replicas when b…
RuinanGu Jul 15, 2022
8774f17
HADOOP-13144. Enhancing IPC client throughput via multiple connection…
ZanderXu Jul 15, 2022
440f4c2
HDFS-16654. Link OpenSSL lib for CMake deps check (#4538)
GauthamBanasandra Jul 17, 2022
34e548c
HADOOP-18332: remove rs-api dependency as it conflicts with jsr311-ap…
pjfanning Jul 17, 2022
a55ace7
HADOOP-18079. Upgrade Netty to 4.1.77. (#3977)
jojochuang Jul 18, 2022
21b8952
HDFS-16666. Pass CMake args for Windows in pom.xml (#4574)
GauthamBanasandra Jul 19, 2022
4fb799e
HDFS-16464. Create only libhdfspp static libraries for Windows (#4571)
GauthamBanasandra Jul 19, 2022
6415eb0
HDFS-16665. Fix duplicate sources for HDFS test (#4573)
GauthamBanasandra Jul 19, 2022
e664f81
HADOOP-18333.Upgrade jetty version to 9.4.48.v20220622 (#4553)
hotcodemacha Jul 20, 2022
d07256a
HDFS-16667. Use malloc for buffer allocation in uriparser2 (#4576)
GauthamBanasandra Jul 20, 2022
bac2219
HADOOP-18330. S3AFileSystem removes Path when calling createS3Client …
ashutoshpant Jul 21, 2022
f4b635c
YARN-11211. QueueMetrics leaks Configuration objects when validation …
szilard-nemeth Jul 21, 2022
838020c
YARN-11160. Support getResourceProfiles, getResourceProfile API's for…
slfan1989 Jul 21, 2022
08a940d
HDFS-16640. RBF: Show datanode IP list when click DN histogram in Rou…
wzhallright Jul 21, 2022
2f6916a
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. (#4375)
slfan1989 Jul 22, 2022
3cce41a
Make upstream aware of 3.2.4 release.
iwasakims Jul 22, 2022
221eb2d
Make upstream aware of 3.2.4 release.
iwasakims Jul 22, 2022
5c84cb8
YARN-8900. [Router] Federation: routing getContainers REST invocation…
slfan1989 Jul 23, 2022
2c96357
HDFS-15079. RBF: Namenode needs to use the actual client Id and callI…
ZanderXu Jul 23, 2022
63db1a8
YARN-11203. Fix typo in hadoop-yarn-server-router module. (#4510). Co…
slfan1989 Jul 23, 2022
7de9b5e
HDFS-16467. Ensure Protobuf generated headers are included first (#4601)
GauthamBanasandra Jul 23, 2022
8f83d9f
HDFS-16680. Skip libhdfspp Valgrind tests on Windows (#4611)
GauthamBanasandra Jul 23, 2022
2f49eec
HDFS-16655. OIV: print out erasure coding policy name in oiv Delimite…
Neilxzn Jul 25, 2022
edeb995
YARN-11161. Support getAttributesToNodes, getClusterNodeAttributes, g…
slfan1989 Jul 25, 2022
6ba2c53
HDFS-16681. Do not pass GCC flags for MSVC in libhdfspp (#4615)
GauthamBanasandra Jul 25, 2022
9fe9623
MAPREDUCE-7372 MapReduce set permission too late in copyJar method (#…
skysiders Jul 25, 2022
bf8782d
YARN-10883. [Router] Router Audit Log Add Client IP Address. (#4426)
slfan1989 Jul 25, 2022
01a2e0f
HDFS-16533. COMPOSITE_CRC failed between replicated file and striped …
ZanderXu Jul 25, 2022
213ea03
YARN-11210. Fix YARN RMAdminCLI retry logic for non-retryable kerbero…
KevinWikant Jul 26, 2022
4c8cd61
HADOOP-17461. Collect thread-level IOStatistics. (#4352)
mehakmeet Jul 26, 2022
c92ff0b
HADOOP-18372. ILoadTestS3ABulkDeleteThrottling failing. (#4642)
ahmarsuhail Jul 27, 2022
24560f2
HDFS-16660. Improve Code With Lambda in IPCLoggerChannel class (#4561)
ZanderXu Jul 28, 2022
06ac327
HDFS-16619. Fix HttpHeaders.Values And HttpHeaders.Names Deprecated I…
slfan1989 Jul 28, 2022
a5adc27
HDFS-16658. Change logLevel from DEBUG to INFO if logEveryBlock is tr…
ZanderXu Jul 28, 2022
f80fab2
HDFS-16671. RBF: RouterRpcFairnessPolicyController supports configura…
ZanderXu Jul 28, 2022
58ed621
HADOOP-18344. Upgrade AWS SDK to 1.12.262 (#4637)
steveloughran Jul 28, 2022
95a8587
HADOOP-18344. (followup) AWS SDK 1.12.262: update LICENSE-binary
steveloughran Jul 28, 2022
bf570bd
YARN-11063. Support auto queue creation template wildcards for arbitr…
9uapaw Jul 28, 2022
a5b12c8
HADOOP-18227. Add input stream IOStats for vectored IO api in S3A. (#…
mukund-thakur Jul 28, 2022
e994635
YARN-11212. [Federation] Add getNodeToLabels REST APIs for Router. (#…
slfan1989 Jul 28, 2022
2680f17
YARN-11180. Refactor some code of getNewApplication, submitApplicatio…
slfan1989 Jul 29, 2022
13fbfd5
HADOOP-18358. Update commons-math3 from 3.1.1 to 3.6.1. (#4619). Cont…
slfan1989 Aug 1, 2022
123d1aa
HADOOP-18368. Fixes ITestCustomSigner for access point names with '-'…
ahmarsuhail Aug 1, 2022
57da4bb
YARN-11220. [Federation] Add getLabelsToNodes, getClusterNodeLabels, …
slfan1989 Aug 2, 2022
1f0a71a
YARN-8973. [Router] Add missing methods in RMWebProtocol. (#4664)
slfan1989 Aug 2, 2022
69f6fdb
HADOOP-18301. Upgrade commons-io to 2.11.0 (#4455)
hotcodemacha Aug 3, 2022
0f36539
HDFS-16712. Fix incorrect placeholder in DataNode.java (#4672). Contr…
ZanderXu Aug 3, 2022
0fc7dd8
HDFS-16687. RouterFsckServlet replicates code from DfsServlet base cl…
snmvaughan Aug 3, 2022
c5eba32
YARN-6972. Adding RM ClusterId in AppInfo. (#4673)
slfan1989 Aug 3, 2022
6463f86
YARN-11029. Refactor AMRMProxy Service code and Added Some Metrics. (…
slfan1989 Aug 3, 2022
c5ec727
YARN-11230. [Federation] Add getContainer, signalToContainer REST API…
slfan1989 Aug 3, 2022
66dec9d
HADOOP-18355. Update previous index properly while validating overlap…
mukund-thakur Aug 3, 2022
8eebf40
HDFS-16642. Moving the selecting inputstream from journalnode in Edit…
ZanderXu Aug 4, 2022
dbf73e1
HADOOP-18364. All method metrics related to the RPC protocol should b…
zhangshuyan0 Aug 4, 2022
0aa08ef
HADOOP-18363. Fix bug preventing hadoop-metrics2 from emitting metric…
hotcodemacha Aug 4, 2022
6f7c4c7
YARN-11235. Refactor Policy Code and Define getReservationHomeSubclus…
slfan1989 Aug 4, 2022
080e670
HADOOP-17234. Addendum. Add .asf.yaml to allow github and jira integr…
ayushtkn Aug 5, 2022
62dbefd
HADOOP-18305. Release Hadoop 3.3.4: upstream changelog and jdiff files
steveloughran Aug 5, 2022
b5642c5
HADOOP-18366. ITestS3Select.testSelectSeekFullLandsat is timing out. …
ahmarsuhail Aug 5, 2022
bd0f9a4
HADOOP-18390. Fix out of sync import for HADOOP-18321 (#4694)
hotcodemacha Aug 6, 2022
25ccdc7
HDFS-16648. Add isDebugEnabled check for debug blockLogs in some clas…
ZanderXu Aug 6, 2022
52c2d99
YARN-11228. [Federation] Add getAppAttempts, getAppAttempt REST APIs …
slfan1989 Aug 6, 2022
1cda2dc
YARN-10793. Upgrade Junit from 4 to 5 in hadoop-yarn-server-applicati…
hotcodemacha Aug 7, 2022
d8d3325
HADOOP-18387. Fix incorrect placeholder in hadoop-common (#4679). Con…
slfan1989 Aug 7, 2022
06f0f7d
HADOOP-18373. IOStatisticsContext tuning (#4705)
virajjasani Aug 8, 2022
895f7c5
HDFS-16709. Remove redundant cast in FSEditLogOp.class (#4667). Contr…
ZanderXu Aug 8, 2022
977f4b6
MAPREDUCE-7385. impove JobEndNotifier#httpNotification With recommend…
slfan1989 Aug 8, 2022
92abd99
YARN-11237. Fix Bug while disabling proxy failover with Federation (#…
hotcodemacha Aug 8, 2022
ffa9ed9
YARN-6572. Refactoring Router services to use common util classes for…
slfan1989 Aug 9, 2022
133e8aa
YARN-11227. [Federation] Add getAppTimeout, getAppTimeouts, updateApp…
slfan1989 Aug 10, 2022
c0bbdca
HADOOP-18398. Prevent AvroRecord*.class from being included non-test …
eubnara Aug 11, 2022
e9509ac
HADOOP-18340. deleteOnExit does not work with S3AFileSystem (#4608)
huaxiangsun Aug 11, 2022
b28e4c6
HADOOP-18392. Propagate vectored s3a input stream stats to file syste…
mukund-thakur Aug 11, 2022
09cabaa
HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets (#4531)
ZanderXu Aug 11, 2022
6ca2d3f
YARN-6539. Create SecureLogin inside Router. (#4712)
slfan1989 Aug 11, 2022
2005582
HDFS-16702. MiniDFSCluster should report cause of exception in assert…
snmvaughan Aug 11, 2022
59619ad
HDFS-16689. NameNode may crash when transitioning to Active with in-p…
ZanderXu Aug 12, 2022
8c9533a
HADOOP-18397. Shutdown AWSSecurityTokenService when its resources are…
virajjasani Aug 12, 2022
521e65a
HDFS-16723. Replace incorrect SafeModeException with StandbyException…
ZanderXu Aug 12, 2022
e0c8c6e
HDFS-16678. RBF should supports disable getNodeUsage() in RBFMetrics …
ZanderXu Aug 12, 2022
b737869
HADOOP-18383. Codecs with @DoNotPool annotation are not closed causin…
kevins-29 Aug 12, 2022
9f6bbc9
YARN-11148. In federation and security mode, nm recover may fail. (#4…
zhengchenyu Aug 13, 2022
d383cc4
YARN-11236. Implement FederationReservationHomeSubClusterStore With M…
slfan1989 Aug 13, 2022
d0fdb1d
HADOOP-18404. Fix broken link to wiki help page in org.apache.hadoop.…
paulk-asert Aug 14, 2022
ab88e4b
YARN-11223. [Federation] Add getAppPriority, updateApplicationPriori…
slfan1989 Aug 15, 2022
ad83e95
HADOOP-18402. S3A committer NPE in spark job abort (#4735)
steveloughran Aug 15, 2022
eee59a8
Revert "HADOOP-18402. S3A committer NPE in spark job abort (#4735)"
steveloughran Aug 15, 2022
906ae51
HADOOP-18402. S3A committer NPE in spark job abort (#4735)
steveloughran Aug 15, 2022
86cc96c
Revert "HDFS-16689. NameNode may crash when transitioning to Active w…
ferhui Aug 15, 2022
b1d4af2
HDFS-16704. Datanode return empty response instead of NPE for GetVolu…
ZanderXu Aug 15, 2022
eff3b8c
YARN-10885. Make FederationStateStoreFacade#getApplicationHomeSubClus…
slfan1989 Aug 15, 2022
622ca0d
HDFS-16705. RBF supports healthMonitor timeout configurable and cachi…
ZanderXu Aug 15, 2022
d55d76e
HADOOP-18371. S3A FS init to log at debug when fs.s3a.create.storage.…
virajjasani Aug 15, 2022
f02ff1a
YARN-11248. Add unit test for FINISHED_CONTAINERS_PULLED_BY_AM event …
hotcodemacha Aug 16, 2022
86abeb4
HDFS-16730. Update the doc that append to EC files is supported (#4749)
hotcodemacha Aug 16, 2022
5cc8c57
HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid co…
hotcodemacha Aug 17, 2022
e40b3a3
HDFS-4043. Namenode Kerberos Login does not use proper hostname for h…
snmvaughan Aug 17, 2022
cd72f7e
YARN-11224. [Federation] Add getAppQueue, updateAppQueue REST APIs fo…
slfan1989 Aug 17, 2022
682931a
HADOOP-18028. High performance S3A input stream (#4752)
steveloughran Aug 18, 2022
d09dd4a
HADOOP-18385. ITestS3ACannedACLs failure; fixed by adding in a span (…
hotcodemacha Aug 18, 2022
b7d4dc6
HADOOP-18365. Update the remote address when a change is detected (#4…
snmvaughan Aug 18, 2022
7f03025
HADOOP-18403. Fix FileSystem leak in ITestS3AAWSCredentialsProvider (…
virajjasani Aug 18, 2022
f75c58a
YARN-11252. Yarn Federation Router Supports Update / Delete Reservati…
slfan1989 Aug 19, 2022
b253b3b
YARN-11269. Upgrade JUnit from 4 to 5 in hadoop-yarn-server-timeline-…
hotcodemacha Aug 20, 2022
c870171
YARN-11254. hadoop-minikdc dependency duplicated in hadoop-yarn-serve…
clara0 Aug 20, 2022
7f176d0
HDFS-16729. RBF: fix some unreasonably annotated docs. (#4745)
jianghuazhu Aug 20, 2022
c294a41
YARN-9425. Make initialDelay configurable for FederationStateStoreSer…
hotcodemacha Aug 21, 2022
a9e5fb3
HDFS-16684. Exclude the current JournalNode (#4723)
snmvaughan Aug 22, 2022
231e095
HADOOP-18407. Improve readVectored() api spec (#4760)
mukund-thakur Aug 22, 2022
17daad3
HADOOP-18279. Cancel fileMonitoringTimer even if trustManager isn't d…
snmvaughan Aug 22, 2022
eda4bb5
YARN-11250. Capture the Performance Metrics of ZookeeperFederationSta…
slfan1989 Aug 22, 2022
c249db8
HADOOP-18380. fs.s3a.prefetch.block.size to be read through longBytes…
virajjasani Aug 23, 2022
183f09b
HDFS-16717. Replace NPE with IOException in DataNode.class (#4699). C…
ZanderXu Aug 23, 2022
6fbc38d
HDFS-16686. GetJournalEditServlet fails to authorize valid Kerberos r…
snmvaughan Aug 23, 2022
a3b1baf
HDFS-16669: Enhance client protocol to propagate last seen state IDs …
simbadzina Jul 18, 2022
c37f01d
HDFS-16724. RBF should support get the information about ancestor mou…
ZanderXu Aug 23, 2022
4890ba5
HADOOP-18406: Adds alignment context to call path for creating RPC pr…
simbadzina Aug 17, 2022
1ff1210
HADOOP-18417. Upgrade to M7 of surefire plugin (#4795)
snmvaughan Aug 24, 2022
de37fd3
MAPREDUCE-7403. manifest-committer dynamic partitioning support. (#4728)
steveloughran Aug 24, 2022
052d7f2
HADOOP-18361. Update commons-net from 3.6 to 3.8.0. (#4683). Contribu…
slfan1989 Aug 24, 2022
75aff24
YARN-11240. Fix incorrect placeholder in yarn-module. (#4678). Contri…
slfan1989 Aug 24, 2022
8d4f51c
HDFS-16728. RBF throw IndexOutOfBoundsException with disableNameServi…
ZanderXu Aug 24, 2022
880686d
Revert "HADOOP-18417. Upgrade to M7 of surefire plugin (#4795)"
ayushtkn Aug 24, 2022
1691ccc
HDFS-16738. Invalid CallerContext caused NullPointerException (#4791)
ZanderXu Aug 25, 2022
7fb9c30
HADOOP-18382. AWS SDK v2 upgrade prerequisites (#4698)
ahmarsuhail Aug 25, 2022
231a446
HDFS-16732. [SBN READ] Avoid get location from observer when the bloc…
zhengchenyu Aug 25, 2022
5736b34
HDFS-16736. Link to Boost library in libhdfspp (#4782)
GauthamBanasandra Aug 26, 2022
f8b9dd9
YARN-11219. [Federation] Add getAppActivities, getAppStatistics REST …
slfan1989 Aug 26, 2022
5567154
HDFS-16734. RBF: fix some bugs when handling getContentSummary RPC (#…
ZanderXu Aug 26, 2022
4031b07
YARN-11253. Add Configuration to delegationToken RemoverScanInterval.…
slfan1989 Aug 27, 2022
0075ef1
YARN-8482. [Router] Add cache for fast answers to getApps. (#4769)
slfan1989 Aug 27, 2022
c60a900
YARN-11275. [Federation] Add batchFinishApplicationMaster in UAMPoolM…
slfan1989 Aug 27, 2022
71778a6
HDFS-16735. Reduce the number of HeartbeatManager loops. (#4780). Con…
zhangshuyan0 Aug 29, 2022
2c05015
YARN-11196. NUMA support in DefaultContainerExecutor (#4742)
Samrat002 Aug 30, 2022
90dba8b
YARN-11245. Upgrade JUnit from 4 to 5 in hadoop-yarn-csi (#4778)
hotcodemacha Aug 30, 2022
22835be
HADOOP-18375. Fix failure of shelltest for hadoop_add_ldlibpath. (#4652)
iwasakims Aug 30, 2022
8a47ed6
YARN-11287. Fix NoClassDefFoundError: org/junit/platform/launcher/cor…
slfan1989 Aug 30, 2022
c334ba8
HADOOP-18428. Parameterize platform toolset version (#4815)
GauthamBanasandra Aug 30, 2022
c69e16b
HADOOP-18410. S3AInputStream.unbuffer() does not release http connect…
steveloughran Aug 31, 2022
84081a8
MAPREDUCE-7409. Make shuffle key length configurable. Contributed by …
9uapaw Aug 31, 2022
19830c9
HADOOP-18391. Improvements in VectoredReadUtils#readVectored() for di…
mukund-thakur Aug 31, 2022
33edbed
YARN-11272. Federation StateStore: Support storage/retrieval of Reser…
slfan1989 Aug 31, 2022
2dd8b13
HDFS-16755. TestQJMWithFaults.testUnresolvableHostName() can fail due…
snmvaughan Sep 1, 2022
2056040
HADOOP-18339. S3A storage class option only picked up when buffering …
monthonk Sep 1, 2022
37e213c
YARN-11177. Support getNewReservation, submit / update/ Reservation A…
slfan1989 Sep 1, 2022
c48ed3e
HADOOP-18408. ABFS: ITestAbfsManifestCommitProtocol fails on nonHNS …
sreeb-msft Sep 2, 2022
7b239a8
HDFS-16750. NameNode should use NameNode.getRemoteUser() to log audit…
ZanderXu Sep 2, 2022
3a96de7
YARN-6667. Handle containerId duplicate without failing the heartbeat…
slfan1989 Sep 2, 2022
b266f85
YARN-11284. [Federation] Improve UnmanagedAMPoolManager WithoutBlock …
slfan1989 Sep 2, 2022
1965708
YARN-11273. Federation StateStore: Support storage/retrieval of Reser…
slfan1989 Sep 2, 2022
7bf95d7
YARN-11289. [Federation] Improve NM FederationInterceptor removeAppFr…
slfan1989 Sep 2, 2022
ac42519
HDFS-16593. Correct the BlocksRemoved metric on DataNode side (#4353)…
ZanderXu Sep 5, 2022
be4c638
HDFS-16748. RBF: DFSClient should uniquely identify writing files by …
ZanderXu Sep 5, 2022
7bcf853
HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatisti…
sumangala-patki Sep 6, 2022
c947c32
HDFS-16659. JournalNode should throw NewerTxnIdException when SinceTx…
ZanderXu Sep 6, 2022
cc41ad6
HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping. (…
ayushtkn Sep 6, 2022
c664f95
HADOOP-18426. Use weighted calculation for MutableStat mean/variance …
xkrogen Sep 7, 2022
42c8f61
HADOOP-18441. Remove hadoop custom ServicesResourceTransformer (#4850…
pjfanning Sep 7, 2022
832d0e0
HADOOP-18443. Upgrade snakeyaml to 1.31 to mitigate CVE-2022-25857 (#…
hotcodemacha Sep 8, 2022
03961b1
HADOOP-18416. fix ITestS3AIOStatisticsContext test failure (#4806)
mehakmeet Sep 8, 2022
0db3ee5
HADOOP-18427. Improve ZKDelegationTokenSecretManager#startThead With …
slfan1989 Sep 8, 2022
29c4d8d
YARN-11298. Improve Yarn Router Junit Test Close MockRM. (#4870)
slfan1989 Sep 8, 2022
4a01fad
HDFS-16756. RBF proxies the client's user by the login user to enable…
ZanderXu Sep 9, 2022
56387cc
HADOOP-18186. s3a prefetching to use SemaphoredDelegatingExecutor for…
virajjasani Sep 9, 2022
5b85af8
YARN-11278. Fixed Ambiguous error message in mutation API. Contribute…
9uapaw Sep 9, 2022
8732625
HADOOP-18439. Fix VectoredIO for LocalFileSystem when checksum is ena…
mukund-thakur Sep 9, 2022
e76ffbf
YARN-11297. [Federation] Improve Yarn Router Reservation Submission C…
slfan1989 Sep 9, 2022
e77d54d
HDFS-13522: Add federated nameservices states to client protocol and …
simbadzina Sep 7, 2022
b276052
YARN-11274. Impove Nodemanager#NodeStatusUpdaterImpl Log. (#4783). Co…
slfan1989 Sep 10, 2022
cdcb448
YARN-11286. Make AsyncDispatcher#printEventDetailsExecutor thread poo…
slfan1989 Sep 10, 2022
21bae31
YARN-11265. Upgrade JUnit from 4 to 5 in hadoop-yarn-server-sharedcac…
hotcodemacha Sep 10, 2022
1923096
Allow block reconstruction pending timeout to be refreshable (#4567)
lfxy Sep 12, 2022
cde1f3a
HADOOP-18302. Remove WhiteBox in hadoop-common module. (#4457)
slfan1989 Sep 12, 2022
65a027b
YARN-11241. Add uncleaning option for local app log file with log-agg…
hotcodemacha Sep 12, 2022
3ce3533
YARN-7614. [RESERVATION] Support ListReservation APIs in Federation R…
slfan1989 Sep 12, 2022
55d8a91
YARN-11261. Upgrade JUnit from 4 to 5 in hadoop-yarn-server-web-proxy…
hotcodemacha Sep 13, 2022
88545a8
YARN-11301. Fix NoClassDefFoundError: org/junit/platform/launcher/cor…
slfan1989 Sep 13, 2022
8ce71c8
[Documentation] RBF: Duplicate statement to be removed for better rea…
prasad-acit Sep 13, 2022
86b84ed
HADOOP-18452. Fix TestKMS#testKMSHAZooKeeperDelegationToken Failed By…
slfan1989 Sep 14, 2022
272844e
HADOOP-15072 - Update Apache Kerby to 2.0.2 (#4473)
coheigea Sep 14, 2022
ce54b7e
HADOOP-18118. Fix KMS Accept Queue Size default value to 500 (#3972)
GuoPhilipse Sep 14, 2022
6422eaf
HDFS-16767: RBF: Support observer node in Router-Based Federation.
simbadzina Sep 13, 2022
59d3c20
MAPREDUCE-7407. Avoid stopContainer() on dead node (#4779)
hotcodemacha Sep 15, 2022
43c1eba
HDFS-16771. Follow-up for HDFS-16659: JN should tersely print logs ab…
ZanderXu Sep 15, 2022
0f03299
HADOOP-16769. LocalDirAllocator to provide diagnostics when file crea…
hotcodemacha Sep 16, 2022
a73c480
HADOOP-18446. [SBN read] Add a re-queue metric to RpcMetrics to quant…
ZanderXu Sep 16, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .asf.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,4 +22,4 @@ notifications:
commits: common-commits@hadoop.apache.org
issues: common-issues@hadoop.apache.org
pullrequests: common-issues@hadoop.apache.org
jira_options: link label worklog
jira_options: comment link label
122 changes: 70 additions & 52 deletions LICENSE-binary
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -215,15 +215,15 @@ com.aliyun:aliyun-java-sdk-ecs:4.2.0
com.aliyun:aliyun-java-sdk-ram:3.0.0
com.aliyun:aliyun-java-sdk-sts:3.0.0
com.aliyun.oss:aliyun-sdk-oss:3.13.2
com.amazonaws:aws-java-sdk-bundle:1.11.901
com.amazonaws:aws-java-sdk-bundle:1.12.262
com.cedarsoftware:java-util:1.9.0
com.cedarsoftware:json-io:2.5.1
com.fasterxml.jackson.core:jackson-annotations:2.13.2
com.fasterxml.jackson.core:jackson-core:2.13.2
com.fasterxml.jackson.core:jackson-databind:2.13.2.2
com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.13.2
com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:2.13.2
com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.13.2
com.fasterxml.jackson.core:jackson-annotations:2.12.7
com.fasterxml.jackson.core:jackson-core:2.12.7
com.fasterxml.jackson.core:jackson-databind:2.12.7
com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.12.7
com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:2.12.7
com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.12.7
com.fasterxml.uuid:java-uuid-generator:3.1.4
com.fasterxml.woodstox:woodstox-core:5.3.0
com.github.davidmoten:rxjava-extras:0.8.0.17
Expand Down Expand Up @@ -251,7 +251,7 @@ commons-collections:commons-collections:3.2.2
commons-daemon:commons-daemon:1.0.13
commons-io:commons-io:2.8.0
commons-logging:commons-logging:1.1.3
commons-net:commons-net:3.6
commons-net:commons-net:3.8.0
de.ruedigermoeller:fst:2.50
io.grpc:grpc-api:1.26.0
io.grpc:grpc-context:1.26.0
Expand All @@ -261,17 +261,36 @@ io.grpc:grpc-protobuf:1.26.0
io.grpc:grpc-protobuf-lite:1.26.0
io.grpc:grpc-stub:1.26.0
io.netty:netty:3.10.6.Final
io.netty:netty-all:4.1.42.Final
io.netty:netty-buffer:4.1.27.Final
io.netty:netty-codec:4.1.27.Final
io.netty:netty-codec-http:4.1.27.Final
io.netty:netty-codec-http2:4.1.27.Final
io.netty:netty-codec-socks:4.1.27.Final
io.netty:netty-common:4.1.27.Final
io.netty:netty-handler:4.1.27.Final
io.netty:netty-handler-proxy:4.1.27.Final
io.netty:netty-resolver:4.1.27.Final
io.netty:netty-transport:4.1.27.Final
io.netty:netty-all:4.1.77.Final
io.netty:netty-buffer:4.1.77.Final
io.netty:netty-codec:4.1.77.Final
io.netty:netty-codec-dns:4.1.77.Final
io.netty:netty-codec-haproxy:4.1.77.Final
io.netty:netty-codec-http:4.1.77.Final
io.netty:netty-codec-http2:4.1.77.Final
io.netty:netty-codec-memcache:4.1.77.Final
io.netty:netty-codec-mqtt:4.1.77.Final
io.netty:netty-codec-redis:4.1.77.Final
io.netty:netty-codec-smtp:4.1.77.Final
io.netty:netty-codec-socks:4.1.77.Final
io.netty:netty-codec-stomp:4.1.77.Final
io.netty:netty-codec-xml:4.1.77.Final
io.netty:netty-common:4.1.77.Final
io.netty:netty-handler:4.1.77.Final
io.netty:netty-handler-proxy:4.1.77.Final
io.netty:netty-resolver:4.1.77.Final
io.netty:netty-resolver-dns:4.1.77.Final
io.netty:netty-transport:4.1.77.Final
io.netty:netty-transport-rxtx:4.1.77.Final
io.netty:netty-transport-sctp:4.1.77.Final
io.netty:netty-transport-udt:4.1.77.Final
io.netty:netty-transport-classes-epoll:4.1.77.Final
io.netty:netty-transport-native-unix-common:4.1.77.Final
io.netty:netty-transport-classes-kqueue:4.1.77.Final
io.netty:netty-resolver-dns-classes-macos:4.1.77.Final
io.netty:netty-transport-native-epoll:4.1.77.Final
io.netty:netty-transport-native-kqueue:4.1.77.Final
io.netty:netty-resolver-dns-native-macos:4.1.77.Final
io.opencensus:opencensus-api:0.12.3
io.opencensus:opencensus-contrib-grpc-metrics:0.12.3
io.reactivex:rxjava:1.3.8
Expand All @@ -290,7 +309,7 @@ org.apache.commons:commons-configuration2:2.1.1
org.apache.commons:commons-csv:1.0
org.apache.commons:commons-digester:1.8.1
org.apache.commons:commons-lang3:3.12.0
org.apache.commons:commons-math3:3.1.1
org.apache.commons:commons-math3:3.6.1
org.apache.commons:commons-text:1.4
org.apache.commons:commons-validator:1.6
org.apache.curator:curator-client:5.2.0
Expand All @@ -306,44 +325,44 @@ org.apache.htrace:htrace-core4:4.1.0-incubating
org.apache.httpcomponents:httpclient:4.5.6
org.apache.httpcomponents:httpcore:4.4.10
org.apache.kafka:kafka-clients:2.8.1
org.apache.kerby:kerb-admin:1.0.1
org.apache.kerby:kerb-client:1.0.1
org.apache.kerby:kerb-common:1.0.1
org.apache.kerby:kerb-core:1.0.1
org.apache.kerby:kerb-crypto:1.0.1
org.apache.kerby:kerb-identity:1.0.1
org.apache.kerby:kerb-server:1.0.1
org.apache.kerby:kerb-simplekdc:1.0.1
org.apache.kerby:kerb-util:1.0.1
org.apache.kerby:kerby-asn1:1.0.1
org.apache.kerby:kerby-config:1.0.1
org.apache.kerby:kerby-pkix:1.0.1
org.apache.kerby:kerby-util:1.0.1
org.apache.kerby:kerby-xdr:1.0.1
org.apache.kerby:token-provider:1.0.1
org.apache.kerby:kerb-admin:2.0.2
org.apache.kerby:kerb-client:2.0.2
org.apache.kerby:kerb-common:2.0.2
org.apache.kerby:kerb-core:2.0.2
org.apache.kerby:kerb-crypto:2.0.2
org.apache.kerby:kerb-identity:2.0.2
org.apache.kerby:kerb-server:2.0.2
org.apache.kerby:kerb-simplekdc:2.0.2
org.apache.kerby:kerb-util:2.0.2
org.apache.kerby:kerby-asn1:2.0.2
org.apache.kerby:kerby-config:2.0.2
org.apache.kerby:kerby-pkix:2.0.2
org.apache.kerby:kerby-util:2.0.2
org.apache.kerby:kerby-xdr:2.0.2
org.apache.kerby:token-provider:2.0.2
org.apache.solr:solr-solrj:8.8.2
org.apache.yetus:audience-annotations:0.5.0
org.apache.zookeeper:zookeeper:3.6.3
org.codehaus.jettison:jettison:1.1
org.eclipse.jetty:jetty-annotations:9.4.44.v20210927
org.eclipse.jetty:jetty-http:9.4.44.v20210927
org.eclipse.jetty:jetty-io:9.4.44.v20210927
org.eclipse.jetty:jetty-jndi:9.4.44.v20210927
org.eclipse.jetty:jetty-plus:9.4.44.v20210927
org.eclipse.jetty:jetty-security:9.4.44.v20210927
org.eclipse.jetty:jetty-server:9.4.44.v20210927
org.eclipse.jetty:jetty-servlet:9.4.44.v20210927
org.eclipse.jetty:jetty-util:9.4.44.v20210927
org.eclipse.jetty:jetty-util-ajax:9.4.44.v20210927
org.eclipse.jetty:jetty-webapp:9.4.44.v20210927
org.eclipse.jetty:jetty-xml:9.4.44.v20210927
org.eclipse.jetty.websocket:javax-websocket-client-impl:9.4.44.v20210927
org.eclipse.jetty.websocket:javax-websocket-server-impl:9.4.44.v20210927
org.eclipse.jetty:jetty-annotations:9.4.48.v20220622
org.eclipse.jetty:jetty-http:9.4.48.v20220622
org.eclipse.jetty:jetty-io:9.4.48.v20220622
org.eclipse.jetty:jetty-jndi:9.4.48.v20220622
org.eclipse.jetty:jetty-plus:9.4.48.v20220622
org.eclipse.jetty:jetty-security:9.4.48.v20220622
org.eclipse.jetty:jetty-server:9.4.48.v20220622
org.eclipse.jetty:jetty-servlet:9.4.48.v20220622
org.eclipse.jetty:jetty-util:9.4.48.v20220622
org.eclipse.jetty:jetty-util-ajax:9.4.48.v20220622
org.eclipse.jetty:jetty-webapp:9.4.48.v20220622
org.eclipse.jetty:jetty-xml:9.4.48.v20220622
org.eclipse.jetty.websocket:javax-websocket-client-impl:9.4.48.v20220622
org.eclipse.jetty.websocket:javax-websocket-server-impl:9.4.48.v20220622
org.ehcache:ehcache:3.3.1
org.lz4:lz4-java:1.7.1
org.objenesis:objenesis:2.6
org.xerial.snappy:snappy-java:1.0.5
org.yaml:snakeyaml:1.16:
org.yaml:snakeyaml:1.31:
org.wildfly.openssl:wildfly-openssl:1.0.7.Final


Expand Down Expand Up @@ -416,7 +435,7 @@ hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanage
bootstrap v3.3.6
broccoli-asset-rev v2.4.2
broccoli-funnel v1.0.1
datatables v1.10.8
datatables v1.10.19
em-helpers v0.5.13
em-table v0.1.6
ember v2.2.0
Expand Down Expand Up @@ -491,7 +510,6 @@ javax.annotation:javax.annotation-api:1.3.2
javax.servlet:javax.servlet-api:3.1.0
javax.servlet.jsp:jsp-api:2.1
javax.websocket:javax.websocket-api:1.0
javax.ws.rs:javax.ws.rs-api:2.1.1
javax.ws.rs:jsr311-api:1.1.1
javax.xml.bind:jaxb-api:2.2.11

Expand Down
10 changes: 1 addition & 9 deletions hadoop-client-modules/hadoop-client-api/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,13 +98,6 @@
<createSourcesJar>true</createSourcesJar>
<shadeSourcesContent>true</shadeSourcesContent>
</configuration>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-maven-plugins</artifactId>
<version>${project.version}</version>
</dependency>
</dependencies>
<executions>
<execution>
<phase>package</phase>
Expand Down Expand Up @@ -254,8 +247,7 @@
</relocation>
</relocations>
<transformers>
<!-- Needed until MSHADE-182 -->
<transformer implementation="org.apache.hadoop.maven.plugin.shade.resource.ServicesResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.ApacheLicenseResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.DontIncludeResourceTransformer">
<resource>NOTICE.txt</resource>
Expand Down
11 changes: 1 addition & 10 deletions hadoop-client-modules/hadoop-client-minicluster/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -671,13 +671,6 @@
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-shade-plugin</artifactId>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-maven-plugins</artifactId>
<version>${project.version}</version>
</dependency>
</dependencies>
<executions>
<execution>
<phase>package</phase>
Expand All @@ -704,7 +697,6 @@
<exclude>org.bouncycastle:*</exclude>
<!-- Leave snappy that includes native methods which cannot be relocated. -->
<exclude>org.xerial.snappy:*</exclude>
<exclude>javax.ws.rs:javax.ws.rs-api</exclude>
</excludes>
</artifactSet>
<filters>
Expand Down Expand Up @@ -1053,8 +1045,7 @@
</relocation>
</relocations>
<transformers>
<!-- Needed until MSHADE-182 -->
<transformer implementation="org.apache.hadoop.maven.plugin.shade.resource.ServicesResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.ApacheLicenseResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.DontIncludeResourceTransformer">
<resources>
Expand Down
11 changes: 1 addition & 10 deletions hadoop-client-modules/hadoop-client-runtime/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -128,13 +128,6 @@
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-shade-plugin</artifactId>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-maven-plugins</artifactId>
<version>${project.version}</version>
</dependency>
</dependencies>
<executions>
<execution>
<phase>package</phase>
Expand Down Expand Up @@ -163,7 +156,6 @@
<exclude>org.bouncycastle:*</exclude>
<!-- Leave snappy that includes native methods which cannot be relocated. -->
<exclude>org.xerial.snappy:*</exclude>
<exclude>javax.ws.rs:javax.ws.rs-api</exclude>
</excludes>
</artifactSet>
<filters>
Expand Down Expand Up @@ -398,8 +390,7 @@
-->
</relocations>
<transformers>
<!-- Needed until MSHADE-182 -->
<transformer implementation="org.apache.hadoop.maven.plugin.shade.resource.ServicesResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.ApacheLicenseResourceTransformer"/>
<transformer implementation="org.apache.maven.plugins.shade.resource.DontIncludeResourceTransformer">
<resources>
Expand Down
Loading