HADOOP-15566 Opentelemetry changes using java agent#3445

Closed

kiran-maturi wants to merge 673 commits intoapache:trunkfrom

kiran-maturi:HADOOP-15566-javaagent

This pull request is big! We're only showing the most recent 250 commits

Commits on Nov 24, 2021

YARN-10813. Set default capacity of root for node labels. Contributed by Andras Gyori

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
HADOOP-17760. Delete hadoop.ssl.enabled and dfs.https.enable from docs and core-default.xml (#3099)

tasanuma
authored and
Kiran Kumar Maturi
committed
HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet (#3065)

hust-hhb
authored and
Kiran Kumar Maturi
committed
HDFS-16074. Remove an expensive debug string concatenation (#3107)

jojochuang
authored and
Kiran Kumar Maturi
committed
HADOOP-17724. Add Dockerfile for Debian 10 (#3038)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HDFS-15842. HDFS mover to emit metrics. (#2738)

LeonGao91
authored and
Kiran Kumar Maturi
committed
HDFS-16078. Remove unused parameters for DatanodeManager.handleLifeline() (#3119). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16061. DFTestUtil.waitReplication can produce false positives (#3095). Contributed by Ahmed Hussein.

amahussein
authored and
Kiran Kumar Maturi
committed
HDFS-16080. RBF: Invoking method in all locations should break the loop after successful result (#3121). Contributed by Viraj Jasani.

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16079. Improve the block state change log (#3120). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16075. Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects (#3115)

virajjasani
authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7354. Use empty array constant present in TaskCompletionEvent to avoid creating redundant objects (#3123)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-14575. LeaseRenewer#daemon threads leak in DFSClient. Contributed by Renukaprasad C.

authored and
Kiran Kumar Maturi
committed
HDFS-16082. Atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer (#3127)

virajjasani
authored and
Kiran Kumar Maturi
committed
YARN-10826. [UI2] Upgrade Node.js to v12.22.1. (#3128)

iwasakims
authored and
Kiran Kumar Maturi
committed
HADOOP-17766. CI for Debian 10 (#3129)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HDFS-16076. Avoid using slow DataNodes for reading by sorting locations (#3117)

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16085. Move the getPermissionChecker out of the read lock (#3134). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery (#3130). Contributed by Ahmed Hussein.

amahussein
authored and
Kiran Kumar Maturi
committed
HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain." (#3133)

steveloughran
authored and
Kiran Kumar Maturi
committed
HDFS-16044. Fix getListing call getLocatedBlocks even source is a directory. Contributed by ludun.

Hexiaoqiao
authored and
Kiran Kumar Maturi
committed
YARN-10780. Optimise retrieval of configured node labels in CS queues. Contributed by Andras Gyori.

pbacsko
authored and
Kiran Kumar Maturi
committed
Revert "HDFS-16044. Fix getListing call getLocatedBlocks even source is a directory. Contributed by ludun."

Hexiaoqiao
authored and
Kiran Kumar Maturi
committed
HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt (#3109)

majdyz
authored and
Kiran Kumar Maturi
committed
YARN-10824. Title not set for JHS and NM webpages. Contributed by Bilwa S T.

jbrennan333
authored and
Kiran Kumar Maturi
committed
HDFS-13916. Distcp SnapshotDiff to support WebHDFS. Contributed by Xun REN.

iwasakims
authored and
Kiran Kumar Maturi
committed
YARN-10820. Make GetClusterNodesRequestPBImpl thread safe. Contributed by Swathi Chandrashekar.

PrabhuJoseph
authored and
Kiran Kumar Maturi
committed
YARN-10834. Intra-queue preemption: apps that don't use defined custom resource won't be preempted. Contributed by Eric Payne.

jbrennan333
authored and
Kiran Kumar Maturi
committed
HDFS-16092. Avoid creating LayoutFlags redundant objects (#3150)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16089. Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor (#3146)

tomscut
authored and
Kiran Kumar Maturi
committed
HADOOP-17777. Update clover-maven-plugin version from 3.3.0 to 4.4.1 (#3152)

jiwq
authored and
Kiran Kumar Maturi
committed
HDFS-16096. Delete useless method DirectoryWithQuotaFeature#setQuota (#3156)

authored and
Kiran Kumar Maturi
committed
HADOOP-17331. [JDK 16] TestDNS fails (#2884)

aajisaka
authored and
Kiran Kumar Maturi
committed
HDFS-16090. Fine grained lock for datanodeNetworkCounts (#3148)

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17778. CI for Centos 8 (#3151)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HDFS-16086. Add volume information to datanode log for tracing (#3136)

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16104. Remove unused parameter and fix java doc for DiskBalancerCLI (#3160). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16099. Make bpServiceToActive to be volatile. (#3159)

zhangshuyan0
authored and
Kiran Kumar Maturi
committed
HDFS-16106. Fix flaky unit test TestDFSShell (#3168)

tomscut
authored and
Kiran Kumar Maturi
committed
HADOOP-17774. S3A bytesRead FS statistic showing twice the correct value (#3144)

mehakmeet
authored and
Kiran Kumar Maturi
committed
HADOOP-17290. ABFS: Add Identifiers to Client Request Header (#2520)

sumangala-patki
authored and
Kiran Kumar Maturi
committed
HDFS-16109. Fix flaky some unit tests since they offen timeout (#3172)

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16108. Fix incorrect log placeholders used in JournalNodeSyncer (#3169)

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17250 Lot of short reads can be merged with readahead. (#3110)

mukund-thakur
authored and
Kiran Kumar Maturi
committed
HADOOP-17402. Add GCS config to the core-site (#2638)

ravwojdyla
authored and
Kiran Kumar Maturi
committed
HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout (#3080)

liangxs
authored and
Kiran Kumar Maturi
committed
HDFS-16110. Remove unused method reportChecksumFailure in DFSClient (#3174)

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16101. Remove unuse variable and IoException in ProvidedStorageMap. Contributed by lei w.

ayushtkn
authored and
Kiran Kumar Maturi
committed
HADOOP-17775. Remove JavaScript package from Docker environment. (#3137)

iwasakims
authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7351 - CleanupJob during handle of SIGTERM signal (#3176)

authored and
Kiran Kumar Maturi
committed
HDFS-16114. the balancer parameters print error (#3179)

authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7353: Mapreduce job fails when NM is stopped. Contributed by Bilwa S T (BilwaST)

erichadoop
authored and
Kiran Kumar Maturi
committed
HDFS-16088. Standby NameNode process getLiveDatanodeStorageReport req… (#3140)

tomscut
authored and
Kiran Kumar Maturi
committed
HADOOP-17788. Replace IOUtils#closeQuietly usages by Hadoop's own utility (#3171)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16121. Iterative snapshot diff report can generate duplicate records for creates, deletes and Renames. (#3188)

bshashikant
authored and
Kiran Kumar Maturi
committed
HDFS-15796. ConcurrentModificationException error happens on NameNode occasionally. Contributed by Daniel Ma

S O'Donnell
authored and
Kiran Kumar Maturi
committed
HADOOP-17794. Add a sample configuration to use ZKDelegationTokenSecretManager in Hadoop KMS (#3190)

aajisaka
authored and
Kiran Kumar Maturi
committed
HADOOP-17793. Better token validation (#3189)

artem-smotrakov
authored and
Kiran Kumar Maturi
committed
HDFS-16122. Fix DistCpContext#toString() (#3191). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HADOOP-12665. Document hadoop.security.token.service.use_ip. (#3187)

aajisaka
authored and
Kiran Kumar Maturi
committed
HADOOP-17770 WASB : Support disabling buffered reads in positional reads (#3149)

anoopsjohn
authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7356. Remove some duplicate dependencies from mapreduce-client's child poms (#3193). Contributed by Viraj Jasani.

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes. (#2639)

LeonGao91
authored and
Kiran Kumar Maturi
committed
HADOOP-17028. ViewFS should initialize mounted target filesystems lazily. Contributed by Abhishek Das (#2260)

abhishekdas99
authored and
Kiran Kumar Maturi
committed
HADOOP-17672.Remove an invalid comment content in the FileContext class. (#2961)

authored and
Kiran Kumar Maturi
committed
HADOOP-17795. Provide fallbacks for callqueue.impl and scheduler.impl (#3192)

virajjasani
authored and
Kiran Kumar Maturi
committed
YARN-10456. RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry. Contributed by Eric Payne.

jbrennan333
authored and
Kiran Kumar Maturi
committed
HDFS-15650. Make the socket timeout for computing checksum of striped blocks configurable (#2414)

crossfire
authored and
Kiran Kumar Maturi
committed
HADOOP-16272. Upgrade HikariCP to 4.0.3 (#3204)

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17803. Remove WARN logging from LoggingAuditor when executing a request outside an audit span (#3207)

mehakmeet
authored and
Kiran Kumar Maturi
committed
HADOOP-17801. No error message reported when bucket doesn't exist in S3AFS (#3202)

mehakmeet
authored and
Kiran Kumar Maturi
committed
HDFS-16127. Improper pipeline close recovery causes a permanent write failure or data loss. Contributed by Kihwal Lee.

kihwal
authored and
Kiran Kumar Maturi
committed
HDFS-16067. Support Append API in NNThroughputBenchmark. Contributed by Renukaprasad C.

Hexiaoqiao
authored and
Kiran Kumar Maturi
committed
YARN-10855. yarn logs cli fails to retrieve logs if any TFile is corrupt or empty. Contributed by Jim Brennan.

zhuqi-lucas
authored and
Kiran Kumar Maturi
committed
YARN-10858. [UI2] YARN-10826 breaks Queue view. (#3213)

iwasakims
authored and
Kiran Kumar Maturi
committed
HADOOP-16290. Enable RpcMetrics units to be configurable (#3198)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16087. Fix stuck issue in rbfbalance tool (#3141). Contributed by Eric Yin.

lipppppp
authored and
Kiran Kumar Maturi
committed
YARN-10630. [UI2] Ambiguous queue name resolution (#3214)

authored and
Kiran Kumar Maturi
committed
YARN-10860. Make max container per heartbeat configs refreshable. Contributed by Eric Badger.

zhuqi-lucas
authored and
Kiran Kumar Maturi
committed
HADOOP-17796. Upgrade jetty version to 9.4.43 (#3208)

prasad-acit
authored and
Kiran Kumar Maturi
committed
YARN-10657. We should make max application per queue to support node label. Contributed by Andras Gyori.

zhuqi-lucas
authored and
Kiran Kumar Maturi
committed
HADOOP-17813. Checkstyle - Allow line length: 100

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17808. ipc.Client to set interrupt flag after catching InterruptedException (#3219)

virajjasani
authored and
Kiran Kumar Maturi
committed
YARN-10829. Support getApplications API in FederationClientInterceptor (#3135)

akshatb1
authored and
Kiran Kumar Maturi
committed
HADOOP-17458. S3A to treat "SdkClientException: Data read has a different length than the expected" as EOFException (#3040)

bogthe
authored and
Kiran Kumar Maturi
committed
YARN-10833. Set the X-FRAME-OPTIONS header for the default contexts. (#3203)

brumi1024
authored and
Kiran Kumar Maturi
committed
HADOOP-17317. [JDK 11] Upgrade dnsjava to remove illegal access warnings (#2442)

aajisaka
authored and
Kiran Kumar Maturi
committed
Addendum HADOOP-17770 WASB : Support disabling buffered reads in positional reads - Added the invalid SpotBugs warning to findbugs-exclude.xml (#3223)

anoopsjohn
authored and
Kiran Kumar Maturi
committed
HDFS-12920. HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop. (#3227)

aajisaka
authored and
Kiran Kumar Maturi
committed
[UI2] Bump http-proxy to 1.18.1 (#2891)

dependabot[bot]
authored and
Kiran Kumar Maturi
committed
HDFS-16131. Show storage type for failed volumes on namenode web (#3211). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16140. TestBootstrapAliasmap fails by BindException. (#3229)

aajisaka
authored and
Kiran Kumar Maturi
committed
HADOOP-17807. Use separate src dir for platform builds (#3210)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HDFS-16139. Update BPServiceActor Scheduler's nextBlockReportTime atomically (#3228). Contributed by Viraj Jasani.

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK (#2706)

mehakmeet
authored and
Kiran Kumar Maturi
committed
YARN-6221. Entities missing from ATS when summary log file info got returned to the ATS before the domain log. Contributed by Xiaomin Zhang

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid. (#3185)

authored and
Kiran Kumar Maturi
committed
HADOOP-17765. ABFS: Use Unique File Paths in Tests. (#3153)

sumangala-patki
authored and
Kiran Kumar Maturi
committed
HDFS-16111. Add a configuration to RoundRobinVolumeChoosingPolicy to avoid failed volumes at datanodes. (#3175)

authored and
Kiran Kumar Maturi
committed
YARN-9551. TestTimelineClientV2Impl.testSyncCall fails intermittent (#3212)

authored and
Kiran Kumar Maturi
committed
HDFS-16145. CopyListing fails with FNF exception with snapshot diff. (#3234)

bshashikant
authored and
Kiran Kumar Maturi
committed
HDFS-16137.Improve the comments related to FairCallQueue#queues. (#3226)

authored and
Kiran Kumar Maturi
committed
YARN-10727. ParentQueue does not validate the queue on removal. Contributed by Andras Gyori

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
HDFS-16144. Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions). Contributed by Stephen O'Donnell

S O'Donnell
authored and
Kiran Kumar Maturi
committed
HADOOP-17817. S3A to raise IOE if both S3-CSE and S3Guard enabled (#3239)

mehakmeet
authored and
Kiran Kumar Maturi
committed
YARN-10790. CS Flexible AQC: Add separate parent and leaf template property. Contributed by Andras Gyori

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
YARN-6272. TestAMRMClient#testAMRMClientWithContainerResourceChange fails intermittently. Contributed by Andras Gyory & Prabhu Joseph

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
HADOOP-17814. Provide fallbacks for identity/cost providers and backoff enable (#3230)

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17811: ABFS ExponentialRetryPolicy doesn't pick up configuration values (#3221)

brianloss
authored and
Kiran Kumar Maturi
committed
HADOOP-17819. Add extensions to ProtobufRpcEngine RequestHeaderProto. Contributed by Hector Sandoval Chaverri. (#3242)

hchaverri
authored and
Kiran Kumar Maturi
committed
HDFS-15175. Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog. Contributed by Wan Chang.

Hexiaoqiao
authored and
Kiran Kumar Maturi
committed
HDFS-15936.Solve SocketTimeoutException#sendPacket() does not record SocketTimeout exception. (#2836)

authored and
Kiran Kumar Maturi
committed
YARN-10841. Fix token reset synchronization for UAM response token. (#3194)

minni31
authored and
Kiran Kumar Maturi
committed
YARN-10628. Add node usage metrics in SLS. Contributed by Vadaga Ananyo Rao

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
YARN-10663. Add runningApps stats in SLS. Contributed by Vadaga Ananyo Rao

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
YARN-10869. CS considers only the default maximum-allocation-mb/vcore property as a maximum when it creates dynamic queues (#3225)

brumi1024
authored and
Kiran Kumar Maturi
committed
YARN-10856. Prevent ATS v2 health check REST API call if the ATS service itself is disabled. (#3236)

brumi1024
authored and
Kiran Kumar Maturi
committed
HADOOP-17815. Run CI for Centos 7 (#3231)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
YARN-10814. Fallback to RandomSecretProvider if the secret file is empty (#3206)

tomicooler
authored and
Kiran Kumar Maturi
committed
HDFS-14529. SetTimes to throw FileNotFoundException if inode is not found (#3243)

jojochuang
authored and
Kiran Kumar Maturi
committed
HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem (#3101)

bogthe
authored and
Kiran Kumar Maturi
committed
HADOOP-17812. NPE in S3AInputStream read() after failure to reconnect to store (#3222)

wbo4958
authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7258. HistoryServerRest.html#Task_Counters_API, modify the jobTaskCounters's itemName from taskcounterGroup to taskCounterGroup (#1808)

authored and
Kiran Kumar Maturi
committed
YARN-10854. Support marking inactive node as untracked without configured include path. Contributed by Tao Yang.

zhuqi-lucas
authored and
Kiran Kumar Maturi
committed
HADOOP-17628. Distcp contract test is really slow with ABFS and S3A; timing out. (#3240)

steveloughran
authored and
Kiran Kumar Maturi
committed
HADOOP-17822. fs.s3a.acl.default not working after S3A Audit feature (#3249)

steveloughran
authored and
Kiran Kumar Maturi
committed
HADOOP-17612. Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0 (#3241)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16149.Improve the parameter annotation in FairCallQueue#priorityLevels. (#3255)

authored and
Kiran Kumar Maturi
committed
YARN-10874. Refactor NM ContainerLaunch#getEnvDependencies's unit tests (#3248)

tomicooler
authored and
Kiran Kumar Maturi
committed
HDFS-16146. All three replicas are lost due to not adding a new DataN… (#3247) Contributed by Shuyan Zhang.

zhangshuyan0
authored and
Kiran Kumar Maturi
committed
YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler
authored and
Kiran Kumar Maturi
committed
YARN-10849 Clarify testcase documentation for TestServiceAM#testContainersReleasedWhenPreLaunchFails. Contributed by Szilard Nemeth

Gergely Pollak
authored and
Kiran Kumar Maturi
committed
HADOOP-17618. ABFS: Partially obfuscate SAS object IDs in Logs (#2845)

sumangala-patki
authored and
Kiran Kumar Maturi
committed
YARN-10878. move TestNMSimulator off com.google (#3268)

steveloughran
authored and
Kiran Kumar Maturi
committed
HADOOP-17823. S3A S3Guard tests to skip if S3-CSE are enabled (#3263)

mehakmeet
authored and
Kiran Kumar Maturi
committed
HADOOP-17816. Run optional CI for changes in C (#3238)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HADOOP-17808. Avoid excessive logging for interruption (ADDENDUM) (#3267)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16153. Avoid evaluation of LOG.debug statement in QuorumJournalManager (#3269). Contributed by wangzhaohui.

wzhallright
authored and
Kiran Kumar Maturi
committed
HADOOP-17837: Add unresolved endpoint value to UnknownHostException (#3272)

bbeaudreault
authored and
Kiran Kumar Maturi
committed
HDFS-16154. TestMiniJournalCluster failing intermittently because of not reseting UserGroupInformation completely (#3270)

authored and
Kiran Kumar Maturi
committed
HADOOP-17837: Add unresolved endpoint value to UnknownHostException (ADDENDUM) (#3276)

bbeaudreault
authored and
Kiran Kumar Maturi
committed
HADOOP-17787. Refactor fetching of credentials in Jenkins (#3167)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HADOOP-17835. Use CuratorCache implementation instead of PathChildrenCache / TreeCache (#3266)

virajjasani
authored and
Kiran Kumar Maturi
committed
Fix potential heap buffer overflow in hdfs.c. Contributed by Igor Chervatyuk.

aajisaka
authored and
Kiran Kumar Maturi
committed
HADOOP-17370. Upgrade commons-compress to 1.21 (#3274)

aajisaka
authored and
Kiran Kumar Maturi
committed
HDFS-16151. Improve the parameter comments related to ProtobufRpcEngine2#Server(). (#3256)

authored and
Kiran Kumar Maturi
committed
HADOOP-17841. Remove ListenerHandle from Hadoop registry (#3278)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-15976. Make mkdtemp cross platform (#2908)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
opentelemetry using javaagent

kiran-maturi
authored and
Kiran Kumar Maturi
committed
HADOOP-17844. Upgrade JSON smart to 2.4.7 (#3299)

prasad-acit
authored and
Kiran Kumar Maturi
committed
HADOOP-17799. Improve the GitHub pull request template (#3277)

aajisaka
authored and
Kiran Kumar Maturi
committed
HADOOP-17834. Bump aliyun-sdk-oss to 3.13.0 (#3261)

smengcl
authored and
Kiran Kumar Maturi
committed
added opentelemetry trace options for hdfs

kiran-maturi
authored and
Kiran Kumar Maturi
committed
HDFS-16163. Avoid locking entire blockPinningFailures map (#3296)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16171. De-flake testDecommissionStatus (#3280)

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17825. Add BuiltInGzipCompressor (#3250)

viirya
authored and
Kiran Kumar Maturi
committed
HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments. (#3295)

authored and
Kiran Kumar Maturi
committed
YARN-10873: Account for scheduled AM containers before deactivating node (#3287)

srinivasst
authored and
Kiran Kumar Maturi
committed
HDFS-16174. Refactor TempFile and TempDir in libhdfs++ (#3303)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HADOOP-17836. Improve logging on ABFS error reporting (#3281)

steveloughran
authored and
Kiran Kumar Maturi
committed
HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters (#2975)

sumangala-patki
authored and
Kiran Kumar Maturi
committed
HDFS-16160. Improve the parameter annotation in DatanodeProtocol#sendHeartbeat (#3291)

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16177. Bug fix for Util#receiveFile (#3310)

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16178. Make recursive rmdir in libhdfs++ cross platform (#3311)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HDFS-16180.FsVolumeImpl.nextBlock should consider that the block meta file has been deleted. (#3315)

Neilxzn
authored and
Kiran Kumar Maturi
committed
YARN-10838. Implement an optimised version of Configuration getPropsWithPrefix. Contributed by Andras Gyori, Benjamin Teke

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
HADOOP-17858. Avoid possible class loading deadlock with VerifierNone initialization (#3321)

virajjasani
authored and
Kiran Kumar Maturi
committed
HADOOP-17854. Run junit in Jenkins only if surefire reports exist (#3319)

GauthamBanasandra
authored and
Kiran Kumar Maturi
committed
HDFS-16184. De-flake TestBlockScanner#testSkipRecentAccessFile (#3329)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS. (#3307)

authored and
Kiran Kumar Maturi
committed
HDFS-16157. Support configuring DNS record to get list of journal nodes contributed by Leon Gao. (#3284)

LeonGao91
authored and
Kiran Kumar Maturi
committed
HDFS-16143. Add Timer in EditLogTailer and de-flake TestEditLogTailer#testStandbyTriggersLogRollsWhenTailInProgressEdits (#3235)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16173.Improve CopyCommands#Put#executor queue configurability. (#3302)

authored and
Kiran Kumar Maturi
committed
YARN-10891. Extend QueueInfo with max-parallel-apps in CS. (#3314)

tomicooler
authored and
Kiran Kumar Maturi
committed
HADOOP-17877. BuiltInGzipCompressor header and trailer should not be static variables (#3350)

viirya
authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7342. Stop RMService in TestClientRedirect.testRedirect() (#2968)

lzx404243
authored and
Kiran Kumar Maturi
committed
HADOOP-17544. Mark KeyProvider as Stable. (#2776)

aajisaka
authored and
Kiran Kumar Maturi
committed
HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than `fs.s3a.threads.max` (#3337).

dongjoon-hyun
authored and
Kiran Kumar Maturi
committed
HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst. (#3353)

authored and
Kiran Kumar Maturi
committed
HADOOP-17870. Http Filesystem to qualify relative paths. (#3338)

yellowflash
authored and
Kiran Kumar Maturi
committed
MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter (#2500)

authored and
Kiran Kumar Maturi
committed
HDFS-15966. Empty the statistical parameters when emptying the redundant queue (#2894)

langlaile1221
authored and
Kiran Kumar Maturi
committed
HADOOP-17886. Upgrade ant to 1.10.11 (#3371)

amahussein
authored and
Kiran Kumar Maturi
committed
HADOOP-17874. ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner (#3343)

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16202. Use constants "HdfsClientConfigKeys.Failover.PREFIX" instead of "dfs.client.failover." (#3367). Contributed by Weison Wei.

WeisonWei
authored and
Kiran Kumar Maturi
committed
HADOOP-15129. Datanode caches namenode DNS lookup failure and cannot startup (#3348)

cnauroth
authored and
Kiran Kumar Maturi
committed
HDFS-16199. Resolve log placeholders in NamenodeBeanMetrics (#3362). Contributed by Viraj Jasani.

virajjasani
authored and
Kiran Kumar Maturi
committed
HDFS-16194. Simplify the code with DatanodeID#getXferAddrWithHostname (#3354). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
HDFS-16138. BlockReportProcessingThread exit doesn't print the actual stack (#3244). Contributed by Renukaprasad C.

prasad-acit
authored and
Kiran Kumar Maturi
committed
HDFS-16204. Improve FSDirEncryptionZoneOp related parameter comments. (#3368)

jianghuazhu
authored and
Kiran Kumar Maturi
committed
HADOOP-17156. ABFS: Release the byte buffers held by input streams in close() (#3285)

mukund-thakur
authored and
Kiran Kumar Maturi
committed
HADOOP-17894. CredentialProviderFactory.getProviders() recursion loading JCEKS file from S3A (#3393)

steveloughran
authored and
Kiran Kumar Maturi
committed
YARN-10884: Handle empty owners to parse log files (#3318)

authored and
Kiran Kumar Maturi
committed
HDFS-16209. Add description for dfs.namenode.caching.enabled (#3378)

tomscut
authored and
Kiran Kumar Maturi
committed
HADOOP-17897. Allow nested blocks in switch case in checkstyle settings. (#3394)

iwasakims
authored and
Kiran Kumar Maturi
committed
HADOOP-17899. Avoid using implicit dependency on junit-jupiter-api. (#3399)

iwasakims
authored and
Kiran Kumar Maturi
committed
YARN-10576. Update Capacity Scheduler documentation with JSON-based placement mapping. Contributed by Benjamin Teke

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler

brumi1024
authored and
Kiran Kumar Maturi
committed
Add documentation for YARN-10623 auto refresh queue conf in CS (#3279)

zhuqi-lucas
authored and
Kiran Kumar Maturi
committed
YARN-10646. TestCapacitySchedulerWeightMode test descriptor comments doesnt reflect the correct scenario (#3339)

brumi1024
authored and
Kiran Kumar Maturi
committed
YARN-10919. Remove LeafQueue#scheduler field (#3382)

authored and
Kiran Kumar Maturi
committed
YARN-10901. Permission checking error on an existing directory in LogAggregationFileController#verifyAndCreateRemoteLogDir (#3355)

tomicooler
authored and
Kiran Kumar Maturi
committed
HADOOP-17857. Check real user ACLs in addition to proxied user ACLs. Contributed by Eric Payne

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
YARN-10870. Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page. Contributed by Gergely Pollak

szilard-nemeth
authored and
Kiran Kumar Maturi
committed
YARN-10829. Follow up: Adding null checks before merging ResourceUsage Report (#3252)

akshatb1
authored and
Kiran Kumar Maturi
committed
HDFS-16210. RBF: Add the option of refreshCallQueue to RouterAdmin (#3379)

symious
authored and
Kiran Kumar Maturi
committed
HDFS-16207. Remove NN logs stack trace for non-existent xattr query (#3375)

amahussein
authored and
Kiran Kumar Maturi
committed
HADOOP-17887. Remove the wrapper class GzipOutputStream (#3377)

viirya
authored and
Kiran Kumar Maturi
committed
HADOOP-17804. Expose prometheus metrics only after a flush and dedupe with tag values (#3369)

Kimahriman
authored and
Kiran Kumar Maturi
committed
HDFS-16065. RBF: Add metrics to record Router's operations (#3100)

symious
authored and
Kiran Kumar Maturi
committed
YARN-10893. Adding metrics for getClusterMetrics and getApplications APIs in FederationClientInterceptor (#3325)

akshatb1
authored and
Kiran Kumar Maturi
committed
YARN-10914. Simplify duplicated code for tracking ResourceUsage in AbstractCSQueue (#3402)

tomicooler
authored and
Kiran Kumar Maturi
committed
YARN-10910. AbstractCSQueue#setupQueueConfigs: Separate validation logic from initialization logic (#3407)

brumi1024
authored and
Kiran Kumar Maturi
committed
YARN-10852. Optimise CSConfiguration getAllUserWeightsForQueue (#3392)

9uapaw
authored and
Kiran Kumar Maturi
committed
YARN-10872. Replace getPropsWithPrefix calls in AutoCreatedQueueTemplate (#3396)

brumi1024
authored and
Kiran Kumar Maturi
committed
HADOOP-17901. Performance degradation in Text.append() after HADOOP-1… (#3411)

pbacsko
authored and
Kiran Kumar Maturi
committed
HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS (#3346) Contributed by Leon Gao

LeonGao91
authored and
Kiran Kumar Maturi
committed
HADOOP-17904. Test Result Not Working In Jenkins Result. (#3413). Contributed by Ayush Saxena.

ayushtkn
authored and
Kiran Kumar Maturi
committed
HDFS-16221. RBF: Add usage of refreshCallQueue for Router (#3421)

symious
authored and
Kiran Kumar Maturi
committed
HDFS-16197.Simplify getting NNStorage in FSNamesystem. (#3357)

jianghuazhu
authored and
Kiran Kumar Maturi
committed
YARN-10903. Fix the headroom check in ParentQueue and RegularContainerAllocator for DRF (#3352)

JackWangCS
authored and
Kiran Kumar Maturi
committed
YARN-10928. Support default queue config for minimum-user-limit-percent/user-limit-factor (#3389)

zheng-weihao
authored and
Kiran Kumar Maturi
committed
HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing (#3340)

bshashikant
authored and
Kiran Kumar Maturi
committed
HDFS-16223. AvailableSpaceRackFaultTolerantBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. (#3424). Contributed by Ayush Saxena.

ayushtkn
authored and
Kiran Kumar Maturi
committed
HADOOP-17900. Move ClusterStorageCapacityExceededException to Public from LimitedPrivate. (#3404). Contributed by Ayush Saxena.

ayushtkn
authored and
Kiran Kumar Maturi
committed
HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown (#3359)

EungsopYoo
authored and
Kiran Kumar Maturi
committed
HDFS-15920.Solve the problem that the value of SafeModeMonitor#RECHECK_INTERVAL can be configured. (#2831). Contributed by JiangHua Zhu.

jianghuazhu
authored and
Kiran Kumar Maturi
committed
HDFS-16225. Fix typo for FederationTestUtils (#3428). Contributed by tomscut.

tomscut
authored and
Kiran Kumar Maturi
committed
YARN-10912. AbstractCSQueue#updateConfigurableResourceRequirement: Separate validation logic from initialization logic (#3390)

tomicooler
authored and
Kiran Kumar Maturi
committed
YARN-10917. Investigate and simplify CapacitySchedulerConfigValidator#validateQueueHierarchy (#3403)

tomicooler
authored and
Kiran Kumar Maturi
committed
YARN-10915. AbstractCSQueue: Simplify complex logic in methods: deriveCapacityFromAbsoluteConfigurations and updateEffectiveResources (#3418)

brumi1024
authored and
Kiran Kumar Maturi
committed
HADOOP-17891. Exclude snappy-java and lz4-java from relocation in shaded hadoop client libraries (#3385)

viirya
authored and
Kiran Kumar Maturi
committed
HDFS-16181. [SBN Read] Fix display of JournalNode metric RpcRequestCacheMissAmount (#3317)

authored and
Kiran Kumar Maturi
committed
HADOOP-17907. FileUtil#fullyDelete deletes contents of sym-linked directory when symlink cannot be deleted because of local fs fault (#3431). Contributed by Weihao Zheng.

zheng-weihao
authored and
Kiran Kumar Maturi
committed
YARN-10935. AM Total Queue Limit goes below per-user AM Limit if parent is full. Contributed by Eric Payne.

ericbadger
authored and
Kiran Kumar Maturi
committed
HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS (#3406)

mehakmeet
authored and
Kiran Kumar Maturi
committed
Revert "HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS (#3406)" (#3443)

steveloughran
authored and
Kiran Kumar Maturi
committed
HADOOP-17871. S3A CSE: minor tuning (#3412)

mehakmeet
authored and
Kiran Kumar Maturi
committed
HDFS-16203. Discover datanodes with unbalanced block pool usage by the standard deviation (#3366)

tomscut
authored and
Kiran Kumar Maturi
committed
changes to handle NPE and modified serialization and deserialization of span context

kiran-maturi
authored and
Kiran Kumar Maturi
committed
cleanup

kiran-maturi
authored and
Kiran Kumar Maturi
committed
Update hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

authored and
Kiran Kumar Maturi
committed
removed name field for Tracer and moved opentelemetry javaagent to hadoop-tools
Kiran Kumar Maturi
committed

Commits on Nov 25, 2021

Commits on Nov 26, 2021

reverted protobuf.version to 2.5.0
kiran-maturi
committed

Commits on Mar 22, 2022

addressed review comments
kiran-maturi
committed

Commits on Apr 12, 2022

moving opentelemetry javaagent to hadoop tools and added new field in rpcheader for open span context
kiran-maturi
committed

Commits on Jan 12, 2023

Merge branch 'trunk' into HADOOP-15566-javaagent
kiran-maturi
authored

Commits on Dec 2, 2023

Merge branch 'trunk' into HADOOP-15566-javaagent
kiran-maturi
authored