HDDS-9400. Introduce DatanodeID to avoid passing UUID/String object in SCM#5417

Merged

adoroszlai merged 79 commits intoapache:masterfrom

nandakumar131:HDDS-9400

Feb 11, 2025

Commits on Jan 4, 2025

Commits on Jan 24, 2025

Merge branch 'master' into HDDS-9400
nandakumar131
authored

Commits on Feb 10, 2025

HDDS-12130. Improve assertion compatibility with old Hadoop (#7738)

adoroszlai
authored and
nandakumar131
committed
HDDS-12131. NPE in OM when overwriting empty file using multipart upload (#7739)

k5342
authored and
nandakumar131
committed
HDDS-12089. Move execute_debug_tests out of testlib.sh (#7744)

adoroszlai
authored and
nandakumar131
committed
HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier (#7726)

sodonnel
authored and
nandakumar131
committed
HDDS-12081. TestKeyInputStream repeats tests with default container layout (#7704)

adoroszlai
authored and
nandakumar131
committed
HDDS-12138. Bump assertj-core to 3.27.3 (#7751)

dependabot[bot]
authored and
nandakumar131
committed
HDDS-12098. Bump Hugo to 0.141.0 (#7731)

adoroszlai
authored and
nandakumar131
committed
HDDS-12122. Add unit test for SnapshotChainRepair (#7741)

peterxcli
authored and
nandakumar131
committed
HDDS-11798. Move SafeModeRule names to respective rules (#7742)
nandakumar131
committed
HDDS-12115. RM selects replicas to delete non-deterministically if nodes are overloaded (#7728)

sodonnel
authored and
nandakumar131
committed
HDDS-11892. Remove config from SCM for disabling Ratis. (#7711)
nandakumar131
committed
HDDS-12135. Set RM default deadline to 12 minutes and datanode offset to 6 minutes (#7747)

sodonnel
authored and
nandakumar131
committed
HDDS-12099. Generate kubernetes Robot report in container (#7754)

chiacyu
authored and
nandakumar131
committed
HDDS-12117. Create endpoint builders for S3G tests (#7753)

peterxcli
authored and
nandakumar131
committed
HDDS-12084. Persist currently selected UI type (new/old) between refreshes (#7705)

devabhishekpal
authored and
nandakumar131
committed
HDDS-11837. Support executing multiple commands in Ozone CLI (#7727)

adoroszlai
authored and
nandakumar131
committed
HDDS-12032. Remove DefaultConfigManager from SCM. (#7757)
nandakumar131
committed
HDDS-12139. Refactor TestSnapshotChainRepair. (#7752)

adoroszlai
authored and
nandakumar131
committed
HDDS-12127. RM should not expire pending deletes, but retry until delete is confirmed or node is dead (#7746)

sodonnel
authored and
nandakumar131
committed
HDDS-12141. Replace direct dependency on hadoop-hdfs-client (#7762)

adoroszlai
authored and
nandakumar131
committed
HDDS-12140. Replace leftover rebot in k8s/examples/test-all.sh (#7756)

adoroszlai
authored and
nandakumar131
committed
HDDS-11125. Do not log user-controlled data in HddsConfServlet (#7767)

len548
authored and
nandakumar131
committed
HDDS-12147. Remove server dependencies from hdds-tools (#7771)

adoroszlai
authored and
nandakumar131
committed
HDDS-12116. Customizable prefix for shaded protobuf in ozonefs-hadoop3-client (#7729)

apotheque
authored and
nandakumar131
committed
HDDS-12010. Block ozone repair if service is running (#7758)

adoroszlai
authored and
nandakumar131
committed
HDDS-12155. Create new submodule for ozone shell (#7775)

adoroszlai
authored and
nandakumar131
committed
HDDS-12162. Log available space of HddsVolume and DbVolume upon Datanode startup (#7777)

smengcl
authored and
nandakumar131
committed
HDDS-12143. Generate list of integration check splits dynamically (#7766)

adoroszlai
authored and
nandakumar131
committed
HDDS-12040. `ozone freon cr` fails with NPE in ReplicationSupervisor (#7776)

len548
authored and
nandakumar131
committed
HDDS-12144. Remove unsupported replication types from config description (#7764)

adoroszlai
authored and
nandakumar131
committed
HDDS-11277. Remove dependency on hadoop-hdfs in Ozone client (#7781)

adoroszlai
authored and
nandakumar131
committed
HDDS-12132. Parameterize testUpdateTransactionInfoTable for SCM (#7768)

sarvekshayr
authored and
nandakumar131
committed
HDDS-12085. Add manual refresh button for DU page (#7780)

devabhishekpal
authored and
nandakumar131
committed
HDDS-12165. Refactor VolumeInfoMetrics to use getCurrentUsage (#7784)

adoroszlai
authored and
nandakumar131
committed
HDDS-12181. Bump jline to 3.29.0 (#7789)

dependabot[bot]
authored and
nandakumar131
committed
HDDS-12176. Trivial dependency cleanup.(#7787)

adoroszlai
authored and
nandakumar131
committed
HDDS-12163. Reduce number of individual getCapacity/getAvailable/getUsedSpace calls (#7790)

adoroszlai
authored and
nandakumar131
committed
HDDS-12142. Save logs from build check (#7782)

adoroszlai
authored and
nandakumar131
committed
HDDS-12073. Don't show Source Bucket and Volume if null in DU metadata (#7760)

devabhishekpal
authored and
nandakumar131
committed
HDDS-11508. Decouple delete batch limits from Ratis request size for DirectoryDeletingService. (#7365)

sadanand48
authored and
nandakumar131
committed
HDDS-12186. Avoid array allocation for table iterator. (#7797)

sadanand48
authored and
nandakumar131
committed
HDDS-12186. (addendum) Avoid array allocation for table iterator (#7799)

adoroszlai
authored and
nandakumar131
committed
HDDS-11714. resetDeletedBlockRetryCount with --all may fail and can cause long db lock in large cluster. (#7665)

aryangupta1998
authored and
nandakumar131
committed
HDDS-12183. Reuse cluster across safe test classes (#7793)

adoroszlai
authored and
nandakumar131
committed
HDDS-12203. Initialize block length before skip (#7809)

oneonestar
authored and
nandakumar131
committed
HDDS-12202. OpsCreate and OpsAppend metrics not incremented (#7811)

peterxcli
authored and
nandakumar131
committed
HDDS-12200. Fix grammar in OM HA, EC and Snapshot doc (#7806)

sreejasahithi
authored and
nandakumar131
committed
HDDS-12195. Implement skip() in OzoneFSInputStream (#7801)

oneonestar
authored and
nandakumar131
committed
HDDS-12212. Fix grammar in decommissioning and observability documentation (#7815)

Gargi-jais11
authored and
nandakumar131
committed
HDDS-12112. Fix interval used for Chunk Read/Write Dashboard (#7724)

kerneltime
authored and
nandakumar131
committed
HDDS-11442. Add dashboard for memory consumption metrics (#7198)

len548
authored and
nandakumar131
committed
HDDS-12159. Remove redundant seek for rocksDBs (#7794)

authored and
nandakumar131
committed
HDDS-7003. Make read-replicas tool compatible with EC replication type (#7528)

len548
authored and
nandakumar131
committed
HDDS-10607. Remove unused config property ozone.block.deleting.container.limit.per.interval (#7816)

sreejasahithi
authored and
nandakumar131
committed
HDDS-12044. Fix heatmap calendar closing on skipping years/months (#7812)

devabhishekpal
authored and
nandakumar131
committed
HDDS-12221. Remove unused config property ozone.block.deleting.limit.per.task (#7823)

Gargi-jais11
authored and
nandakumar131
committed
HDDS-12217. Remove reference to FileUtil in hdds-common. (#7818)

adoroszlai
authored and
nandakumar131
committed
HDDS-12231. Logging in Container Balancer is too verbose. (#7826)

siddhantsangwan
authored and
nandakumar131
committed
HDDS-12033. ScmHAUnfinalizedStateValidationAction can be remove as it's not used (#7820)

jojochuang
authored and
nandakumar131
committed
HDDS-11866. Remove code paths for non-Ratis OM (#7778)

adoroszlai
authored and
nandakumar131
committed
HDDS-12218. Add more to integration test with shared cluster (#7821)

adoroszlai
authored and
nandakumar131
committed
HDDS-12227. Avoid Clutter in Recon Logs by Reducing Log Level of ContainerSizeCountTask. (#7825)

ArafatKhan2198
authored and
nandakumar131
committed
HDDS-12228. Fix Duplicate Key Violation Condition in FileSizeCountTask. (#7824)

ArafatKhan2198
authored and
nandakumar131
committed
HDDS-12180. Store snapshot in CachingSpaceUsageSource (#7798)

adoroszlai
authored and
nandakumar131
committed
HDDS-12230. Improve error message in `ozone sh key put` when file not found (#7829)

sreejasahithi
authored and
nandakumar131
committed
HDDS-12232. Move container from QUASI_CLODED to CLOSED only when SCM sees all 3 origin node replicas (#7834)

authored and
nandakumar131
committed
HDDS-12149. Do not require dependency-convergence. (#7772)

adoroszlai
authored and
nandakumar131
committed
HDDS-11784. Allow aborting FSO multipart uploads with missing parent directories (#7700)

sokui
authored and
nandakumar131
committed
HDDS-12205. Reduce log level in TestHSync (#7838)

chiacyu
authored and
nandakumar131
committed
HDDS-12287. Bump sqlite-jdbc to 3.49.0.0 (#7839)

dependabot[bot]
authored and
nandakumar131
committed
HDDS-12248. Make allowListAllVolumes reconfigurable in OM (#7837)

adoroszlai
authored and
nandakumar131
committed
HDDS-12292. Change log level in SCMNodeManager#getNodesByAddress to debug. (#7843)
nandakumar131
committed
Fixed review comments.
nandakumar131
committed
Fixed typo in hdds.proto
nandakumar131
committed
Merge remote-tracking branch 'upstream' into HDDS-9400
nandakumar131
committed

Commits on Feb 11, 2025

Use StringWithByteString to store UUID String.
nandakumar131
committed