Skip to content

Conversation

@GeorgeJahad
Copy link
Contributor

What changes were proposed in this pull request?

Fix bug that creates extraneous snapshot directories

ls -ld /data/metadata/db.snapshots/db*
drwxr-xr-x 2 hadoop hadoop 4096 Mar 22 03:27 /data/metadata/db.snapshots/db.checkpoints
drwxr-xr-x 2 hadoop hadoop 4096 Mar 22 03:27 /data/metadata/db.snapshots/db.snapshots

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-8237

How was this patch tested?

Ran 'ls' again as above.

@adoroszlai adoroszlai added the snapshot https://issues.apache.org/jira/browse/HDDS-6517 label Mar 22, 2023
@neils-dev neils-dev added the gr label Mar 22, 2023
Copy link
Contributor

@hemantk-12 hemantk-12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the patch @GeorgeJahad.

+1.

Left couple of minor comments.

Copy link
Contributor

@prashantpogde prashantpogde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with a minor nit.

@prashantpogde
Copy link
Contributor

@GeorgeJahad Can you please resolve the conflict ?

Copy link
Contributor

@smengcl smengcl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @GeorgeJahad for taking care of this.

@smengcl
Copy link
Contributor

smengcl commented Apr 5, 2023

CI passed on @GeorgeJahad 's fork's branch: https://github.com/GeorgeJahad/ozone/actions/runs/4613253792

But there are some (seemingly irrelevant) flakiness in PR CI:

https://github.com/apache/ozone/actions/runs/4613253988/jobs/8155048388

Error:  Failures: 
Error:    TestContainerStateCounts.testDeletedContainerCount:383 expected: <5> but was: <2>

https://github.com/apache/ozone/actions/runs/4613253988/jobs/8155259011

Error:  Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.3.5:version-info (version-info) on project ozone-common: java.util.ConcurrentModificationException -> [Help 1]

Retriggered PR CI.

@smengcl
Copy link
Contributor

smengcl commented Apr 5, 2023

Thanks @hemantk-12 and @prashantpogde for reviewing this.

@smengcl smengcl merged commit 05d9d85 into apache:master Apr 5, 2023
errose28 added a commit to errose28/ozone that referenced this pull request Apr 6, 2023
* master: (155 commits)
  update readme (apache#4535)
  HDDS-8374. Disable flaky unit test: TestContainerStateCounts
  HDDS-8016. updated the ozone doc for linked bucket and deletion async limitation (apache#4526)
  HDDS-8237. [Snapshot] loadDb() used by SstFiltering service creates extraneous directories. (apache#4446)
  HDDS-8035. Intermittent timeout in TestOzoneManagerHAWithData.testOMHAMetrics (apache#4362)
  HDDS-8039. Allow container inspector to run from ozone debug. (apache#4337)
  HDDS-8304. [Snapshot] Reduce flakiness in testSkipTrackingWithZeroSnapshot (apache#4487)
  HDDS-7974. [Snapshot] KeyDeletingService to be aware of Ozone snapshots (apache#4486)
  HDDS-8368. ReplicationManager: Create ContainerReplicaOp with correct target Datanode (apache#4532)
  HDDS-8358. Fix the space usage comparator in ContainerBalancerSelectionCriteria (apache#4527)
  HDDS-8359. ReplicationManager: Fix getContainerReplicationHealth() so that it builds ContainerCheckRequest correctly (apache#4528)
  HDDS-8361. Useless object in TestOzoneBlockTokenIdentifier (apache#4517)
  HDDS-8325. Consolidate and refine RocksDB metrics of services (apache#4506)
  HDDS-8135. Incorrect synchronization during certificate renewal in DefaultCertificateClient. (apache#4381)
  HDDS-8127. Exclude deleted containers from Recon container count (apache#4440)
  HDDS-8364. ReadReplicas may give wrong results with topology-aware read enabled (apache#4522)
  HDDS-8354. Avoid WARNING about ObjectEndpoint#get (apache#4515)
  HDDS-8324. DN data cache gets removed randomly asking for data from disk (apache#4499)
  HDDS-8291. Upgrade to Hadoop 3.3.5 (apache#4484)
  HDDS-8355. Mark TestOMRatisSnapshots#testInstallSnapshot as flaky
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

snapshot https://issues.apache.org/jira/browse/HDDS-6517

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants