Skip to content

Conversation

@kerneltime
Copy link
Contributor

@kerneltime kerneltime commented Jun 2, 2022

What changes were proposed in this pull request?

Revert the upgrade of RocksDB across a major version bump
This is to avoid memory leaks due to lack of close for
RocksObject inherited objects.

The upgrade should be done only once the leaks have been fixed.
Without the leak fix, the newer version of RocksDB makes it impossible
to run any long-running load.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-6828

How was this patch tested?

This is the older release train. I ran a basic build and waiting for CI run.

Copy link
Contributor

@jojochuang jojochuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 6.29.5 is the last 6.x release and does not have the resource leak bug.

@jojochuang
Copy link
Contributor

@kerneltime in fact, we should probably file another jira for the revert specifically.

Revert the upgrade of RocksDB across a major version bump
This is to avoid memory leakds due to lack of close for
RocksObject inherited objects.

Change-Id: I50d9de0303b30d4221c49eb45e8b3bdf9290ad9f
@kerneltime
Copy link
Contributor Author

@kerneltime in fact, we should probably file another jira for the revert specifically.

Done.

@kerneltime kerneltime changed the title HDDS-5821 Revert RockDB version pending leak fixes HDDS-6828 Revert RockDB version pending leak fixes Jun 2, 2022
@jojochuang jojochuang merged commit db867de into apache:master Jun 2, 2022
errose28 added a commit to errose28/ozone that referenced this pull request Jun 7, 2022
* master: (87 commits)
  HDDS-6686. Do Leadship check before SASL token verification. (apache#3382)
  HDDS-4364: [FSO]List FileStatus : startKey can be a non-existed path (apache#3481)
  HDDS-6091. Add file checksum to OmKeyInfo (apache#3201)
  HDDS-6706. Exposing Volume Information Metrics to the DataNode UI (apache#3478)
  HDDS-6759: Add listblock API in MockDatanodeStorage (apache#3452)
  HDDS-5821 Container cache management for closing RockDB  (apache#3426)
  HDDS-6683. Refactor OM server bucket layout configuration usage (apache#3477)
  HDDS-6824. Revert changes made in proto.lock by HDDS-6768. (apache#3480)
  HDDS-6811. Bucket create message with layout type (apache#3479)
  HDDS-6810. Add a optional flag to trigger listStatus as part of listKeys for FSO buckets. (apache#3461)
  HDDS-6828. Revert RockDB version pending leak fixes (apache#3475)
  HDDS-6764: EC: DN ability to create RECOVERING containers for EC reconstruction. (apache#3458)
  HDDS-6795: EC: PipelineStateMap#addPipeline should not have precondition checks post db updates (apache#3453)
  HDDS-6823. Intermittent failure in TestOzoneECClient#testExcludeOnDNMixed (apache#3476)
  HDDS-6820. Bucket Layout Post-Finalization Validators for ACL Requests. (apache#3472)
  HDDS-6819. Add LEGACY to AllowedBucketLayouts in CreateBucketHandler (apache#3473)
  HDDS-4859. [FSO]ListKeys: seek all the files/dirs from startKey to keyPrefix (apache#3466)
  HDDS-6705 Add metrics for volume statistics including disk capacity, usage, Reserved (apache#3430)
  HDDS-6474. Add test to cover the FSO bucket list status with beyond batch boundary and cache. (apache#3379). Contributed by aswinshakil
  HDDS-6280. Support Container Balancer HA (apache#3423)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants