Skip to content

Conversation

@jojochuang
Copy link
Contributor

What changes were proposed in this pull request?

HDDS-11260. [hsync] Add Ozone Manager protocol version

Please describe your PR in detail:
Add a new Ozone Manager layout version HBASE_SUPPORT and prevent clients to submit HBase related requests (hsync, listOpenFiles, recoverLease) to OM if OM isn't upgraded yet.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-11260

How was this patch tested?

@jojochuang jojochuang requested a review from ashishkumar50 July 31, 2024 22:48
@jojochuang jojochuang marked this pull request as ready for review August 1, 2024 00:19
Copy link
Contributor

@errose28 errose28 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this @jojochuang

@jojochuang
Copy link
Contributor Author

Address review comments.

  1. Remove the redundant typecast from ClientProtocol to RpcClient.
  2. Replace IOException with UnsupportedOperationException for better application handling.
  3. Better exception description.

Please enter the commit message for your changes. Lines starting

Copy link
Contributor

@ChenSammi ChenSammi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @jojochuang . Waiting for CI to pass.

Change-Id: Id9a7ca230708451e2d78a43e2da26c4dd8f554d2
Change-Id: Id6c63ef31fa30698eca2ce53f5fdbf95c9aef5d2
… don't support HBASE_SUPPORT protocol version.

Change-Id: I2dcf1c8d1903e521c91bc4cb0c6570ab4057d81e
1. Remove the redundant typecast from ClientProtocol to RpcClient.
2. Replace IOException with UnsupportedOperationException for better application handling.
3. Better exception description.

Change-Id: Icb54c1b616820f8d93d6db9dc90c8dea4a6c19e1
@jojochuang
Copy link
Contributor Author

The PR CI passed but I still want to double check.
Rebase the PR after HDDS-11258. Waiting for CI

Copy link
Contributor

@errose28 errose28 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates, LGTM

@jojochuang jojochuang merged commit 7828ba3 into apache:HDDS-7593 Aug 2, 2024
@jojochuang
Copy link
Contributor Author

Merged. Thanks @errose28 and @ChenSammi

@smengcl
Copy link
Contributor

smengcl commented Aug 2, 2024

Thanks @jojochuang for the patch.

errose28 added a commit to errose28/ozone that referenced this pull request Aug 7, 2024
* master: (181 commits)
  HDDS-11289. Bump docker-maven-plugin to 0.45.0 (apache#7024)
  HDDS-11287. Code cleanup in XceiverClientSpi (apache#7043)
  HDDS-11283. Refactor KeyValueStreamDataChannel to avoid spurious IDE build issues (apache#7040)
  HDDS-11257. Ozone write does not work when http proxy is set for the JVM. (apache#7036)
  HDDS-11249. Bump ozone-runner to 20240729-jdk17-1 (apache#7003)
  HDDS-10517. Recon - Add a UI component for showing DN decommissioning detailed status and info (apache#6724)
  HDDS-11270. [hsync] Add DN layout version (HBASE_SUPPORT/version 8) upgrade test. (apache#7021)
  HDDS-11272. Statistics some node status information (apache#7025)
  HDDS-11278. Move code out of Hadoop util package (apache#7028)
  HDDS-11274. (addendum) Replace Hadoop annotations/configs with Ozone-specific ones
  HDDS-11274. Replace Hadoop annotations/configs with Ozone-specific ones (apache#7026)
  HDDS-11280. Add Synchronize in AbstractCommitWatcher.addAckDataLength (apache#7032)
  HDDS-11235. Spare InfoBucket RPC call in FileSystem#mkdir() call. (apache#6990)
  HDDS-11273. Bump commons-compress to 1.26.2 (apache#7023)
  HDDS-11225. Increase ipc.server.read.threadpool.size (apache#7007)
  HDDS-11224. Increase hdds.datanode.handler.count (apache#7011)
  HDDS-11259. [hsync] DataNode should verify HBASE_SUPPORT layout version for every PutBlock. (apache#7012)
  HDDS-11214. Added config to set rocksDB's max log file size and num of log files (apache#7014)
  HDDS-11226. Make ExponentialBackoffPolicy maxRetries configurable (apache#6985)
  HDDS-11260. [hsync] Add Ozone Manager protocol version (apache#7015)
  ...

Conflicts:
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/audit/DNAction.java
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueHandler.java
hadoop-hdds/interface-client/src/main/proto/DatanodeClientProtocol.proto
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/TestContainerReportHandler.java
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants