Skip to content

Conversation

@fapifta
Copy link
Contributor

@fapifta fapifta commented Jan 24, 2022

What changes were proposed in this pull request?

As part of HDDS-5954, we have investigated the gRPC client and how it works, to see how we should tune its behaviour for erasure coded storage. At the end of the day, we decided to do not change the gRPC client and how it works in general, but we would like to document what we have found, and considered.
This PR contains our learnt knowledge, it removes the TODO comments from the XceiverClientGrpc class, and extends the APIDoc related to this class as well as adds a broader readme content about how the client works with the rest of the code.
Code changes to fix some IDE warnings along with documentation changes are:

  • internal variables that do not change were made to be final,
  • connect method with the token parameter made to call the parameterless version, as they duplicated the same code, and none used the token parameter,
  • two unnecessary null value assignments were removed as they did not have any effect.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-6217

How was this patch tested?

Not applicable, there weren't any semantical changes made to the code.

@fapifta fapifta changed the title HDDS-5954. EC: Review the TODOs in GRPC Xceiver client and fix them. HDDS-6217. Cleanup XceiverClientGrpc TODOs, and document how the client works and should be used. Jan 24, 2022
@adoroszlai adoroszlai merged commit 5dd64f3 into apache:master Jul 1, 2022
@adoroszlai
Copy link
Contributor

Thanks @fapifta for the cleanup and writeup.

errose28 added a commit to errose28/ozone that referenced this pull request Jul 12, 2022
* master: (46 commits)
  HDDS-6901. Configure HDDS volume reserved as percentage of the volume space. (apache#3532)
  HDDS-6978. EC: Cleanup RECOVERING container on DN restarts (apache#3585)
  HDDS-6982. EC: Attempt to cleanup the RECOVERING container when reconstruction failed at coordinator. (apache#3583)
  HDDS-6968. Addendum: [Multi-Tenant] Fix USER_MISMATCH error even on correct user. (apache#3578)
  HDDS-6794. EC: Analyze and add putBlock even on non writing node in the case of partial single stripe. (apache#3514)
  HDDS-6900. Propagate TimeoutException for all SCM HA Ratis calls. (apache#3564)
  HDDS-6938. handle NPE when removing prefixAcl (apache#3568)
  HDDS-6960. EC: Implement the Over-replication Handler (apache#3572)
  HDDS-6979. Remove unused plexus dependency declaration (apache#3579)
  HDDS-6957. EC: ReplicationManager - priortise under replicated containers (apache#3574)
  HDDS-6723. Close Rocks objects properly in OzoneManager (apache#3400)
  HDDS-6942. Ozone Buckets/Objects created via S3 should not allow group access (apache#3553)
  HDDS-6965. Increase timeout for basic check (apache#3563)
  HDDS-6969. Add link to compose directory in smoketest README (apache#3567)
  HDDS-6970. EC: Ensure DatanodeAdminMonitor can handle EC containers during decommission (apache#3573)
  HDDS-6977. EC: Remove references to ContainerReplicaPendingOps in TestECContainerReplicaCount (apache#3575)
  HDDS-6217. Cleanup XceiverClientGrpc TODOs, and document how the client works and should be used. (apache#3012)
  HDDS-6773. Cleanup TestRDBTableStore (apache#3434) - fix checkstyle
  HDDS-6773. Cleanup TestRDBTableStore (apache#3434)
  HDDS-6676. KeyValueContainerData#getProtoBufMessage() should set block count (apache#3371)
  ...

Conflicts:
    hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/upgrade/SCMUpgradeFinalizer.java
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants