Skip to content

Conversation

@bharathv
Copy link
Contributor

  • HBASE-23648: Re-use underlying connection registry in RawAsyncHBaseAdmin

No need to create and close a new registry on demand. Audited other
usages of getRegistry() and the code looks fine.

  • Fix checkstyle issues in RawAsyncHBaseAdmin

This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.

RPCs exposing it will come in a separate patch as a part of
HBASE-18095.

Signed-off-by: Andrew Purtell <[email protected]>
Signed-off-by: Wellington Chevreuil <[email protected]>
Signed-off-by: Guangxu Cheng <[email protected]>
(cherry picked from commit c2e01f2)
…ache#812)

Currently we just track whether an active master exists.
It helps to also track the address of the active master in
all the masters to help serve the client RPC requests to
know which master is active.

Signed-off-by: Nick Dimiduk <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
(cherry picked from commit efebb84)
* HBASE-23281: Track meta region changes on masters

This patch adds a simple cache that tracks the meta region replica
locations. It keeps an eye on the region movements so that the
cached locations are not stale.

This information is used for servicing client RPCs for connections
that use master based registry (HBASE-18095). The RPC end points
will be added in a separate patch.

Signed-off-by: Nick Dimiduk <[email protected]>
(cherry picked from commit 8571d38)
* HBASE-23304: RPCs needed for client meta information lookup

This patch implements the RPCs needed for the meta information
lookup during connection init. New tests added to cover the RPC
code paths. HBASE-23305 builds on this to implement the client
side logic.

Fixed a bunch of checkstyle nits around the places the patch
touches.

Signed-off-by: Andrew Purtell <[email protected]>
(cherry picked from commit 4f8fbba)
* HBASE-23604: Cleanup AsyncRegistry interface

- Cleans up the method names to make more sense and adds a little
more javadocs for context. In future patches we can revisit
the name of the actual class to make it more self explanatory.

- Does AsyncRegistry -> ConnectionRegistry rename.
"async" ness of the registry is kind of implicit based on
the interface contents and need not be reflected in the name.

Signed-off-by: Nick Dimiduk <[email protected]>
Signed-off-by: stack <[email protected]>
Signed-off-by: Viraj Jasani <[email protected]>
(cherry picked from commit 12bb41e)
…min (apache#994)

* HBASE-23648: Re-use underlying connection registry in RawAsyncHBaseAdmin

No need to create and close a new registry on demand. Audited other
usages of getRegistry() and the code looks fine.

* Fix checkstyle issues in RawAsyncHBaseAdmin

(cherry picked from commit 07c3826)
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 35s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 2s No case conflicting files found.
+0 🆗 prototool 0m 0s prototool was not available.
+1 💚 hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 42 new or modified test files.
_ branch-2 Compile Tests _
+0 🆗 mvndep 0m 15s Maven dependency ordering for branch
+1 💚 mvninstall 5m 14s branch-2 passed
+1 💚 compile 2m 24s branch-2 passed
+1 💚 checkstyle 2m 16s branch-2 passed
+1 💚 shadedjars 4m 21s branch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 1m 33s branch-2 passed
+0 🆗 spotbugs 0m 34s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 7m 42s branch-2 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 15s Maven dependency ordering for patch
+1 💚 mvninstall 4m 52s the patch passed
+1 💚 compile 2m 24s the patch passed
+1 💚 cc 2m 24s the patch passed
+1 💚 javac 2m 24s the patch passed
+1 💚 checkstyle 0m 11s The patch passed checkstyle in hbase-protocol-shaded
+1 💚 checkstyle 0m 40s hbase-client: The patch generated 0 new + 258 unchanged - 13 fixed = 258 total (was 271)
+1 💚 checkstyle 0m 14s The patch passed checkstyle in hbase-zookeeper
+1 💚 checkstyle 1m 10s hbase-server: The patch generated 0 new + 135 unchanged - 13 fixed = 135 total (was 148)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedjars 4m 18s patch has no errors when building our shaded downstream artifacts.
+1 💚 hadoopcheck 15m 27s Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 💚 hbaseprotoc 2m 15s the patch passed
+1 💚 javadoc 1m 32s the patch passed
+1 💚 findbugs 8m 1s the patch passed
_ Other Tests _
+1 💚 unit 0m 42s hbase-protocol-shaded in the patch passed.
-1 ❌ unit 14m 7s hbase-client in the patch failed.
+1 💚 unit 0m 51s hbase-zookeeper in the patch passed.
+1 💚 unit 155m 42s hbase-server in the patch passed.
+1 💚 asflicense 2m 12s The patch does not generate ASF License warnings.
246m 35s
Reason Tests
Failed junit tests hadoop.hbase.client.TestClientNoCluster
Subsystem Report/Notes
Docker Client=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/artifact/out/Dockerfile
GITHUB PR #1100
JIRA Issue HBASE-23648
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile cc hbaseprotoc prototool
uname Linux 5d64d9ac8c9c 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1100/out/precommit/personality/provided.sh
git revision branch-2 / 2d5dfeb
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/artifact/out/patch-unit-hbase-client.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/testReport/
Max. process+thread count 5635 (vs. ulimit of 10000)
modules C: hbase-protocol-shaded hbase-client hbase-zookeeper hbase-server U: .
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@bharathv
Copy link
Contributor Author

bharathv commented Feb 2, 2020

Will be included in #1101

@bharathv bharathv closed this Feb 2, 2020
@bharathv bharathv deleted the HBASE-23648-branch-2 branch February 2, 2020 01:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants