Skip to content

Conversation

@apurtell
Copy link
Contributor

See description on #2669

this.socket.bind(this.rpcClient.localAddr);
}
NetUtils.connect(this.socket, remoteId.getAddress(), this.rpcClient.connectTO);
if (this.rpcClient.metrics != null) {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change fixes a bug we encountered in production while running in Amazon's Elastic Kubernetes Service.

private void connect() throws UnknownHostException {
if (LOG.isDebugEnabled()) {
LOG.debug("Connecting to " + remoteId.address);
LOG.debug("Connecting to " + remoteId.getAddress());
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 6m 38s Docker failed to build yetus/hbase:b249092a5f.
Subsystem Report/Notes
GITHUB PR #2671
Console output https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/1/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 0m 7s Docker failed to build yetus/hbase:b249092a5f.
Subsystem Report/Notes
GITHUB PR #2671
Console output https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/2/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@apurtell apurtell force-pushed the HBASE-25292-branch-1 branch from 7d95a26 to d927435 Compare November 18, 2020 22:20
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 0m 9s Docker failed to build yetus/hbase:b249092a5f.
Subsystem Report/Notes
GITHUB PR #2671
Console output https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/3/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 6m 28s Docker failed to build yetus/hbase:b249092a5f.
Subsystem Report/Notes
GITHUB PR #2671
Console output https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/4/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

apurtell and others added 3 commits November 25, 2020 14:48
Network identities should be bound late. Remote addresses should be
resolved at the last possible moment, just before connect(). Network
identity mappings can change, so our code should not inappropriately
cache them. Otherwise we might miss a change and fail to operate normally.

Revert "HBASE-14544 Allow HConnectionImpl to not refresh the dns on errors"
Removes hbase.resolve.hostnames.on.failure and related code. We always
resolve hostnames, as late as possible.

Preserve InetSocketAddress caching per RPC connection. Avoids potential
lookups per Call.

Replace InetSocketAddress with Address where used as a map key. If we want
to key by hostname and/or resolved address we should be explicit about it.
Using Address chooses mapping by hostname and port only.

Add metrics for potential nameservice resolution attempts, whenever an
InetSocketAddress is instantiated for connect; and metrics for failed
resolution, whenever InetSocketAddress#isUnresolved on the new instance
is true.
@apurtell apurtell force-pushed the HBASE-25292-branch-1 branch from f23a7f2 to 56a4cd1 Compare November 25, 2020 22:49
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 8m 7s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ branch-1 Compile Tests _
+0 🆗 mvndep 2m 23s Maven dependency ordering for branch
+1 💚 mvninstall 8m 40s branch-1 passed
+1 💚 compile 2m 0s branch-1 passed with JDK Azul Systems, Inc.-1.8.0_262-b19
+1 💚 compile 2m 17s branch-1 passed with JDK Azul Systems, Inc.-1.7.0_272-b10
+1 💚 checkstyle 4m 6s branch-1 passed
+1 💚 shadedjars 4m 19s branch has no errors when building our shaded downstream artifacts.
+1 💚 javadoc 1m 51s branch-1 passed with JDK Azul Systems, Inc.-1.8.0_262-b19
+1 💚 javadoc 2m 13s branch-1 passed with JDK Azul Systems, Inc.-1.7.0_272-b10
+0 🆗 spotbugs 3m 43s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 7m 55s branch-1 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 23s Maven dependency ordering for patch
+1 💚 mvninstall 2m 29s the patch passed
+1 💚 compile 1m 54s the patch passed with JDK Azul Systems, Inc.-1.8.0_262-b19
+1 💚 javac 1m 54s the patch passed
+1 💚 compile 2m 14s the patch passed with JDK Azul Systems, Inc.-1.7.0_272-b10
-1 ❌ javac 0m 56s hbase-server-jdkAzulSystems,Inc.-1.7.0_272-b10 with JDK Azul Systems, Inc.-1.7.0_272-b10 generated 2 new + 4 unchanged - 2 fixed = 6 total (was 6)
-1 ❌ checkstyle 0m 48s hbase-client: The patch generated 1 new + 168 unchanged - 3 fixed = 169 total (was 171)
-1 ❌ checkstyle 2m 7s hbase-server: The patch generated 1 new + 108 unchanged - 1 fixed = 109 total (was 109)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedjars 4m 2s patch has no errors when building our shaded downstream artifacts.
+1 💚 hadoopcheck 6m 17s Patch does not cause any errors with Hadoop 2.8.5 2.9.2.
+1 💚 javadoc 1m 49s the patch passed with JDK Azul Systems, Inc.-1.8.0_262-b19
+1 💚 javadoc 2m 6s the patch passed with JDK Azul Systems, Inc.-1.7.0_272-b10
+1 💚 findbugs 6m 35s the patch passed
_ Other Tests _
+1 💚 unit 2m 55s hbase-common in the patch passed.
+1 💚 unit 2m 45s hbase-client in the patch passed.
-1 ❌ unit 92m 31s hbase-server in the patch failed.
+1 💚 unit 0m 33s hbase-external-blockcache in the patch passed.
+1 💚 asflicense 1m 34s The patch does not generate ASF License warnings.
181m 32s
Reason Tests
Failed junit tests hadoop.hbase.client.TestConnectionImplementation
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/artifact/out/Dockerfile
GITHUB PR #2671
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 151ce7cf0760 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-home/workspace/Base-PreCommit-GitHub-PR_PR-2671/out/precommit/personality/provided.sh
git revision branch-1 / 30d988f
Default Java Azul Systems, Inc.-1.7.0_272-b10
Multi-JDK versions /usr/lib/jvm/zulu-8-amd64:Azul Systems, Inc.-1.8.0_262-b19 /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_272-b10
javac https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/artifact/out/diff-compile-javac-hbase-server-jdkAzulSystems,Inc.-1.7.0_272-b10.txt
checkstyle https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/artifact/out/diff-checkstyle-hbase-client.txt
checkstyle https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/artifact/out/diff-checkstyle-hbase-server.txt
unit https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/artifact/out/patch-unit-hbase-server.txt
Test Results https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/testReport/
Max. process+thread count 3698 (vs. ulimit of 10000)
modules C: hbase-common hbase-client hbase-server hbase-external-blockcache U: .
Console output https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2671/5/console
versions git=1.9.1 maven=3.0.5 findbugs=3.0.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@apurtell
Copy link
Contributor Author

apurtell commented Dec 4, 2020

#2669 was merged, closing this and picking back the master commit.

@apurtell apurtell closed this Dec 4, 2020
@apurtell apurtell deleted the HBASE-25292-branch-1 branch December 4, 2020 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants