Skip to content

Conversation

@bharatviswa504
Copy link
Contributor

…fer.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 33 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 63 Maven dependency ordering for branch
+1 mvninstall 541 trunk passed
+1 compile 291 trunk passed
+1 checkstyle 89 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 890 branch has no errors when building and testing our client artifacts.
+1 javadoc 145 trunk passed
0 spotbugs 290 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 475 trunk passed
_ Patch Compile Tests _
0 mvndep 26 Maven dependency ordering for patch
+1 mvninstall 478 the patch passed
+1 compile 280 the patch passed
+1 cc 280 the patch passed
+1 javac 280 the patch passed
-0 checkstyle 48 hadoop-ozone: The patch generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 678 patch has no errors when building and testing our client artifacts.
-1 javadoc 84 hadoop-ozone generated 4 new + 5 unchanged - 0 fixed = 9 total (was 5)
-1 findbugs 200 hadoop-hdds generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
_ Other Tests _
-1 unit 163 hadoop-hdds in the patch failed.
-1 unit 1255 hadoop-ozone in the patch failed.
+1 asflicense 61 The patch does not generate ASF License warnings.
6430
Reason Tests
FindBugs module:hadoop-hdds
Synchronization performed on java.util.concurrent.ConcurrentHashMap in org.apache.hadoop.utils.db.cache.PartialTableCache.evictCache(long) At PartialTableCache.java:org.apache.hadoop.utils.db.cache.PartialTableCache.evictCache(long) At PartialTableCache.java:[line 92]
Synchronization performed on java.util.concurrent.ConcurrentHashMap in org.apache.hadoop.utils.db.cache.PartialTableCache.put(CacheKey, CacheValue) At PartialTableCache.java:org.apache.hadoop.utils.db.cache.PartialTableCache.put(CacheKey, CacheValue) At PartialTableCache.java:[line 68]
Failed junit tests hadoop.ozone.client.rpc.TestBCSID
hadoop.ozone.client.rpc.TestBlockOutputStreamWithFailures
hadoop.ozone.container.common.impl.TestContainerPersistence
hadoop.hdds.scm.pipeline.TestSCMPipelineManager
hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc
uname Linux a563a699b14a 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 55e0c13
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/artifact/out/diff-checkstyle-hadoop-ozone.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
findbugs https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/artifact/out/new-findbugs-hadoop-hdds.html
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/testReport/
Max. process+thread count 4426 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/1/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504
Copy link
Contributor Author

Fixed findbug and checkstyle issues.
For test failures related to TestReplicationManager opened HDDS-1599.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 540 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 68 Maven dependency ordering for branch
+1 mvninstall 522 trunk passed
+1 compile 247 trunk passed
+1 checkstyle 61 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 823 branch has no errors when building and testing our client artifacts.
+1 javadoc 183 trunk passed
0 spotbugs 288 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 478 trunk passed
_ Patch Compile Tests _
0 mvndep 73 Maven dependency ordering for patch
+1 mvninstall 478 the patch passed
+1 compile 276 the patch passed
+1 cc 276 the patch passed
+1 javac 276 the patch passed
-0 checkstyle 46 hadoop-hdds: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 3 The patch has no ill-formed XML file.
+1 shadedclient 663 patch has no errors when building and testing our client artifacts.
-1 javadoc 69 hadoop-ozone generated 4 new + 5 unchanged - 0 fixed = 9 total (was 5)
+1 findbugs 496 the patch passed
_ Other Tests _
-1 unit 143 hadoop-hdds in the patch failed.
-1 unit 1009 hadoop-ozone in the patch failed.
-1 asflicense 61 The patch generated 17 ASF License warnings.
6590
Reason Tests
Failed junit tests hadoop.ozone.container.common.impl.TestContainerPersistence
hadoop.ozone.client.rpc.TestBCSID
hadoop.ozone.web.client.TestKeys
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 9c7a1764a1e1 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / ec92ca6
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/artifact/out/diff-checkstyle-hadoop-hdds.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 5319 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/4/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 46 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 78 Maven dependency ordering for branch
+1 mvninstall 555 trunk passed
+1 compile 248 trunk passed
+1 checkstyle 70 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 840 branch has no errors when building and testing our client artifacts.
+1 javadoc 149 trunk passed
0 spotbugs 300 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 496 trunk passed
_ Patch Compile Tests _
0 mvndep 28 Maven dependency ordering for patch
+1 mvninstall 507 the patch passed
+1 compile 272 the patch passed
+1 cc 272 the patch passed
+1 javac 272 the patch passed
+1 checkstyle 71 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 1 The patch has no ill-formed XML file.
+1 shadedclient 660 patch has no errors when building and testing our client artifacts.
-1 javadoc 77 hadoop-ozone generated 4 new + 5 unchanged - 0 fixed = 9 total (was 5)
+1 findbugs 522 the patch passed
_ Other Tests _
+1 unit 285 hadoop-hdds in the patch passed.
-1 unit 1649 hadoop-ozone in the patch failed.
-1 asflicense 49 The patch generated 17 ASF License warnings.
6811
Reason Tests
Failed junit tests hadoop.ozone.container.common.impl.TestContainerPersistence
hadoop.ozone.client.rpc.TestBCSID
hadoop.ozone.client.rpc.TestOzoneAtRestEncryption
hadoop.ozone.web.client.TestKeys
hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient
hadoop.ozone.om.TestOzoneManagerHA
hadoop.ozone.container.common.statemachine.commandhandler.TestBlockDeletion
hadoop.ozone.container.ozoneimpl.TestOzoneContainer
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/5/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 599bea7f4f9a 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 06fa4d2
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/5/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/5/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/5/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-850/5/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 4212 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/5/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504 bharatviswa504 force-pushed the HDDS-1551-1 branch 2 times, most recently from 02a1a2d to f763e1e Compare May 29, 2019 20:48
@bharatviswa504
Copy link
Contributor Author

/retest

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 39 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 71 Maven dependency ordering for branch
+1 mvninstall 554 trunk passed
+1 compile 258 trunk passed
+1 checkstyle 63 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 791 branch has no errors when building and testing our client artifacts.
+1 javadoc 143 trunk passed
0 spotbugs 303 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 491 trunk passed
_ Patch Compile Tests _
0 mvndep 29 Maven dependency ordering for patch
+1 mvninstall 483 the patch passed
+1 compile 263 the patch passed
+1 cc 263 the patch passed
+1 javac 263 the patch passed
+1 checkstyle 71 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 2 The patch has no ill-formed XML file.
+1 shadedclient 630 patch has no errors when building and testing our client artifacts.
-1 javadoc 73 hadoop-ozone generated 4 new + 5 unchanged - 0 fixed = 9 total (was 5)
+1 findbugs 503 the patch passed
_ Other Tests _
+1 unit 242 hadoop-hdds in the patch passed.
-1 unit 1007 hadoop-ozone in the patch failed.
+1 asflicense 57 The patch does not generate ASF License warnings.
5964
Reason Tests
Failed junit tests hadoop.hdds.scm.pipeline.TestSCMPipelineManager
hadoop.ozone.client.rpc.TestOzoneRpcClient
hadoop.ozone.client.rpc.TestFailureHandlingByClient
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/6/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 1d3000f18253 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 751f0df
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/6/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/6/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/6/testReport/
Max. process+thread count 5137 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/6/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 29 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 22 Maven dependency ordering for branch
+1 mvninstall 501 trunk passed
+1 compile 253 trunk passed
+1 checkstyle 67 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 807 branch has no errors when building and testing our client artifacts.
+1 javadoc 136 trunk passed
0 spotbugs 286 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 469 trunk passed
_ Patch Compile Tests _
0 mvndep 32 Maven dependency ordering for patch
+1 mvninstall 486 the patch passed
+1 compile 271 the patch passed
+1 cc 271 the patch passed
+1 javac 271 the patch passed
+1 checkstyle 68 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 2 The patch has no ill-formed XML file.
+1 shadedclient 667 patch has no errors when building and testing our client artifacts.
-1 javadoc 73 hadoop-ozone generated 4 new + 5 unchanged - 0 fixed = 9 total (was 5)
+1 findbugs 557 the patch passed
_ Other Tests _
+1 unit 250 hadoop-hdds in the patch passed.
-1 unit 1515 hadoop-ozone in the patch failed.
+1 asflicense 48 The patch does not generate ASF License warnings.
6502
Reason Tests
Failed junit tests hadoop.ozone.client.rpc.TestCommitWatcher
hadoop.ozone.web.client.TestKeys
hadoop.ozone.client.rpc.TestContainerStateMachine
hadoop.ozone.om.TestOzoneManagerHA
hadoop.ozone.client.rpc.TestSecureOzoneRpcClient
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/7/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux db3c35b0cc9f 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 0ead209
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/7/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/7/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/7/testReport/
Max. process+thread count 3812 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/7/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 31 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 67 Maven dependency ordering for branch
+1 mvninstall 561 trunk passed
+1 compile 296 trunk passed
+1 checkstyle 70 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 839 branch has no errors when building and testing our client artifacts.
+1 javadoc 145 trunk passed
0 spotbugs 337 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 543 trunk passed
_ Patch Compile Tests _
0 mvndep 31 Maven dependency ordering for patch
+1 mvninstall 504 the patch passed
+1 compile 288 the patch passed
+1 cc 288 the patch passed
+1 javac 288 the patch passed
+1 checkstyle 80 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 1 The patch has no ill-formed XML file.
+1 shadedclient 661 patch has no errors when building and testing our client artifacts.
-1 javadoc 80 hadoop-ozone generated 4 new + 5 unchanged - 0 fixed = 9 total (was 5)
+1 findbugs 513 the patch passed
_ Other Tests _
+1 unit 229 hadoop-hdds in the patch passed.
-1 unit 2229 hadoop-ozone in the patch failed.
+1 asflicense 56 The patch does not generate ASF License warnings.
7485
Reason Tests
Failed junit tests hadoop.hdds.scm.pipeline.TestNodeFailure
hadoop.ozone.client.rpc.TestKeyInputStream
hadoop.ozone.om.TestOmBlockVersioning
hadoop.ozone.client.rpc.TestSecureOzoneRpcClient
hadoop.ozone.om.TestContainerReportWithKeys
hadoop.hdds.scm.pipeline.TestPipelineClose
hadoop.hdds.scm.pipeline.TestSCMPipelineManager
hadoop.ozone.om.TestOmInit
hadoop.ozone.client.rpc.TestFailureHandlingByClient
hadoop.hdds.scm.pipeline.TestSCMRestart
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/8/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux d715f54a540b 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 0ead209
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/8/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/8/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/8/testReport/
Max. process+thread count 3668 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/8/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 85 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 23 Maven dependency ordering for branch
+1 mvninstall 757 trunk passed
+1 compile 329 trunk passed
+1 checkstyle 82 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 982 branch has no errors when building and testing our client artifacts.
+1 javadoc 159 trunk passed
0 spotbugs 335 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 556 trunk passed
_ Patch Compile Tests _
0 mvndep 26 Maven dependency ordering for patch
+1 mvninstall 527 the patch passed
+1 compile 282 the patch passed
+1 cc 282 the patch passed
+1 javac 282 the patch passed
+1 checkstyle 71 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 2 The patch has no ill-formed XML file.
+1 shadedclient 641 patch has no errors when building and testing our client artifacts.
-1 javadoc 72 hadoop-ozone generated 3 new + 5 unchanged - 0 fixed = 8 total (was 5)
+1 findbugs 537 the patch passed
_ Other Tests _
+1 unit 263 hadoop-hdds in the patch passed.
-1 unit 1407 hadoop-ozone in the patch failed.
+1 asflicense 43 The patch does not generate ASF License warnings.
7085
Reason Tests
Failed junit tests hadoop.ozone.client.rpc.TestWatchForCommit
hadoop.ozone.om.TestScmSafeMode
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/9/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 05439e3af54b 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 0ead209
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/9/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/9/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/9/testReport/
Max. process+thread count 4948 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/9/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

Copy link
Contributor

@hanishakoneru hanishakoneru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @bharatviswa504 for working on this.
I have a few comments, mostly NitPicks.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

commitSetBucketPropertyInfoToDB() just calls commitCreateBucketInfoToDB() without any modification. We can directly call commitCreateBucketInfoToDB() here (and maybe rename it to commitBucketInfoToDB ? ).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How are these exceptions handled currently?

Copy link
Contributor Author

@bharatviswa504 bharatviswa504 May 30, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently using ratisClient there is a TODO for RaftRetry failure exception, and I don't see anything being done for handling NotReplicatedException.

NotReplicatedException is thrown only for watch type requests. So, this exception will be never thrown in our HA case, as requests submitted through HA are Write requests.

RaftRetryFailure exception is thrown only from RatisClient, when using server this exception will not be thrown.

If you have any more comments, will update the TODO in next patch or I will take care of that in next jira if you are okay with it.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should it not be Status.valueOf()? Or does this also give the same result?

Copy link
Contributor Author

@bharatviswa504 bharatviswa504 May 30, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here ordinal gives Position, and from that position finding the value from Status.values() (This return array of Status)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

newCreateBucketInfo.setBucketInfo is done later. Should only set the creation time here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need a volume lock here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Acquired volume lock here, so that deleteVolume cannot happen while creating bucket.

Take a scenario: volume created, then delete Volume and Create bucket in that volume came in parallel. If we don't acquire volume lock, there might be a chance to create a bucket in a deletd volume.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OMDummyCreateBucketResponse seems to be doing the same thing as OMBucketCreateResponse. Why do we need 2 different tests?

Copy link
Contributor Author

@bharatviswa504 bharatviswa504 May 30, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is added based on Arpit's comment in HDDS-1512. As we want to test OM Double Buffer Implementation without actual OM Responses too.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo: request is invalid

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can remove the prefix "OzoneManagerProtocolProtos" here (to avoid confusion)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo: createSet...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bucketName is not used here.
Can we rename this method to something like addVolumeToDB?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@bharatviswa504
Copy link
Contributor Author

Thank You @hanishakoneru for the review.
I have addressed the review comments. For some of the questions, replied my answers.

@bharatviswa504
Copy link
Contributor Author

/retest

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 29 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 62 Maven dependency ordering for branch
+1 mvninstall 535 trunk passed
+1 compile 269 trunk passed
+1 checkstyle 70 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 838 branch has no errors when building and testing our client artifacts.
+1 javadoc 136 trunk passed
0 spotbugs 297 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 491 trunk passed
_ Patch Compile Tests _
0 mvndep 28 Maven dependency ordering for patch
+1 mvninstall 462 the patch passed
+1 compile 266 the patch passed
+1 cc 266 the patch passed
+1 javac 266 the patch passed
+1 checkstyle 76 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 1 The patch has no ill-formed XML file.
+1 shadedclient 635 patch has no errors when building and testing our client artifacts.
-1 javadoc 75 hadoop-ozone generated 3 new + 5 unchanged - 0 fixed = 8 total (was 5)
+1 findbugs 487 the patch passed
_ Other Tests _
+1 unit 232 hadoop-hdds in the patch passed.
-1 unit 1506 hadoop-ozone in the patch failed.
+1 asflicense 44 The patch does not generate ASF License warnings.
6491
Reason Tests
Failed junit tests hadoop.ozone.client.rpc.TestBCSID
hadoop.ozone.TestContainerStateMachineIdempotency
hadoop.ozone.client.rpc.TestHybridPipelineOnDatanode
hadoop.ozone.TestMiniChaosOzoneCluster
hadoop.ozone.client.rpc.TestOzoneAtRestEncryption
hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/10/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 07534816c8d6 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 9ad7cad
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/10/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/10/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/10/testReport/
Max. process+thread count 3661 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/10/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 30 Docker mode activated.
_ Prechecks _
+1 dupname 2 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 15 new or modified test files.
_ trunk Compile Tests _
0 mvndep 62 Maven dependency ordering for branch
+1 mvninstall 515 trunk passed
+1 compile 279 trunk passed
+1 checkstyle 85 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 824 branch has no errors when building and testing our client artifacts.
+1 javadoc 134 trunk passed
0 spotbugs 292 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 477 trunk passed
_ Patch Compile Tests _
0 mvndep 35 Maven dependency ordering for patch
+1 mvninstall 474 the patch passed
+1 compile 259 the patch passed
+1 cc 259 the patch passed
+1 javac 259 the patch passed
-0 checkstyle 47 hadoop-ozone: The patch generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 1 The patch has no ill-formed XML file.
+1 shadedclient 673 patch has no errors when building and testing our client artifacts.
-1 javadoc 84 hadoop-ozone generated 3 new + 5 unchanged - 0 fixed = 8 total (was 5)
+1 findbugs 496 the patch passed
_ Other Tests _
-1 unit 243 hadoop-hdds in the patch failed.
-1 unit 1283 hadoop-ozone in the patch failed.
+1 asflicense 40 The patch does not generate ASF License warnings.
6371
Reason Tests
Failed junit tests hadoop.hdds.scm.block.TestBlockManager
hadoop.hdds.scm.pipeline.TestRatisPipelineProvider
hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 9e24913aea1c 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 9ad7cad
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/artifact/out/diff-checkstyle-hadoop-ozone.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/testReport/
Max. process+thread count 4580 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/11/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504
Copy link
Contributor Author

/retest

@bharatviswa504
Copy link
Contributor Author

Last commit change is moved all the classes to package named bucket under request/response.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 0 Docker mode activated.
-1 patch 11 #850 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.
Subsystem Report/Notes
GITHUB PR #850
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/13/console
versions git=1.9.1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 33 Docker mode activated.
_ Prechecks _
+1 dupname 2 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 17 new or modified test files.
_ trunk Compile Tests _
0 mvndep 67 Maven dependency ordering for branch
+1 mvninstall 535 trunk passed
+1 compile 285 trunk passed
+1 checkstyle 79 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 803 branch has no errors when building and testing our client artifacts.
+1 javadoc 138 trunk passed
0 spotbugs 292 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 482 trunk passed
-0 patch 335 Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
_ Patch Compile Tests _
0 mvndep 26 Maven dependency ordering for patch
+1 mvninstall 468 the patch passed
+1 compile 271 the patch passed
+1 cc 271 the patch passed
+1 javac 271 the patch passed
+1 checkstyle 75 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 659 patch has no errors when building and testing our client artifacts.
-1 javadoc 73 hadoop-ozone generated 3 new + 5 unchanged - 0 fixed = 8 total (was 5)
+1 findbugs 488 the patch passed
_ Other Tests _
+1 unit 219 hadoop-hdds in the patch passed.
-1 unit 1438 hadoop-ozone in the patch failed.
+1 asflicense 43 The patch does not generate ASF License warnings.
6422
Reason Tests
Failed junit tests hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
hadoop.ozone.client.rpc.TestBCSID
hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/12/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc
uname Linux f83fce47c780 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / c1caab4
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/12/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/12/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/12/testReport/
Max. process+thread count 4372 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/12/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504
Copy link
Contributor Author

/retest

@bharatviswa504
Copy link
Contributor Author

Rebased with trunk.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 29 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 17 new or modified test files.
_ trunk Compile Tests _
0 mvndep 25 Maven dependency ordering for branch
+1 mvninstall 596 trunk passed
+1 compile 323 trunk passed
+1 checkstyle 86 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 952 branch has no errors when building and testing our client artifacts.
+1 javadoc 168 trunk passed
0 spotbugs 348 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 588 trunk passed
-0 patch 398 Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
_ Patch Compile Tests _
0 mvndep 30 Maven dependency ordering for patch
+1 mvninstall 539 the patch passed
+1 compile 301 the patch passed
+1 cc 301 the patch passed
+1 javac 301 the patch passed
-0 checkstyle 40 hadoop-ozone: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 761 patch has no errors when building and testing our client artifacts.
-1 javadoc 77 hadoop-ozone generated 3 new + 5 unchanged - 0 fixed = 8 total (was 5)
+1 findbugs 536 the patch passed
_ Other Tests _
+1 unit 239 hadoop-hdds in the patch passed.
-1 unit 1276 hadoop-ozone in the patch failed.
+1 asflicense 83 The patch does not generate ASF License warnings.
6952
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/15/artifact/out/Dockerfile
GITHUB PR #850
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc
uname Linux 5e8e3ead135c 4.4.0-139-generic #165~14.04.1-Ubuntu SMP Wed Oct 31 10:55:11 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 30c6dd9
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-850/15/artifact/out/diff-checkstyle-hadoop-ozone.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-850/15/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-850/15/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-850/15/testReport/
Max. process+thread count 5232 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/15/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hanishakoneru
Copy link
Contributor

Thank you @bharatviswa504 . +1 pending CI.

@bharatviswa504
Copy link
Contributor Author

bharatviswa504 commented May 30, 2019

Thank You @hanishakoneru for the review.
CI has already run for this. Checkstyle in OzoneManagerRequestHandler.java is related to this PR, will take care of it during commit.

@bharatviswa504 bharatviswa504 merged commit c965f7f into apache:trunk May 30, 2019
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 29 Docker mode activated.
-1 patch 14 #850 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-850/16/artifact/out/Dockerfile
GITHUB PR #850
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-850/16/console
versions git=2.7.4
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504
Copy link
Contributor Author

I have committed this to the trunk.
Thank You @hanishakoneru for the review.

shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
Author: Jagadish <[email protected]>

Reviewers: Jagadish<[email protected]>

Closes apache#850 from vjagadish1989/website-reorg37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants