1> [2017-05-03T05:24:17,804][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] [testMasterShutdownDuringSnapshot]: before test
  1> [2017-05-03T05:24:17,804][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] [DedicatedClusterSnapshotRestoreIT#testMasterShutdownDuringSnapshot]: setting up test
  1> [2017-05-03T05:24:17,805][INFO ][o.e.t.InternalTestCluster] Setup InternalTestCluster [TEST-CHILD_VM=[1]-CLUSTER_SEED=[7394296720855640395]-HASH=[A04F8420ED995]-cluster] with seed [669DD1B0E26FA94B] using [0] dedicated masters, [0] (data) nodes and [0] coord only nodes (min_master_nodes are [auto-managed])
  1> [2017-05-03T05:24:17,805][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] [DedicatedClusterSnapshotRestoreIT#testMasterShutdownDuringSnapshot]: all set up test
  1> [2017-05-03T05:24:17,805][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] -->  starting two master nodes and two data nodes
  1> [2017-05-03T05:24:17,807][INFO ][o.e.n.Node               ] [node_tm0] initializing ...
  1> [2017-05-03T05:24:17,814][INFO ][o.e.e.NodeEnvironment    ] [node_tm0] using [3] data paths, mounts [[/var/lib/jenkins (/dev/mapper/earjenkins)]], net usable_space [339.7gb], net total_space [492gb], spins? [unknown], types [ext4]
  1> [2017-05-03T05:24:17,814][INFO ][o.e.e.NodeEnvironment    ] [node_tm0] heap size [491mb], compressed ordinary object pointers [true]
  1> [2017-05-03T05:24:17,816][INFO ][o.e.n.Node               ] [node_tm0] node name [node_tm0], node ID [R1AuoLAaRSCop6yH0hy5ow]
  1> [2017-05-03T05:24:17,816][INFO ][o.e.n.Node               ] [node_tm0] version[6.0.0-alpha1-SNAPSHOT], pid[16478], build[Unknown/Unknown], OS[Linux/4.4.0-66-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_121/25.121-b13]
  1> [2017-05-03T05:24:17,816][INFO ][o.e.n.Node               ] [node_tm0] JVM arguments [-Dfile.encoding=UTF8, -ea, -esa, -Xmx512m, -Xms512m, -XX:MaxDirectMemorySize=512m, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/heapdump, -XX:-OmitStackTraceInFastThrow, -Dtests.prefix=tests, -Dtests.seed=E02060E9AA99A891, -Dtests.security.manager=true, -Djava.io.tmpdir=./temp, -Dtests.gradle=true, -Dtests.artifact=core, -Djava.awt.headless=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dtests.ifNoTests=fail, -Dtests.task=:core:integTest, -Djna.nosys=true, -Dtests.logger.level=WARN, -Djunit4.childvm.cwd=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/testrun/integTest/J1, -Djunit4.childvm.id=1, -Djunit4.childvm.count=3]
  1> [2017-05-03T05:24:17,816][WARN ][o.e.n.Node               ] [node_tm0] version [6.0.0-alpha1-SNAPSHOT] is a pre-release version of Elasticsearch and is not suitable for production
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] no modules loaded
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.node.NodeMocksPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT$TestCustomMetaDataPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.snapshots.mockstore.MockRepository$Plugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.test.ESIntegTestCase$TestSeedPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.test.discovery.TestZenDiscovery$TestPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.test.store.MockFSIndexStore$TestPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.test.transport.MockTransportService$TestPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.transport.AssertingTransportInterceptor$TestPlugin]
  1> [2017-05-03T05:24:17,817][INFO ][o.e.p.PluginsService     ] [node_tm0] loaded plugin [org.elasticsearch.transport.MockTcpTransportPlugin]
  1> [2017-05-03T05:24:17,832][INFO ][o.e.d.DiscoveryModule    ] [node_tm0] using discovery type [test-zen]
  1> [2017-05-03T05:24:17,876][INFO ][o.e.n.Node               ] [node_tm0] initialized
  1> [2017-05-03T05:24:17,877][INFO ][o.e.n.Node               ] [node_tm1] initializing ...
  1> [2017-05-03T05:24:17,884][INFO ][o.e.e.NodeEnvironment    ] [node_tm1] using [3] data paths, mounts [[/var/lib/jenkins (/dev/mapper/earjenkins)]], net usable_space [339.7gb], net total_space [492gb], spins? [unknown], types [ext4]
  1> [2017-05-03T05:24:17,884][INFO ][o.e.e.NodeEnvironment    ] [node_tm1] heap size [491mb], compressed ordinary object pointers [true]
  1> [2017-05-03T05:24:17,885][INFO ][o.e.n.Node               ] [node_tm1] node name [node_tm1], node ID [H8OUIF28RNuunFUDsyv09Q]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.n.Node               ] [node_tm1] version[6.0.0-alpha1-SNAPSHOT], pid[16478], build[Unknown/Unknown], OS[Linux/4.4.0-66-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_121/25.121-b13]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.n.Node               ] [node_tm1] JVM arguments [-Dfile.encoding=UTF8, -ea, -esa, -Xmx512m, -Xms512m, -XX:MaxDirectMemorySize=512m, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/heapdump, -XX:-OmitStackTraceInFastThrow, -Dtests.prefix=tests, -Dtests.seed=E02060E9AA99A891, -Dtests.security.manager=true, -Djava.io.tmpdir=./temp, -Dtests.gradle=true, -Dtests.artifact=core, -Djava.awt.headless=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dtests.ifNoTests=fail, -Dtests.task=:core:integTest, -Djna.nosys=true, -Dtests.logger.level=WARN, -Djunit4.childvm.cwd=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/testrun/integTest/J1, -Djunit4.childvm.id=1, -Djunit4.childvm.count=3]
  1> [2017-05-03T05:24:17,886][WARN ][o.e.n.Node               ] [node_tm1] version [6.0.0-alpha1-SNAPSHOT] is a pre-release version of Elasticsearch and is not suitable for production
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] no modules loaded
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.node.NodeMocksPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT$TestCustomMetaDataPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.snapshots.mockstore.MockRepository$Plugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.test.ESIntegTestCase$TestSeedPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.test.discovery.TestZenDiscovery$TestPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.test.store.MockFSIndexStore$TestPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.test.transport.MockTransportService$TestPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.transport.AssertingTransportInterceptor$TestPlugin]
  1> [2017-05-03T05:24:17,886][INFO ][o.e.p.PluginsService     ] [node_tm1] loaded plugin [org.elasticsearch.transport.MockTcpTransportPlugin]
  1> [2017-05-03T05:24:17,901][INFO ][o.e.d.DiscoveryModule    ] [node_tm1] using discovery type [test-zen]
  1> [2017-05-03T05:24:17,944][INFO ][o.e.n.Node               ] [node_tm1] initialized
  1> [2017-05-03T05:24:17,945][INFO ][o.e.n.Node               ] [node_tm1] starting ...
  1> [2017-05-03T05:24:17,945][INFO ][o.e.n.Node               ] [node_tm0] starting ...
  1> [2017-05-03T05:24:17,948][INFO ][o.e.t.t.MockTransportService] [node_tm0] publish_address {127.0.0.1:9540}, bound_addresses {[::1]:9540}, {127.0.0.1:9540}
  1> [2017-05-03T05:24:17,948][INFO ][o.e.t.t.MockTransportService] [node_tm1] publish_address {127.0.0.1:9541}, bound_addresses {[::1]:9541}, {127.0.0.1:9541}
  1> [2017-05-03T05:24:17,949][INFO ][o.e.t.d.MockZenPing      ] [node_tm0] pinging using mock zen ping
  1> [2017-05-03T05:24:17,949][INFO ][o.e.t.d.MockZenPing      ] [node_tm1] pinging using mock zen ping
  1> [2017-05-03T05:24:17,953][INFO ][o.e.c.s.MasterService    ] [node_tm1] zen-disco-elected-as-master ([1] nodes joined)[{node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}], reason: new_master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, added {{node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540},}
  1> [2017-05-03T05:24:17,954][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] detected_master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, added {{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [1]])
  1> [2017-05-03T05:24:17,955][INFO ][o.e.n.Node               ] [node_tm0] started
  1> [2017-05-03T05:24:17,955][INFO ][o.e.c.s.ClusterApplierService] [node_tm1] new_master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, added {{node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [1] source [zen-disco-elected-as-master ([1] nodes joined)[{node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}]]])
  1> [2017-05-03T05:24:17,955][INFO ][o.e.n.Node               ] [node_tm1] started
  1> [2017-05-03T05:24:17,958][INFO ][o.e.n.Node               ] [node_td2] initializing ...
  1> [2017-05-03T05:24:17,968][INFO ][o.e.g.GatewayService     ] [node_tm1] recovered [0] indices into cluster_state
  1> [2017-05-03T05:24:17,968][INFO ][o.e.e.NodeEnvironment    ] [node_td2] using [3] data paths, mounts [[/var/lib/jenkins (/dev/mapper/earjenkins)]], net usable_space [339.7gb], net total_space [492gb], spins? [unknown], types [ext4]
  1> [2017-05-03T05:24:17,968][INFO ][o.e.e.NodeEnvironment    ] [node_td2] heap size [491mb], compressed ordinary object pointers [true]
  1> [2017-05-03T05:24:17,970][INFO ][o.e.n.Node               ] [node_td2] node name [node_td2], node ID [vcKzH5JwTR2RTH3NIpb4IA]
  1> [2017-05-03T05:24:17,970][INFO ][o.e.n.Node               ] [node_td2] version[6.0.0-alpha1-SNAPSHOT], pid[16478], build[Unknown/Unknown], OS[Linux/4.4.0-66-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_121/25.121-b13]
  1> [2017-05-03T05:24:17,970][INFO ][o.e.n.Node               ] [node_td2] JVM arguments [-Dfile.encoding=UTF8, -ea, -esa, -Xmx512m, -Xms512m, -XX:MaxDirectMemorySize=512m, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/heapdump, -XX:-OmitStackTraceInFastThrow, -Dtests.prefix=tests, -Dtests.seed=E02060E9AA99A891, -Dtests.security.manager=true, -Djava.io.tmpdir=./temp, -Dtests.gradle=true, -Dtests.artifact=core, -Djava.awt.headless=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dtests.ifNoTests=fail, -Dtests.task=:core:integTest, -Djna.nosys=true, -Dtests.logger.level=WARN, -Djunit4.childvm.cwd=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/testrun/integTest/J1, -Djunit4.childvm.id=1, -Djunit4.childvm.count=3]
  1> [2017-05-03T05:24:17,970][WARN ][o.e.n.Node               ] [node_td2] version [6.0.0-alpha1-SNAPSHOT] is a pre-release version of Elasticsearch and is not suitable for production
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] no modules loaded
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.node.NodeMocksPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT$TestCustomMetaDataPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.snapshots.mockstore.MockRepository$Plugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.test.ESIntegTestCase$TestSeedPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.test.discovery.TestZenDiscovery$TestPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.test.store.MockFSIndexStore$TestPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.test.transport.MockTransportService$TestPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.transport.AssertingTransportInterceptor$TestPlugin]
  1> [2017-05-03T05:24:17,971][INFO ][o.e.p.PluginsService     ] [node_td2] loaded plugin [org.elasticsearch.transport.MockTcpTransportPlugin]
  1> [2017-05-03T05:24:17,986][INFO ][o.e.d.DiscoveryModule    ] [node_td2] using discovery type [test-zen]
  1> [2017-05-03T05:24:18,029][INFO ][o.e.n.Node               ] [node_td2] initialized
  1> [2017-05-03T05:24:18,031][INFO ][o.e.n.Node               ] [node_td3] initializing ...
  1> [2017-05-03T05:24:18,038][INFO ][o.e.e.NodeEnvironment    ] [node_td3] using [3] data paths, mounts [[/var/lib/jenkins (/dev/mapper/earjenkins)]], net usable_space [339.7gb], net total_space [492gb], spins? [unknown], types [ext4]
  1> [2017-05-03T05:24:18,038][INFO ][o.e.e.NodeEnvironment    ] [node_td3] heap size [491mb], compressed ordinary object pointers [true]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.n.Node               ] [node_td3] node name [node_td3], node ID [59LnZpQFR4uYWeQcKlQWDQ]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.n.Node               ] [node_td3] version[6.0.0-alpha1-SNAPSHOT], pid[16478], build[Unknown/Unknown], OS[Linux/4.4.0-66-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_121/25.121-b13]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.n.Node               ] [node_td3] JVM arguments [-Dfile.encoding=UTF8, -ea, -esa, -Xmx512m, -Xms512m, -XX:MaxDirectMemorySize=512m, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/heapdump, -XX:-OmitStackTraceInFastThrow, -Dtests.prefix=tests, -Dtests.seed=E02060E9AA99A891, -Dtests.security.manager=true, -Djava.io.tmpdir=./temp, -Dtests.gradle=true, -Dtests.artifact=core, -Djava.awt.headless=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dtests.ifNoTests=fail, -Dtests.task=:core:integTest, -Djna.nosys=true, -Dtests.logger.level=WARN, -Djunit4.childvm.cwd=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu/core/build/testrun/integTest/J1, -Djunit4.childvm.id=1, -Djunit4.childvm.count=3]
  1> [2017-05-03T05:24:18,039][WARN ][o.e.n.Node               ] [node_td3] version [6.0.0-alpha1-SNAPSHOT] is a pre-release version of Elasticsearch and is not suitable for production
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] no modules loaded
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.node.NodeMocksPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT$TestCustomMetaDataPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.snapshots.mockstore.MockRepository$Plugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.test.ESIntegTestCase$TestSeedPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.test.discovery.TestZenDiscovery$TestPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.test.store.MockFSIndexStore$TestPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.test.transport.MockTransportService$TestPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.transport.AssertingTransportInterceptor$TestPlugin]
  1> [2017-05-03T05:24:18,039][INFO ][o.e.p.PluginsService     ] [node_td3] loaded plugin [org.elasticsearch.transport.MockTcpTransportPlugin]
  1> [2017-05-03T05:24:18,048][INFO ][o.e.d.DiscoveryModule    ] [node_td3] using discovery type [test-zen]
  1> [2017-05-03T05:24:18,075][INFO ][o.e.n.Node               ] [node_td3] initialized
  1> [2017-05-03T05:24:18,075][INFO ][o.e.n.Node               ] [node_td2] starting ...
  1> [2017-05-03T05:24:18,075][INFO ][o.e.n.Node               ] [node_td3] starting ...
  1> [2017-05-03T05:24:18,077][INFO ][o.e.t.t.MockTransportService] [node_td3] publish_address {127.0.0.1:9542}, bound_addresses {[::1]:9542}, {127.0.0.1:9542}
  1> [2017-05-03T05:24:18,078][INFO ][o.e.t.t.MockTransportService] [node_td2] publish_address {127.0.0.1:9543}, bound_addresses {[::1]:9543}, {127.0.0.1:9543}
  1> [2017-05-03T05:24:18,078][INFO ][o.e.t.d.MockZenPing      ] [node_td2] pinging using mock zen ping
  1> [2017-05-03T05:24:18,078][INFO ][o.e.t.d.MockZenPing      ] [node_td3] pinging using mock zen ping
  1> [2017-05-03T05:24:18,082][INFO ][o.e.c.s.MasterService    ] [node_tm1] zen-disco-node-join[{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}], reason: added {{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}
  1> [2017-05-03T05:24:18,082][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] added {{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [3]])
  1> [2017-05-03T05:24:18,083][INFO ][o.e.c.s.ClusterApplierService] [node_td2] detected_master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, added {{node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540},{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [3]])
  1> [2017-05-03T05:24:18,086][INFO ][o.e.n.Node               ] [node_td2] started
  1> [2017-05-03T05:24:18,086][INFO ][o.e.c.s.ClusterApplierService] [node_tm1] added {{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [3] source [zen-disco-node-join[{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}]]])
  1> [2017-05-03T05:24:18,087][INFO ][o.e.c.s.MasterService    ] [node_tm1] zen-disco-node-join[{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}], reason: added {{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542},}
  1> [2017-05-03T05:24:18,087][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] added {{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [4]])
  1> [2017-05-03T05:24:18,087][INFO ][o.e.c.s.ClusterApplierService] [node_td3] detected_master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, added {{node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540},{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [4]])
  1> [2017-05-03T05:24:18,087][INFO ][o.e.c.s.ClusterApplierService] [node_td2] added {{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [4]])
  1> [2017-05-03T05:24:18,091][INFO ][o.e.n.Node               ] [node_td3] started
  1> [2017-05-03T05:24:18,092][INFO ][o.e.c.s.ClusterApplierService] [node_tm1] added {{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542},}, reason: apply cluster state (from master [master {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} committed version [4] source [zen-disco-node-join[{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}]]])
  1> [2017-05-03T05:24:18,092][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] -->  creating repository
  1> [2017-05-03T05:24:18,093][INFO ][o.e.r.RepositoriesService] [node_tm1] put repository [test-repo]
  1> [2017-05-03T05:24:18,106][INFO ][o.e.c.m.MetaDataCreateIndexService] [node_tm1] [test-idx] creating index, cause [api], templates [], shards [3]/[0], mappings []
  1> [2017-05-03T05:24:18,126][INFO ][o.e.c.r.a.AllocationService] [node_tm1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[test-idx][2], [test-idx][0], [test-idx][1]] ...]).
  1> [2017-05-03T05:24:18,138][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] --> indexing some data
  1> [2017-05-03T05:24:18,142][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] Index [26] docs async: [true] bulk: [false]
  1> [2017-05-03T05:24:18,147][INFO ][o.e.c.m.MetaDataMappingService] [node_tm1] [test-idx/J7DO_kfWRJStIag2EiL4TQ] create_mapping [type1]
  1> [2017-05-03T05:24:18,232][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] number of shards: 3
  1> [2017-05-03T05:24:18,242][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] --> stopping master node
  1> [2017-05-03T05:24:18,242][INFO ][o.e.t.InternalTestCluster] Closing master node [node_tm1] 
  1> [2017-05-03T05:24:18,245][INFO ][o.e.c.s.ClusterSettings  ] [node_td3] updating [discovery.zen.minimum_master_nodes] from [2] to [1]
  1> [2017-05-03T05:24:18,247][INFO ][o.e.c.s.ClusterSettings  ] [node_td2] updating [discovery.zen.minimum_master_nodes] from [2] to [1]
  1> [2017-05-03T05:24:18,248][INFO ][o.e.c.s.ClusterSettings  ] [node_tm0] updating [discovery.zen.minimum_master_nodes] from [2] to [1]
  1> [2017-05-03T05:24:18,249][INFO ][o.e.c.s.ClusterSettings  ] [node_tm1] updating [discovery.zen.minimum_master_nodes] from [2] to [1]
  1> [2017-05-03T05:24:18,253][INFO ][o.e.s.SnapshotShardsService] [node_tm1] snapshot [test-repo:test-snap/wadI9XFAQxqeQH3LxPD7Lw] is done
  1> [2017-05-03T05:24:18,255][INFO ][o.e.n.Node               ] [node_tm1] stopping ...
  1> [2017-05-03T05:24:18,255][INFO ][o.e.t.d.TestZenDiscovery ] [node_tm0] master_left [{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}], reason [shut_down]
  1> [2017-05-03T05:24:18,256][WARN ][o.e.t.d.TestZenDiscovery ] [node_tm0] master left (reason = shut_down), current nodes: nodes: 
  1>    {node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}
  1>    {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}, local
  1>    {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, master
  1>    {node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}
  1> [2017-05-03T05:24:18,257][INFO ][o.e.t.d.MockZenPing      ] [node_tm0] pinging using mock zen ping
  1> [2017-05-03T05:24:18,259][INFO ][o.e.t.d.TestZenDiscovery ] [node_td2] master_left [{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}], reason [transport disconnected]
  1> [2017-05-03T05:24:18,259][INFO ][o.e.t.d.TestZenDiscovery ] [node_td3] master_left [{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}], reason [transport disconnected]
  1> [2017-05-03T05:24:18,259][WARN ][o.e.t.d.TestZenDiscovery ] [node_td2] master left (reason = transport disconnected), current nodes: nodes: 
  1>    {node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}
  1>    {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}
  1>    {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, master
  1>    {node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}, local
  1> [2017-05-03T05:24:18,259][WARN ][o.e.t.d.TestZenDiscovery ] [node_td3] master left (reason = transport disconnected), current nodes: nodes: 
  1>    {node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}, local
  1>    {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}
  1>    {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}, master
  1>    {node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}
  1> [2017-05-03T05:24:18,260][INFO ][o.e.t.d.MockZenPing      ] [node_td3] pinging using mock zen ping
  1> [2017-05-03T05:24:18,260][INFO ][o.e.n.Node               ] [node_tm1] stopped
  1> [2017-05-03T05:24:18,260][INFO ][o.e.n.Node               ] [node_tm1] closing ...
  1> [2017-05-03T05:24:18,260][INFO ][o.e.t.d.MockZenPing      ] [node_td2] pinging using mock zen ping
  1> [2017-05-03T05:24:18,260][WARN ][o.e.c.NodeConnectionsService] [node_td3] failed to connect to node {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} (tried [1] times)
  1> org.elasticsearch.transport.ConnectTransportException: [node_tm1][127.0.0.1:9541] general node connection failure
  1> 	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:531) ~[main/:?]
  1> 	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:453) ~[main/:?]
  1> 	at org.elasticsearch.test.transport.MockTransportService$LookupTestTransport.connectToNode(MockTransportService.java:511) ~[framework-6.0.0-alpha1-SNAPSHOT.jar:6.0.0-alpha1-SNAPSHOT]
  1> 	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:328) ~[main/:?]
  1> 	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[main/:?]
  1> 	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) ~[main/:?]
  1> 	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) ~[main/:?]
  1> 	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) ~[main/:?]
  1> 	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[main/:?]
  1> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_121]
  1> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_121]
  1> 	at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_121]
  1> Caused by: java.net.ConnectException: Connection refused (Connection refused)
  1> 	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_121]
  1> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_121]
  1> 	at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_121]
  1> 	at org.elasticsearch.mocksocket.MockSocket.access$101(MockSocket.java:32) ~[mocksocket-1.1.jar:?]
  1> 	at org.elasticsearch.mocksocket.MockSocket.lambda$connect$0(MockSocket.java:66) ~[mocksocket-1.1.jar:?]
  1> 	at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_121]
  1> 	at org.elasticsearch.mocksocket.MockSocket.connect(MockSocket.java:65) ~[mocksocket-1.1.jar:?]
  1> 	at org.elasticsearch.transport.MockTcpTransport.connectToChannels(MockTcpTransport.java:204) ~[framework-6.0.0-alpha1-SNAPSHOT.jar:?]
  1> 	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:514) ~[main/:?]
  1> 	... 11 more
  1> [2017-05-03T05:24:18,262][INFO ][o.e.n.Node               ] [node_tm1] closed
  1> [2017-05-03T05:24:18,262][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] --> wait until the snapshot is done
  1> [2017-05-03T05:24:18,263][WARN ][o.e.c.NodeConnectionsService] [node_td2] failed to connect to node {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} (tried [1] times)
  1> org.elasticsearch.transport.ConnectTransportException: [node_tm1][127.0.0.1:9541] general node connection failure
  1> 	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:531) ~[main/:?]
  1> 	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:453) ~[main/:?]
  1> 	at org.elasticsearch.test.transport.MockTransportService$LookupTestTransport.connectToNode(MockTransportService.java:511) ~[framework-6.0.0-alpha1-SNAPSHOT.jar:6.0.0-alpha1-SNAPSHOT]
  1> 	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:328) ~[main/:?]
  1> 	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[main/:?]
  1> 	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) ~[main/:?]
  1> 	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) ~[main/:?]
  1> 	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) ~[main/:?]
  1> 	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[main/:?]
  1> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_121]
  1> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_121]
  1> 	at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_121]
  1> Caused by: java.net.ConnectException: Connection refused (Connection refused)
  1> 	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_121]
  1> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_121]
  1> 	at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_121]
  1> 	at org.elasticsearch.mocksocket.MockSocket.access$101(MockSocket.java:32) ~[mocksocket-1.1.jar:?]
  1> 	at org.elasticsearch.mocksocket.MockSocket.lambda$connect$0(MockSocket.java:66) ~[mocksocket-1.1.jar:?]
  1> 	at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_121]
  1> 	at org.elasticsearch.mocksocket.MockSocket.connect(MockSocket.java:65) ~[mocksocket-1.1.jar:?]
  1> 	at org.elasticsearch.transport.MockTcpTransport.connectToChannels(MockTcpTransport.java:204) ~[framework-6.0.0-alpha1-SNAPSHOT.jar:?]
  1> 	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:514) ~[main/:?]
  1> 	... 11 more
  1> [2017-05-03T05:24:21,258][INFO ][o.e.c.s.MasterService    ] [node_tm0] zen-disco-elected-as-master ([0] nodes joined), reason: new_master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}
  1> [2017-05-03T05:24:21,259][INFO ][o.e.c.s.ClusterApplierService] [node_td2] detected_master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [14]])
  1> [2017-05-03T05:24:21,259][INFO ][o.e.c.s.ClusterApplierService] [node_td3] detected_master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [14]])
  1> [2017-05-03T05:24:21,261][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] new_master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [14] source [zen-disco-elected-as-master ([0] nodes joined)]])
  1> [2017-05-03T05:24:21,262][WARN ][o.e.c.NodeConnectionsService] [node_tm0] failed to connect to node {node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} (tried [1] times)
  1> org.elasticsearch.transport.ConnectTransportException: [node_tm1][127.0.0.1:9541] general node connection failure
  1> 	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:531) ~[main/:?]
  1> 	at org.elasticsearch.transport.TcpTransport.connectToNode(TcpTransport.java:453) ~[main/:?]
  1> 	at org.elasticsearch.test.transport.MockTransportService$LookupTestTransport.connectToNode(MockTransportService.java:511) ~[framework-6.0.0-alpha1-SNAPSHOT.jar:6.0.0-alpha1-SNAPSHOT]
  1> 	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:328) ~[main/:?]
  1> 	at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:315) ~[main/:?]
  1> 	at org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:154) ~[main/:?]
  1> 	at org.elasticsearch.cluster.NodeConnectionsService$1.doRun(NodeConnectionsService.java:107) ~[main/:?]
  1> 	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) ~[main/:?]
  1> 	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[main/:?]
  1> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_121]
  1> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_121]
  1> 	at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_121]
  1> Caused by: java.net.ConnectException: Connection refused (Connection refused)
  1> 	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_121]
  1> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_121]
  1> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_121]
  1> 	at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_121]
  1> 	at org.elasticsearch.mocksocket.MockSocket.access$101(MockSocket.java:32) ~[mocksocket-1.1.jar:?]
  1> 	at org.elasticsearch.mocksocket.MockSocket.lambda$connect$0(MockSocket.java:66) ~[mocksocket-1.1.jar:?]
  1> 	at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_121]
  1> 	at org.elasticsearch.mocksocket.MockSocket.connect(MockSocket.java:65) ~[mocksocket-1.1.jar:?]
  1> 	at org.elasticsearch.transport.MockTcpTransport.connectToChannels(MockTcpTransport.java:204) ~[framework-6.0.0-alpha1-SNAPSHOT.jar:?]
  1> 	at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:514) ~[main/:?]
  1> 	... 11 more
  1> [2017-05-03T05:24:21,266][INFO ][o.e.c.s.MasterService    ] [node_tm0] zen-disco-node-failed({node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}), reason(transport disconnected)[{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} transport disconnected], reason: removed {{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},}
  1> [2017-05-03T05:24:21,267][INFO ][o.e.c.s.ClusterApplierService] [node_td2] removed {{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [15]])
  1> [2017-05-03T05:24:21,267][INFO ][o.e.c.s.ClusterApplierService] [node_td3] removed {{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [15]])
  1> [2017-05-03T05:24:21,268][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] removed {{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541},}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [15] source [zen-disco-node-failed({node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541}), reason(transport disconnected)[{node_tm1}{H8OUIF28RNuunFUDsyv09Q}{wTgUVedsQhaPyr5YgXnLCg}{127.0.0.1}{127.0.0.1:9541} transport disconnected]]])
  1> [2017-05-03T05:25:26,826][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] [DedicatedClusterSnapshotRestoreIT#testMasterShutdownDuringSnapshot]: cleaning up after test
  1> [2017-05-03T05:25:26,834][INFO ][o.e.c.m.MetaDataDeleteIndexService] [node_tm0] [test-idx/J7DO_kfWRJStIag2EiL4TQ] deleting index
  1> [2017-05-03T05:25:26,836][INFO ][o.e.t.s.MockFSIndexStore$Listener] [node_td2] [test-idx][0] start check index
  1> [2017-05-03T05:25:26,836][INFO ][o.e.t.s.MockFSIndexStore$Listener] [node_td3] [test-idx][1] start check index
  1> [2017-05-03T05:25:26,840][INFO ][o.e.t.s.MockFSIndexStore$Listener] [node_td3] [test-idx][1] end check index
  1> [2017-05-03T05:25:26,840][INFO ][o.e.t.s.MockFSIndexStore$Listener] [node_td2] [test-idx][0] end check index
  1> [2017-05-03T05:25:26,859][INFO ][o.e.t.s.MockFSIndexStore$Listener] [node_td2] [test-idx][2] start check index
  1> [2017-05-03T05:25:26,885][INFO ][o.e.t.s.MockFSIndexStore$Listener] [node_td2] [test-idx][2] end check index
  1> [2017-05-03T05:25:26,941][INFO ][o.e.r.RepositoriesService] [node_tm0] delete repository [test-repo]
  1> [2017-05-03T05:25:26,957][INFO ][o.e.n.Node               ] [node_td2] stopping ...
  1> [2017-05-03T05:25:31,958][INFO ][o.e.c.s.MasterService    ] [node_tm0] zen-disco-node-left({node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}), reason(left)[{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543} left], reason: removed {{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}
  1> [2017-05-03T05:25:31,959][INFO ][o.e.n.Node               ] [node_td2] stopped
  1> [2017-05-03T05:25:31,959][INFO ][o.e.n.Node               ] [node_td2] closing ...
  1> [2017-05-03T05:25:31,959][INFO ][o.e.c.s.ClusterApplierService] [node_td3] removed {{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [19]])
  1> [2017-05-03T05:25:31,963][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] removed {{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543},}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [19] source [zen-disco-node-left({node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543}), reason(left)[{node_td2}{vcKzH5JwTR2RTH3NIpb4IA}{qdvspW6hTCSnLwnp36Tckg}{127.0.0.1}{127.0.0.1:9543} left]]])
  1> [2017-05-03T05:25:31,963][INFO ][o.e.n.Node               ] [node_td2] closed
  1> [2017-05-03T05:25:31,963][INFO ][o.e.n.Node               ] [node_td3] stopping ...
  1> [2017-05-03T05:25:36,964][INFO ][o.e.c.s.MasterService    ] [node_tm0] zen-disco-node-left({node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}), reason(left)[{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542} left], reason: removed {{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542},}
  1> [2017-05-03T05:25:36,964][INFO ][o.e.c.s.ClusterApplierService] [node_tm0] removed {{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542},}, reason: apply cluster state (from master [master {node_tm0}{R1AuoLAaRSCop6yH0hy5ow}{gnKB3tYwSmacxHU6Tz6_DA}{127.0.0.1}{127.0.0.1:9540} committed version [20] source [zen-disco-node-left({node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542}), reason(left)[{node_td3}{59LnZpQFR4uYWeQcKlQWDQ}{cKQyccTtTIK4S8BQBYsG2g}{127.0.0.1}{127.0.0.1:9542} left]]])
  1> [2017-05-03T05:25:36,965][INFO ][o.e.n.Node               ] [node_td3] stopped
  1> [2017-05-03T05:25:36,966][INFO ][o.e.n.Node               ] [node_td3] closing ...
  1> [2017-05-03T05:25:36,967][INFO ][o.e.n.Node               ] [node_td3] closed
  1> [2017-05-03T05:25:36,968][INFO ][o.e.n.Node               ] [node_tm0] stopping ...
  1> [2017-05-03T05:25:36,969][INFO ][o.e.n.Node               ] [node_tm0] stopped
  1> [2017-05-03T05:25:36,969][INFO ][o.e.n.Node               ] [node_tm0] closing ...
  1> [2017-05-03T05:25:36,970][INFO ][o.e.n.Node               ] [node_tm0] closed
  1> [2017-05-03T05:25:36,970][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] [DedicatedClusterSnapshotRestoreIT#testMasterShutdownDuringSnapshot]: cleaned up after test
  1> [2017-05-03T05:25:36,970][INFO ][o.e.s.DedicatedClusterSnapshotRestoreIT] [testMasterShutdownDuringSnapshot]: after test
FAILURE 79.2s J1 | DedicatedClusterSnapshotRestoreIT.testMasterShutdownDuringSnapshot <<< FAILURES!
   > Throwable #1: java.lang.AssertionError
   > 	at __randomizedtesting.SeedInfo.seed([E02060E9AA99A891:3C6AF618D64DD3B1]:0)
   > 	at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 	at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:716)
   > 	at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.testMasterShutdownDuringSnapshot(DedicatedClusterSnapshotRestoreIT.java:765)
   > 	at java.lang.Thread.run(Thread.java:745)
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more
   > 	Suppressed: java.lang.AssertionError
   > 		at org.elasticsearch.snapshots.DedicatedClusterSnapshotRestoreIT.lambda$testMasterShutdownDuringSnapshot$0(DedicatedClusterSnapshotRestoreIT.java:768)
   > 		at org.elasticsearch.test.ESTestCase.assertBusy(ESTestCase.java:704)
   > 		... 38 more