FAILED: DowningClusteredTests.test_stopLeader_by_leaveSelfNode_shouldPropagateToOtherNodes #1018
Description
21:43:00 <EXPR>:0: error: DowningClusteredTests.test_stopLeader_by_leaveSelfNode_shouldPropagateToOtherNodes : threw error "
21:43:00 try await self.joinNodes(node: first, with: second, ensureMembers: .up)
21:43:00 ^~~~~~
21:43:00 error: MembershipError(awaitStatusTimedOut(20.0 seconds, Optional(DistributedActors.Cluster.MembershipError.statusRequirementNotMet(expected: DistributedActors.Cluster.MemberStatus.up, found: Member(sact://second:[email protected]:9002, status: joining, reachability: reachable)))), details: No result within 20s. Last error: statusRequirementNotMet(expected: DistributedActors.Cluster.MemberStatus.up, found: Member(sact://second:[email protected]:9002, status: joining, reachability: reachable)))"
Saw the same issue in #1016 and I suspect sometimes the node may have hiccups and take longer to join nodes... we should give it a bigger timeout I suppose -- and also measure average time it takes to join nodes, then we'll see if we have hiccups or not.