Learner member or not? #18343
Closed
kvmenshikov
started this conversation in
General
Learner member or not?
#18343
Replies: 2 comments 7 replies
-
|
All members should be voting members. You added the member |
Beta Was this translation helpful? Give feedback.
7 replies
-
|
Nope, right now etcdctl show member as voting one but records in voting member logs show 139168fea51cdb71 as learner. |
Beta Was this translation helpful? Give feedback.
-
|
You should be able to see a log something like below when you promote the learner to a voting member, If you still think it's an issue, generate a report using https://github.com/ahrtr/etcd-diagnosis |
Beta Was this translation helpful? Give feedback.
-
|
The things is, i can't see expected state in log files - member which should be voting one, appears as learner. Please find below the output of diagnostic tool, i've obfuscated some sensitive information like ip-addresses and names of instances automatic way. Please let me know, if you need any other information. Thank you for you help! |
Beta Was this translation helpful? Give feedback.
-
Please attach the complete logs of all members. I can always see a log something like below when promoting the learner to a voting member, Also note that 3.5.3 isn't recommended for production use, since there is a data inconsistent issue. Try to upgrade to the latest patch.
Note that this isn't an issue. Each member has a randomised election timeout. |
Beta Was this translation helpful? Give feedback.
-
Looks like i've found the root cause - misconfiguration between member add command and etcd command line arguments. Script is just tiny wrapper around etcdctl But v6 address different for etcd process (in my case this configuration prepared by own automation and have no relation to output of member add command): And member list show addresses from etcd configuration: So, troubleshooting became complicated. As for now I've removed and added member back with correct peer-urls and logs show correct list of voting members. etcd-diagnosis tools is very helpful, thank you! but unfortunately doesn't show the exact difference. Anyway, thank you for your help, really appreciate it!
It's an issue, because election happen in whole cluster in same time. So if some member don't print information about election while other do it, it's and issue. |
Beta Was this translation helpful? Give feedback.
-
|
One more important thing. Update of member peer-urls doens't help! and it etcd logs, i still see So need completely remove member, stop etcd process, cleanup database, add member back and start etcd process again. Hopefully, my case can be helpful for other etcd users |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello everyone!
Have quite strange situation after replacing one host by another one.
According to etcdctl output (identical for all hosts), all members are voting ones, see last line in output:
But according to etcd log and cluster behaviour first member in list is learner
1410023601244789617 is decimal representation of 139168fea51cdb71
So, the question is - why etcdctl show incorrect status of member? And how to fix it? - etcdtctl promote reject promotions with message - etcdserver: can only promote a learner member
Any help and suggestions really appreciated!
Thank you in advance!
Beta Was this translation helpful? Give feedback.
All reactions