fixups: clustermembercontroller2, manifests and setup-env

[alaypatel07]

Trying to make #112 work

[openshift-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: alaypatel07

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [alaypatel07]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[alaypatel07]

This got me to 1st etcd pod crashing with

2020-02-10 23:38:56.978315 I | embed: listening for client requests on 0.0.0.0:2379
2020-02-10 23:38:56.978456 C | etcdmain: error setting up initial cluster: URL scheme must be http, https, unix, or unixs:

Full Logs:

[root@alpate-tnlsq-m-0 ~]# crictl logs -f 004c127fee010
393ac8c7cc0f266d, unstarted, , https://etcd-0.alpatel-alpatel1-2020-02-10.gcp.devcluster.openshift.com:2380,
40e0ff5ee27c98d0, started, etcd-bootstrap, https://10.0.0.6:2380, https://10.0.0.6:2379
waiting for member alpate-tnlsq-m-0.c.openshift-gce-devel.internal...
member alpate-tnlsq-m-0.c.openshift-gce-devel.internal is present, continuing
adding etcd-bootstrap=https://10.0.0.6:2380,
etcd-bootstrap=https://10.0.0.6:2380
mv: cannot stat '/etc/kubernetes/manifests/etcd-member.yaml': No such file or directory
ETCD_PORT_9979_TCP=tcp://172.30.177.92:9979
ETCD_PORT_9979_TCP_PORT=9979
ETCD_PORT_2379_TCP_PORT=2379
ETCD_PORT_2379_TCP_PROTO=tcp
ETCD_INITIAL_CLUSTER_STATE=existing
ETCD_PORT_9979_TCP_ADDR=172.30.177.92
ALL_ETCD_ENDPOINTS=https://10.0.0.5:2379,https://10.0.0.3:2379,https://10.0.0.4:2379,https://10.0.0.6:2379
ETCD_INITIAL_CLUSTER=https://etcd-0.alpatel-alpatel1-2020-02-10.gcp.devcluster.openshift.com:2380,https://10.0.0.6:2380
ETCD_SERVICE_PORT_ETCD=2379
ETCD_SERVICE_PORT_ETCD_METRICS=9979
ETCD_NAME=etcd-member-alpate-tnlsq-m-0.c.openshift-gce-devel.internal
ETCD_QUOTA_BACKEND_BYTES=7516192768
ETCD_SERVICE_PORT=2379
ETCD_PORT_2379_TCP_ADDR=172.30.177.92
ETCDCTL_API=3
ETCD_DATA_DIR=/var/lib/etcd
ETCD_PORT_9979_TCP_PROTO=tcp
ETCD_PORT_2379_TCP=tcp://172.30.177.92:2379
ETCD_PORT=tcp://172.30.177.92:2379
ETCD_SERVICE_HOST=172.30.177.92
+ exec etcd --initial-advertise-peer-urls=https://10.0.0.5:2380 --cert-file=/etc/kubernetes/static-pod-resources/secrets/etcd-all-serving/etcd-serving-alpate-tnlsq-m-0.c.openshift-gce-devel.$
nternal.crt --key-file=/etc/kubernetes/static-pod-resources/secrets/etcd-all-serving/etcd-serving-alpate-tnlsq-m-0.c.openshift-gce-devel.internal.key --trusted-ca-file=/etc/kubernetes/static$
pod-resources/configmaps/etcd-serving-ca/ca-bundle.crt --client-cert-auth=true --peer-cert-file=/etc/kubernetes/static-pod-resources/secrets/etcd-all-peer/etcd-peer-alpate-tnlsq-m-0.c.opensh$
ft-gce-devel.internal.crt --peer-key-file=/etc/kubernetes/static-pod-resources/secrets/etcd-all-peer/etcd-peer-alpate-tnlsq-m-0.c.openshift-gce-devel.internal.key --peer-trusted-ca-file=/etc$
kubernetes/static-pod-resources/configmaps/etcd-peer-client-ca/ca-bundle.crt --peer-client-cert-auth=true --advertise-client-urls=https://10.0.0.5:2379 --listen-client-urls=https://0.0.0.0:2$
79 --listen-peer-urls=https://0.0.0.0:2380 --listen-metrics-urls=https://0.0.0.0:9978
2020-02-10 23:52:03.981435 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/var/lib/etcd
2020-02-10 23:52:03.981515 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=https://etcd-0.alpatel-alpatel1-2020-02-10.gcp.devcluster.openshift.com:2380,https://1$
.0.0.6:2380
2020-02-10 23:52:03.981522 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=existing
2020-02-10 23:52:03.981535 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-member-alpate-tnlsq-m-0.c.openshift-gce-devel.internal
2020-02-10 23:52:03.981550 I | pkg/flags: recognized and used environment variable ETCD_QUOTA_BACKEND_BYTES=7516192768
2020-02-10 23:52:03.981563 W | pkg/flags: unrecognized environment variable ETCD_PORT_9979_TCP=tcp://172.30.177.92:9979
2020-02-10 23:52:03.981566 W | pkg/flags: unrecognized environment variable ETCD_PORT_9979_TCP_PORT=9979
2020-02-10 23:52:03.981569 W | pkg/flags: unrecognized environment variable ETCD_PORT_2379_TCP_PORT=2379
2020-02-10 23:52:03.981573 W | pkg/flags: unrecognized environment variable ETCD_PORT_2379_TCP_PROTO=tcp
2020-02-10 23:52:03.981576 W | pkg/flags: unrecognized environment variable ETCD_PORT_9979_TCP_ADDR=172.30.177.92
2020-02-10 23:52:03.981579 W | pkg/flags: unrecognized environment variable ETCD_SERVICE_PORT_ETCD=2379
2020-02-10 23:52:03.981583 W | pkg/flags: unrecognized environment variable ETCD_SERVICE_PORT_ETCD_METRICS=9979
2020-02-10 23:52:03.981588 W | pkg/flags: unrecognized environment variable ETCD_SERVICE_PORT=2379
2020-02-10 23:52:03.981591 W | pkg/flags: unrecognized environment variable ETCD_PORT_2379_TCP_ADDR=172.30.177.92
2020-02-10 23:52:03.981595 W | pkg/flags: unrecognized environment variable ETCD_PORT_9979_TCP_PROTO=tcp
2020-02-10 23:52:03.981598 W | pkg/flags: unrecognized environment variable ETCD_PORT_2379_TCP=tcp://172.30.177.92:2379
2020-02-10 23:52:03.981601 W | pkg/flags: unrecognized environment variable ETCD_PORT=tcp://172.30.177.92:2379
2020-02-10 23:52:03.981605 W | pkg/flags: unrecognized environment variable ETCD_SERVICE_HOST=172.30.177.92
2020-02-10 23:52:03.981632 I | etcdmain: etcd Version: 3.3.17
2020-02-10 23:52:03.981671 I | etcdmain: Git SHA: e30a18f
2020-02-10 23:52:03.981674 I | etcdmain: Go Version: go1.12.9
2020-02-10 23:52:03.981678 I | etcdmain: Go OS/Arch: linux/amd64
2020-02-10 23:52:03.981682 I | etcdmain: setting maximum number of CPUs to 4, total number of available CPUs is 4
2020-02-10 23:52:03.981878 I | embed: peerTLS: cert = /etc/kubernetes/static-pod-resources/secrets/etcd-all-peer/etcd-peer-alpate-tnlsq-m-0.c.openshift-gce-devel.internal.crt, key = /etc/kube
rnetes/static-pod-resources/secrets/etcd-all-peer/etcd-peer-alpate-tnlsq-m-0.c.openshift-gce-devel.internal.key, ca = , trusted-ca = /etc/kubernetes/static-pod-resources/configmaps/etcd-peer-
client-ca/ca-bundle.crt, client-cert-auth = true, crl-file =
2020-02-10 23:52:03.982428 I | embed: listening for peers on https://0.0.0.0:2380
2020-02-10 23:52:03.982492 I | embed: listening for client requests on 0.0.0.0:2379
2020-02-10 23:52:03.982572 C | etcdmain: error setting up initial cluster: URL scheme must be http, https, unix, or unixs:
[root@alpate-tnlsq-m-0 ~]#

My initial guess is that the following env variable needs to be wrapped in quotes "",

ETCD_INITIAL_CLUSTER=https://etcd-0.alpatel-alpatel1-2020-02-10.gcp.devcluster.openshift.com:2380,https://1$
.0.0.6:2380

[openshift-ci-robot]

@alaypatel07: The following tests failed, say /retest to rerun all failed tests:

Test name	Commit	Details	Rerun command
ci/prow/e2e-aws	8e44b5b	link	/test e2e-aws
ci/prow/e2e-azure	8e44b5b	link	/test e2e-azure
ci/prow/e2e-gcp	8e44b5b	link	/test e2e-gcp
ci/prow/e2e-gcp-upgrade	8e44b5b	link	/test e2e-gcp-upgrade

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[openshift-ci-robot]

@alaypatel07: PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[alaypatel07]

the changes got picked