"terraform.tfstate" already exisits #635
Description
Synopsis: After an install timed out, I tried to re-run with debug level output enabled, and the attempt to recreate a cluster fail with:
FATAL Error executing openshift-install: failed to fetch Cluster: failed to load asset "Cluster": "terraform.tfstate" already exisits. There may already be a running cluster
Despite having torn down the cluster.
Version
$ bin/openshift-install version
bin/openshift-install v0.3.0-151-g8ef57585ccc79b3ac54da7f0757593d4c6a54e70
Terraform v0.11.8
Your version of Terraform is out of date! The latest version
is 0.11.10. You can update by downloading from www.terraform.io/downloads.htmlPlatform (aws|libvirt|openstack):
libvirt.
What happened?
After attempting to create a cluster after tearing it down -- it fails with failed to load asset "Cluster": "terraform.tfstate" already exisits.
$ bin/openshift-install --log-level debug create cluster
[ ... snip ...]
FATAL Error executing openshift-install: failed to fetch Cluster: failed to load asset "Cluster": "terraform.tfstate" already exisits. There may already be a running cluster
$ echo $?
1
What you expected to happen?
Continues with cluster creation.
How to reproduce it (as minimally and precisely as possible)?
- Follow libvirt-how-to
- Spin up a cluster (and have it timeout, optionally? unsure how to recreate that part...)
- Try to tear down & recreate the cluster with these steps:
$ bin/openshift-install destroy cluster
$ sudo ./scripts/maintenance/virsh-cleanup.sh
$ bin/openshift-install --log-level debug create cluster
[ ... snip ...]
FATAL Error executing openshift-install: failed to fetch Cluster: failed to load asset "Cluster": "terraform.tfstate" already exisits. There may already be a running cluster
$ echo $?
1
Details
Full output:
$ bin/openshift-install destroy cluster
INFO Deleted pool pool=Downloads
$ sudo ./scripts/maintenance/virsh-cleanup.sh
Warning: This will destroy effectively all libvirt resources
Continue [yN]? y
$ bin/openshift-install --log-level debug create cluster
DEBUG Fetching "Terraform Variables"...
DEBUG Fetching dependencies of "Terraform Variables"...
DEBUG Fetching "Install Config"...
DEBUG Fetching dependencies of "Install Config"...
DEBUG Fetching "Cluster ID"...
DEBUG Found "Cluster ID" in state file
DEBUG Loading "Cluster ID" from state file
DEBUG Fetching "Email Address"...
DEBUG Found "Email Address" in state file
DEBUG Loading "Email Address" from state file
DEBUG Fetching "Password"...
DEBUG Found "Password" in state file
DEBUG Loading "Password" from state file
DEBUG Fetching "SSH Key"...
DEBUG Found "SSH Key" in state file
DEBUG Loading "SSH Key" from state file
DEBUG Fetching "Base Domain"...
DEBUG Found "Base Domain" in state file
DEBUG Loading "Base Domain" from state file
DEBUG Fetching "Cluster Name"...
DEBUG Found "Cluster Name" in state file
DEBUG Loading "Cluster Name" from state file
DEBUG Fetching "Pull Secret"...
DEBUG Found "Pull Secret" in state file
DEBUG Loading "Pull Secret" from state file
DEBUG Fetching "Platform"...
DEBUG Found "Platform" in state file
DEBUG Loading "Platform" from state file
DEBUG Found "Install Config" in state file
DEBUG Loading "Install Config" from state file
DEBUG Fetching "Bootstrap Ignition Config"...
DEBUG Fetching dependencies of "Bootstrap Ignition Config"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Root CA"...
DEBUG Found "Root CA" in state file
DEBUG Loading "Root CA" from state file
DEBUG Fetching "Certificate (etcd)"...
DEBUG Fetching dependencies of "Certificate (etcd)"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Found "Certificate (etcd)" in state file
DEBUG Loading "Certificate (etcd)" from state file
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Fetching dependencies of "Certificate (kube-ca)"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Found "Certificate (kube-ca)" in state file
DEBUG Loading "Certificate (kube-ca)" from state file
DEBUG Fetching "Certificate (aggregator)"...
DEBUG Fetching dependencies of "Certificate (aggregator)"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Found "Certificate (aggregator)" in state file
DEBUG Loading "Certificate (aggregator)" from state file
DEBUG Fetching "Certificate (service-serving)"...
DEBUG Fetching dependencies of "Certificate (service-serving)"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Found "Certificate (service-serving)" in state file
DEBUG Loading "Certificate (service-serving)" from state file
DEBUG Fetching "Certificate (etcd)"...
DEBUG Fetching dependencies of "Certificate (etcd)"...
DEBUG Fetching "Certificate (etcd)"...
DEBUG Reusing previously-fetched "Certificate (etcd)"
DEBUG Found "Certificate (etcd)" in state file
DEBUG Loading "Certificate (etcd)" from state file
DEBUG Fetching "Certificate (kube-apiaserver)"...
DEBUG Fetching dependencies of "Certificate (kube-apiaserver)"...
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Reusing previously-fetched "Certificate (kube-ca)"
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Certificate (kube-apiaserver)" in state file
DEBUG Loading "Certificate (kube-apiaserver)" from state file
DEBUG Fetching "Certificate (kube-apiserver-proxy)"...
DEBUG Fetching dependencies of "Certificate (kube-apiserver-proxy)"...
DEBUG Fetching "Certificate (aggregator)"...
DEBUG Reusing previously-fetched "Certificate (aggregator)"
DEBUG Found "Certificate (kube-apiserver-proxy)" in state file
DEBUG Loading "Certificate (kube-apiserver-proxy)" from state file
DEBUG Fetching "Certificate (system:admin)"...
DEBUG Fetching dependencies of "Certificate (system:admin)"...
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Reusing previously-fetched "Certificate (kube-ca)"
DEBUG Found "Certificate (system:admin)" in state file
DEBUG Loading "Certificate (system:admin)" from state file
DEBUG Fetching "Certificate (system:serviceaccount:kube-system:default)"...
DEBUG Fetching dependencies of "Certificate (system:serviceaccount:kube-system:default)"...
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Reusing previously-fetched "Certificate (kube-ca)"
DEBUG Found "Certificate (system:serviceaccount:kube-system:default)" in state file
DEBUG Loading "Certificate (system:serviceaccount:kube-system:default)" from state file
DEBUG Fetching "Certificate (mcs)"...
DEBUG Fetching dependencies of "Certificate (mcs)"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Certificate (mcs)" in state file
DEBUG Loading "Certificate (mcs)" from state file
DEBUG Fetching "Key Pair (service-account.pub)"...
DEBUG Found "Key Pair (service-account.pub)" in state file
DEBUG Loading "Key Pair (service-account.pub)" from state file
DEBUG Fetching "Kubeconfig Admin"...
DEBUG Fetching dependencies of "Kubeconfig Admin"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Fetching "Certificate (system:admin)"...
DEBUG Reusing previously-fetched "Certificate (system:admin)"
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Generating "Kubeconfig Admin"...
DEBUG Fetching "Kubeconfig Kubelet"...
DEBUG Fetching dependencies of "Kubeconfig Kubelet"...
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Fetching "Certificate (system:serviceaccount:kube-system:default)"...
DEBUG Reusing previously-fetched "Certificate (system:serviceaccount:kube-system:default)"
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Kubeconfig Kubelet" in state file
DEBUG Loading "Kubeconfig Kubelet" from state file
DEBUG Fetching "Common Manifests"...
DEBUG Fetching dependencies of "Common Manifests"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Network Operator"...
DEBUG Fetching dependencies of "Network Operator"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Network Operator" in state file
DEBUG Loading "Network Operator" from state file
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Fetching "Certificate (etcd)"...
DEBUG Reusing previously-fetched "Certificate (etcd)"
DEBUG Fetching "Certificate (ingress)"...
DEBUG Fetching dependencies of "Certificate (ingress)"...
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Reusing previously-fetched "Certificate (kube-ca)"
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Certificate (ingress)" in state file
DEBUG Loading "Certificate (ingress)" from state file
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Reusing previously-fetched "Certificate (kube-ca)"
DEBUG Fetching "Certificate (service-serving)"...
DEBUG Reusing previously-fetched "Certificate (service-serving)"
DEBUG Fetching "Certificate (etcd)"...
DEBUG Reusing previously-fetched "Certificate (etcd)"
DEBUG Fetching "Certificate (mcs)"...
DEBUG Reusing previously-fetched "Certificate (mcs)"
DEBUG Fetching "Certificate (system:serviceaccount:kube-system:default)"...
DEBUG Reusing previously-fetched "Certificate (system:serviceaccount:kube-system:default)"
DEBUG Found "Common Manifests" in state file
DEBUG Loading "Common Manifests" from state file
DEBUG Fetching "Tectonic Manifests"...
DEBUG Fetching dependencies of "Tectonic Manifests"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Certificate (ingress)"...
DEBUG Reusing previously-fetched "Certificate (ingress)"
DEBUG Fetching "Certificate (kube-ca)"...
DEBUG Reusing previously-fetched "Certificate (kube-ca)"
DEBUG Fetching "Cluster.cluster.k8s.io/v1alpha1"...
DEBUG Fetching dependencies of "Cluster.cluster.k8s.io/v1alpha1"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Cluster.cluster.k8s.io/v1alpha1" in state file
DEBUG Loading "Cluster.cluster.k8s.io/v1alpha1" from state file
DEBUG Fetching "Worker Machines"...
DEBUG Fetching dependencies of "Worker Machines"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Worker Ignition Config"...
DEBUG Fetching dependencies of "Worker Ignition Config"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Found "Worker Ignition Config" in state file
DEBUG Loading "Worker Ignition Config" from state file
DEBUG Found "Worker Machines" in state file
DEBUG Loading "Worker Machines" from state file
DEBUG Fetching "Master Machines"...
DEBUG Fetching dependencies of "Master Machines"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Master Ignition Config"...
DEBUG Fetching dependencies of "Master Ignition Config"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Root CA"...
DEBUG Reusing previously-fetched "Root CA"
DEBUG Found "Master Ignition Config" in state file
DEBUG Loading "Master Ignition Config" from state file
DEBUG Found "Master Machines" in state file
DEBUG Loading "Master Machines" from state file
DEBUG Fetching "Kube Addon Operator"...
DEBUG Fetching dependencies of "Kube Addon Operator"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Found "Kube Addon Operator" in state file
DEBUG Loading "Kube Addon Operator" from state file
DEBUG Found "Tectonic Manifests" in state file
DEBUG Loading "Tectonic Manifests" from state file
DEBUG Found "Bootstrap Ignition Config" in state file
DEBUG Loading "Bootstrap Ignition Config" from state file
DEBUG Fetching "Master Ignition Config"...
DEBUG Reusing previously-fetched "Master Ignition Config"
DEBUG Fetching "Worker Ignition Config"...
DEBUG Reusing previously-fetched "Worker Ignition Config"
DEBUG Generating "Terraform Variables"...
INFO Fetching OS image...
DEBUG Using cached OS image "/home/doug/.cache/openshift-install/libvirt/image/9a7287c9e85161d703ba6382dc6988ca"
DEBUG Fetching "Kubeconfig Admin"...
DEBUG Reusing previously-fetched "Kubeconfig Admin"
DEBUG Fetching "Cluster"...
DEBUG Fetching dependencies of "Cluster"...
DEBUG Fetching "Install Config"...
DEBUG Reusing previously-fetched "Install Config"
DEBUG Fetching "Terraform Variables"...
DEBUG Reusing previously-fetched "Terraform Variables"
DEBUG Fetching "Kubeconfig Admin"...
DEBUG Reusing previously-fetched "Kubeconfig Admin"
FATAL Error executing openshift-install: failed to fetch Cluster: failed to load asset "Cluster": "terraform.tfstate" already exisits. There may already be a running cluster