Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SAP BTP OPERATOR in our k8s cluster is crashing infinitely #464

Open
tarun00000 opened this issue Sep 11, 2024 · 2 comments
Open

SAP BTP OPERATOR in our k8s cluster is crashing infinitely #464

tarun00000 opened this issue Sep 11, 2024 · 2 comments

Comments

@tarun00000
Copy link

Version:
ghcr.io/sap/sap-btp-service-operator/controller:v0.5.4

I tried to make some changes and provision btp service instance and btp service binding.

But the service instance manifest had some issues and caused the BTP operator to crash .

2024-09-09T15:06:49Z INFO Observed a panic in reconciler: runtime error: invalid memory address or nil pointer dereference {"controller": "servicebinding", "controllerGroup": "services.cloud.sap.com", "controllerKind": "ServiceBinding", "ServiceBinding": {"name":"argocd-key","namespace":"default"}, "namespace": "default", "name": "argocd-key", "reconcileID": "6379c665-8827-448e-b162-006030fc2bc2"}

I am currently trying to delete the BTP service binding manually or forcefully, but it is stuck because the deletion process attempts to communicate with the BTP operator, which is in a crashing state
And i do not have access to the btp operator namespace so I can not delete btp operator pod for reconciliation.

Logs

2024-09-09T15:06:49Z INFO Observed a panic in reconciler: runtime error: invalid memory address or nil pointer dereference {"controller": "servicebinding", "controllerGroup": "[services.cloud.sap.com](http://services.cloud.sap.com/)", "controllerKind": "ServiceBinding", "ServiceBinding": {"name":"argocd-key","namespace":"default"}, "namespace": "default", "name": "argocd-key", "reconcileID": "6379c665-8827-448e-b162-006030fc2bc2"}

2024-09-09T14:50:46Z INFO Observed a panic in reconciler: runtime error: invalid memory address or nil pointer dereference {"controller": "servicebpanic: runtime error: invalid memory address or nil pointer dereference [recovered] panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x1a0 pc=0x14a06f2] goroutine 134 [running]: sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile.func1() /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:115 +0x1e5 panic({0x1606840?, 0x25f2eb0?}) /usr/local/go/src/runtime/panic.go:914 +0x21f github.com/SAP/sap-btp-service-operator/controllers.(*ServiceBindingReconciler).Reconcile(0xc00049b7f8, {0x1a5a1d8, 0xc000438fc0}, {{{0xc000396920, 0x7}, {0 /workspace/controllers/servicebinding_controller.go:96 +0x5b2 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile(0x1a5a1d8?, {0x1a5a1d8?, 0xc000438fc0?}, {{{0xc000396920?, 0x155d620?}, {0xc0 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:118 +0xb7 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000186140, {0x1a5a210, 0xc000024280}, {0x167c600?, 0xc00041d520?}) /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:314 +0x365 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000186140, {0x1a5a210, 0xc000024280}) /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:265 +0x1c9 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2() /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:226 +0x79 created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2 in goroutine 102 /go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:222 +0x565 Stream closed EOF for sap-btp-service-operator/sap-btp-operator-controller-manager-547cf79474-w7x85 (manager)

I also tried

try to delete the ServiceBinding argocd-key and remove its finalizer. but did not work.
error I am getting is

 error: servicebindings.services.cloud.sap.com "argocd-key" could not be patched: Internal error occurred: failed calling webhook "mservicebinding.kb.io": failed to call webhook: Post "https://sap-btp-operator-webhook-service.sap-btp-service-operator.svc:443/mutate-services-cloud-sap-com-v1-servicebinding?timeout=10s": no endpoints available for service "sap-btp-operator-webhook-service"
You can run `kubectl replace -f /var/folders/24/pdjyg77x30gdnd70pcm2z7jw0000gn/T/kubectl-edit-3513063779.yaml` to try this update again.

Need your help, Thanks

@tarun00000 tarun00000 changed the title SAP BTP OPERATOR in our MCP cluster is crashing infinitely SAP BTP OPERATOR in our k8s cluster is crashing infinitely Sep 11, 2024
@kerenlahav
Copy link
Contributor

Hi @tarun00000
This issue has been resolved in v0.5.10, you are using a very old version of the operator. please upgrade the operator and try again.

@tarun00000
Copy link
Author

Hi kerenlahav,
Thankyou for the response. I will test and close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants