Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade kube-system images #6509

Closed
jaskaransarkaria opened this issue Nov 28, 2024 · 5 comments
Closed

Upgrade kube-system images #6509

jaskaransarkaria opened this issue Nov 28, 2024 · 5 comments
Assignees
Labels

Comments

@jaskaransarkaria
Copy link
Contributor

Background

https://runbooks.cloud-platform.service.justice.gov.uk/container-images.html#kube-system

upgrade external-dns relates to #6434
adjust docs as descheduler is the latest version

upgrade ebs-cbi-driver (current version is 2.29.1 latest is -> 2.37.0) https://github.com/ministryofjustice/cloud-platform-terraform-eks-csi/blob/029197f0c5b483901358fff0292dcbfe3477b464/main.tf#L7C17-L7C24

@sj-williams
Copy link
Contributor

@sj-williams
Copy link
Contributor

Some further information on behaviour with apex records:
kubernetes-sigs/external-dns#4618 (comment)

@sj-williams
Copy link
Contributor

Additionally, this issue seems like it is a problem for us:
kubernetes-sigs/external-dns#2903 (comment)

Specifically, have seen that after upgrade, if we try to delete an external-dns managed record on an apex record ( ie an A apexrecord for my-tester.cloud.platform.service.gov.uk zone that was created before the externaldns upgrade, it does not delete either the TXT nor the A records.

@sj-williams
Copy link
Contributor

When upgrading a test cluster, deleting the 'helloworld' & 'multi-container' ingresses does not execute a DELETE, get this in the logs:

external-dns-57cbcd488c-tqrd8 external-dns time="2025-01-28T10:28:37Z" level=debug msg="Skipping endpoint [multi-container-app-starter-pack-0.apps.cp-2701-1007.cloud-platform.service.justice.gov.uk](http://multi-container-app-starter-pack-0.apps.cp-2701-1007.cloud-platform.service.justice.gov.uk/) 300 IN A  [abd20e78efa4545e9936585f3be20f4b-7c3637fcd1525bb3.elb.eu-west-2.amazonaws.com](http://abd20e78efa4545e9936585f3be20f4b-7c3637fcd1525bb3.elb.eu-west-2.amazonaws.com/) [{aws/evaluate-target-health true} {alias true}] because owner id does not match, found: \"\", required: \"cp-2701-1007\""



(https://mojdt.slack.com/archives/D03FJPPPEFK/p1738060270544509)
external-dns-57cbcd488c-tqrd8 external-dns time="2025-01-28T10:30:53Z" 
level=debug msg="Skipping endpoint helloworld-app-starter-pack-0.apps.cp-2701-1007.cloud-platform.service.justice.gov.uk 300 IN A  [ae3c21dcc78d447f0a0097070d412602-9c7c900ccefaca59.elb.eu-west-2.amazonaws.com](http://ae3c21dcc78d447f0a0097070d412602-9c7c900ccefaca59.elb.eu-west-2.amazonaws.com/) [{aws/evaluate-target-health true} {alias true}] because owner id does not match, found: \"\", required: \"cp-2701-1007\"

@sj-williams
Copy link
Contributor

Theres now a new dedicated ticket for solving external-dns upgrade issue:

#6752

@github-project-automation github-project-automation bot moved this from 🏗 In Progress to 🥇 Done in Cloud Platform Jan 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Archived in project
Development

No branches or pull requests

3 participants