Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: validate CNS in-memory state after restart #2049

Merged
merged 5 commits into from
Jul 14, 2023

Conversation

camrynl
Copy link
Contributor

@camrynl camrynl commented Jul 10, 2023

Reason for Change:

Adds check to validate CNS pod IP assignment before and after the CNS daemonset is restarted.

Issue Fixed:

Requirements:

Notes:

@camrynl camrynl added the ci Infra or tooling. label Jul 10, 2023
@camrynl camrynl requested a review from a team as a code owner July 10, 2023 21:55
@rbtr rbtr requested a review from rsagasthya July 10, 2023 22:31
kubectl get pod -owide -A
make test-validate-state
echo "restart CNS"
kubectl rollout restart ds azure-cns -n kube-system
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's add a wait as well. kubectl rollout status ds azure-cns -n kube-system to make sure azure-cns has restarted.

@@ -165,6 +165,18 @@ steps:
name: "validatePods"
displayName: "Validate Pods"

- script: |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we add cilium agent restarts as well ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that check can be reserved for cilium nightly pipeline runs

@camrynl camrynl requested a review from vipul-21 July 12, 2023 15:52
vipul-21
vipul-21 previously approved these changes Jul 12, 2023
@rbtr rbtr requested review from csfmomo and removed request for rsagasthya July 12, 2023 21:44
@@ -165,6 +165,19 @@ steps:
name: "validatePods"
displayName: "Validate Pods"

- script: |
echo "validate pod IP assignment and check systemd-networkd restart"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why log message says "systemd-networkd" restart

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The cmd make test-validate-state validates the state after restarting systemd-networkd restart for linux as a part of validating state.

Copy link
Member

@tamilmani1989 tamilmani1989 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@tamilmani1989 tamilmani1989 merged commit e9257ed into master Jul 14, 2023
@tamilmani1989 tamilmani1989 deleted the camrynl/cirestartcns branch July 14, 2023 03:38
rbtr pushed a commit that referenced this pull request Sep 8, 2023
* validate pod states after cns restart

* update job

* wait for cns to complete restart

* update pipeline log

* update pipeline log
jpayne3506 pushed a commit that referenced this pull request Sep 11, 2023
* validate pod states after cns restart

* update job

* wait for cns to complete restart

* update pipeline log

* update pipeline log
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Infra or tooling.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants