Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IBMCloud post cluster creation service endpoint override support #1712

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

jared-hayes-dev
Copy link

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 6, 2024
Copy link
Contributor

openshift-ci bot commented Nov 6, 2024

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

Copy link
Contributor

openshift-ci bot commented Nov 6, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign pratikmahajan for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@jared-hayes-dev jared-hayes-dev marked this pull request as ready for review November 11, 2024 21:26
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 11, 2024
@openshift-ci openshift-ci bot requested review from coverprice and enxebre November 11, 2024 21:26
@jeffnowicki
Copy link

/test markdownlint

Copy link
Contributor

@elmiko elmiko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think this mostly makes sense to me, i just have some clarifying questions.


### User Stories

* As an OpenShift cluster administrator, I want to update my cluster's current service endpoint configuration to point to new service endpoints.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i'd like to see this expanded a little, what happens if the new service endpoints are not used, or why we do need them?

eg

"As an OpenShift cluster administrator, I want to update my cluster's current service endpoint configuration to point to new service endpoints so that "

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


* Expand API definition to support defining services + endpoints within cloud provider spec for IBM
* Modify CCCMO so that changes are reconciled from infrastructure spec to status for IBM cloud provider and cloud config
* Evaluate IBM components with service endpoint support and how they will react/respond to post-install service endpoint changes.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this just evaluation or will changes need to be made based on the results of the evaluation?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I removed this section it was more of a reminder to ourselves (IBM) of our testing process to ensure components we owned processed the changed but it doesn't seem like a relevant section of this enhancement since it exists on our side of the fence.

}
```

### Topology Considerations
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we ever need to consider a proxy scenario?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We dont anticipate/wish to support such a scenario

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What would happen if someone had clusterwideproxy configured?

**cccmo** is an operator responsible for watching updates to the infrastructure object and perforning updates once any value(s) are set.

1. The cccmo reconciliation loop observes that the IBMCloudPlatform spec within the infrastructure object has been set,
2. The cccmo validates the endpoints and then updates the IBMCloudPlatformStatus and cloud config.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is there anything special about the validation process?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Validation involves ensuring the provided endpoint is a valid url using https for traffic, follows a particular pattern we expect for endpoints to follow ie /api/v1 or /v1 which are IBM standard, and whether the hostname exists and can be reached.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be done by CCMO or can it be done at admission time using something like CEL validations?

Copy link
Contributor

openshift-ci bot commented Nov 18, 2024

@jared-hayes-dev: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/markdownlint 9281a12 link true /test markdownlint

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

**cccmo** is an operator responsible for watching updates to the infrastructure object and perforning updates once any value(s) are set.

1. The cccmo reconciliation loop observes that the IBMCloudPlatform spec within the infrastructure object has been set,
2. The cccmo validates the endpoints and then updates the IBMCloudPlatformStatus and cloud config.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be done by CCMO or can it be done at admission time using something like CEL validations?

Comment on lines +70 to +72
// serviceEndpoints is a list of custom endpoints which will override the default
// service endpoints of an IBM Cloud service. These endpoints are consumed by
// components within the cluster to reach the respective IBM Cloud Services.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to explain what happens here when there is a change to this, how are values reconciled with status etc

}
```

### Topology Considerations
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What would happen if someone had clusterwideproxy configured?


### Risks and Mitigations

Users may cause service interruptions for their cluster should they define invalid overrides. This is mitigated by performing validation on the endpoint as there requirements are understood at time of implementation for IBM Cloud.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd like to see how much of this can be done at API time, vs controller time. Earlier validation is better generally

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants