SPLAT-2337: Added OTE binary for ccm-aws by mtulio · Pull Request #30525 · openshift/origin

mtulio · 2025-11-25T02:51:27Z

Re-adding OTE for CCM-AWS to validate hypershift: #30235

CCM-AWS e2e (OTE) on hypershift workload cluster is working and must skip two tests that is failing due an possible issue on retries, documented in:

openshift-ci-robot · 2025-11-25T02:51:30Z

Pipeline controller notification
This repository is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

openshift-ci · 2025-11-25T02:51:32Z

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

openshift-ci-robot · 2025-11-25T02:51:32Z

@mtulio: This pull request references SPLAT-2337 which is a valid jira issue.

Details

In response to this:

Re-adding OTE for CCM-AWS to validate hypershift

openshift/cloud-provider-aws#122

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

mtulio · 2025-11-25T02:51:36Z

/help

mtulio · 2025-11-25T02:51:52Z

/test ?

mtulio · 2025-11-25T02:52:09Z

/test e2e-hypershift-conformance

openshift-ci-robot · 2025-11-25T03:11:54Z

@mtulio: This pull request references SPLAT-2337 which is a valid jira issue.

Details

In response to this:

Re-adding OTE for CCM-AWS to validate hypershift: #30235

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2025-11-25T03:55:25Z

@mtulio: This pull request references SPLAT-2337 which is a valid jira issue.

Details

In response to this:

Re-adding OTE for CCM-AWS to validate hypershift: #30235

DNM while proofing working upstream CCM-AWS e2e (OTE) on hypershift workload cluster.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

mtulio · 2025-12-04T20:32:33Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift/pull/7339

openshift-ci · 2025-12-04T20:32:37Z

@mtulio, testwith: Error processing request. ERROR:

could not determine job runs: invalid format for additional PR: openshift/hypershift/pull/7339

mtulio · 2025-12-04T20:40:20Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift/pull/7339

openshift-ci · 2025-12-04T20:40:49Z

@mtulio, testwith: Error processing request. ERROR:

could not determine job runs: invalid format for additional PR: openshift/hypershift/pull/7339

mtulio · 2025-12-04T20:44:58Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

mtulio · 2025-12-10T12:48:22Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

mtulio · 2025-12-10T12:48:48Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

re-testing after updates in the hypershift repo. I am not having success running /testwith from there.

mtulio · 2025-12-15T16:56:06Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

re-testing after updates in the hypershift repo. I am not having success running /testwith from there.

We've been providing inline patch to the target PR, as aligned with Hypershift team. Let's see the new results:

mtulio · 2025-12-15T16:56:23Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

mtulio · 2026-01-07T23:54:20Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

mtulio · 2026-01-12T19:50:36Z

testing with new changes forcing policy - without checking flag (that seems to be not set on create cluster nor iam):

mtulio · 2026-01-12T19:50:41Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

mtulio · 2026-01-12T20:16:49Z

/testwith openshift/origin/main/e2e-hypershift-conformance openshift/hypershift#7339

mtulio · 2026-01-28T17:27:12Z

/validated by mtulio on job e2e-hypershift-conformance #2016524990978985984

mtulio · 2026-01-28T17:47:32Z

/validated by mtulio on job e2e-hypershift-conformance #2016524990978985984

/verified by mtulio on job e2e-hypershift-conformance #2016524990978985984

openshift-ci-robot · 2026-01-28T17:47:44Z

@mtulio: This PR has been marked as verified by mtulio on job [e2e-hypershift-conformance #2016524990978985984 ](https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30525/pull-ci-openshift-origin-main-e2e-hypershift-conformance/2016524990978985984).

Details

In response to this:

/validated by mtulio on job e2e-hypershift-conformance #2016524990978985984

/verified by mtulio on job e2e-hypershift-conformance #2016524990978985984

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

mtulio · 2026-01-28T17:49:37Z

/verified by mtulio on job e2e-hypershift-conformance #2016524990978985984

/verified by mtulio on job e2e-hypershift-conformance #2016524990978985984 - and all tests provided by OTE is passing (prefix [cloud-provider-aws-e2e])

openshift-ci-robot · 2026-01-28T17:49:48Z

@mtulio: This PR has been marked as verified by mtulio on job [e2e-hypershift-conformance #2016524990978985984](https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30525/pull-ci-openshift-origin-main-e2e-hypershift-conformance/2016524990978985984) - and all tests provided by OTE is passing (prefix [cloud-provider-aws-e2e]).

Details

In response to this:

/verified by mtulio on job e2e-hypershift-conformance #2016524990978985984

/verified by mtulio on job e2e-hypershift-conformance #2016524990978985984 - and all tests provided by OTE is passing (prefix [cloud-provider-aws-e2e])

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

mtulio · 2026-01-28T19:28:09Z

/test e2e-vsphere-ovn

smg247 · 2026-01-29T13:27:44Z

/approve

openshift-ci · 2026-01-29T13:28:03Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: mtulio, rvanderp3, smg247

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

~~OWNERS~~ [smg247]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

mtulio · 2026-01-29T13:29:31Z

The tests are passing in those tests (filter by test prefix [cloud-provider-aws-e2e] in the pass list):

And skipped in non-AWS job, used the job as example: e2e-vsphere-ovn #2016594179487961088:

time="2026-01-28T20:38:36Z" level=info 
msg="Listed 0 tests in 58.926864ms" 
binary=aws-cloud-controller-manager-tests-ext

mtulio · 2026-01-29T13:30:04Z

/verified by mtulio #30525 (comment)

openshift-ci-robot · 2026-01-29T13:30:15Z

@mtulio: This PR has been marked as verified by mtulio https://github.com/openshift/origin/pull/30525#issuecomment-3817704811.

Details

In response to this:

/verified by mtulio #30525 (comment)

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

mtulio · 2026-01-29T16:33:16Z

/test e2e-aws-ovn-microshift

openshift-ci-robot · 2026-01-29T18:33:24Z

/retest-required

Remaining retests: 0 against base HEAD be1e34a and 2 for PR HEAD 1a50012 in total

mtulio · 2026-01-29T19:15:49Z

Job failing on build (registry issues).

/test e2e-aws-ovn-microshift

mtulio · 2026-01-29T21:16:14Z

/retest-required

openshift-ci-robot · 2026-01-30T02:33:16Z

/retest-required

Remaining retests: 0 against base HEAD e713d4e and 1 for PR HEAD 1a50012 in total

mtulio · 2026-01-30T14:49:31Z

The job is reporting permanent failure in many jobs starting yesterday. I see one green signal this morning from 017143090124427264, let me try again:prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30657/pull-ci-openshift-origin-main-e2e-aws-ovn-microshift/2017143090124427264), let me try again:

/retest-required

mtulio · 2026-01-30T18:01:06Z

/pipeline required

openshift-ci-robot · 2026-01-30T18:01:10Z

Scheduling required tests:
/test e2e-aws-csi
/test e2e-aws-ovn-fips
/test e2e-aws-ovn-microshift
/test e2e-aws-ovn-microshift-serial
/test e2e-aws-ovn-serial-1of2
/test e2e-aws-ovn-serial-2of2
/test e2e-gcp-csi
/test e2e-gcp-ovn
/test e2e-gcp-ovn-upgrade
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi

openshift-trt · 2026-01-30T21:52:16Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 1a50012

Job Name	New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial	Medium - "[Jira:"Cluster Version Operator"] cluster-version-operator-tests should support passing serial tests [Serial]" is a new test, and was only seen in one job.

New tests seen in this PR at sha: 1a50012

"[Jira:"Cluster Version Operator"] cluster-version-operator-tests should support passing serial tests [Serial]" [Total: 1, Pass: 1, Fail: 0, Flake: 0]

openshift-trt · 2026-01-30T21:57:04Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 1a50012

Job Name	New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial	Medium - "[Jira:"Cluster Version Operator"] cluster-version-operator-tests should support passing serial tests [Serial]" is a new test, and was only seen in one job.

New tests seen in this PR at sha: 1a50012

"[Jira:"Cluster Version Operator"] cluster-version-operator-tests should support passing serial tests [Serial]" [Total: 1, Pass: 1, Fail: 0, Flake: 0]

openshift-trt · 2026-01-30T22:02:13Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: 1a50012

"[Jira:"Cluster Version Operator"] cluster-version-operator-tests should support passing serial tests [Serial]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]

mtulio · 2026-01-31T02:34:39Z

unrelated test failure

/test e2e-aws-ovn-serial-1of2

openshift-ci · 2026-01-31T05:45:01Z

@mtulio: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

This fix[1] include updates in the policy cloud-controller used by KubeCloudControllerARN required by upstream CCM and exposed by OTE when enabled in the OCP payload, exercised in hypershift through job presubmit e2e-conformance (requires OTE binary[2]). There is also a hotfix on ROSA managed policy used on CI while managed policies is updated by AWS[3]. The policy ensure CCM AWS have enough permissions to deliver the feautre to HCP - already added in upstream[2]. [1] https://issues.redhat.com/browse/OCPBUGS-65885 [2] https://issues.redhat.com/browse/OCPSTRAT-2743 openshift/origin#30525 `https://github.com/kubernetes/cloud-provider-aws/pull/1214` [3] https://issues.redhat.com/browse/SREP-2895

openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 25, 2025

openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Nov 25, 2025

openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Nov 28, 2025

mtulio mentioned this pull request Dec 4, 2025

OCPBUGS-65885: added 1.34 required ELBv2 perms to CCM role openshift/hypershift#7339

Merged

4 tasks

mtulio force-pushed the SPLAT-2337-ote-ccm-aws branch from 8f3a0a7 to c8a18aa Compare December 4, 2025 20:40

openshift-merge-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Dec 4, 2025

openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jan 12, 2026

mtulio force-pushed the SPLAT-2337-ote-ccm-aws branch from c8a18aa to 7379dc1 Compare January 12, 2026 20:16

openshift-merge-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jan 12, 2026

openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Jan 28, 2026

openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 29, 2026

openshift-merge-bot bot merged commit e00df4c into openshift:main Jan 31, 2026
21 of 22 checks passed

neisw mentioned this pull request Feb 1, 2026

Revert "SPLAT-2337: Added OTE binary for ccm-aws" #30744

Merged

mtulio mentioned this pull request Feb 4, 2026

SPLAT-2337: CCM-AWS OTE binary and skips #30747

Merged

Conversation

mtulio commented Nov 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci-robot commented Nov 25, 2025

Uh oh!

openshift-ci bot commented Nov 25, 2025

Uh oh!

openshift-ci-robot commented Nov 25, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mtulio commented Nov 25, 2025

Uh oh!

mtulio commented Nov 25, 2025

Uh oh!

mtulio commented Nov 25, 2025

Uh oh!

openshift-ci-robot commented Nov 25, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci-robot commented Nov 25, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mtulio commented Dec 4, 2025

Uh oh!

openshift-ci bot commented Dec 4, 2025

Uh oh!

mtulio commented Dec 4, 2025

Uh oh!

openshift-ci bot commented Dec 4, 2025

Uh oh!

mtulio commented Dec 4, 2025

Uh oh!

mtulio commented Dec 10, 2025

Uh oh!

mtulio commented Dec 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mtulio commented Dec 15, 2025

Uh oh!

mtulio commented Dec 15, 2025

Uh oh!

mtulio commented Jan 7, 2026

Uh oh!

mtulio commented Jan 12, 2026

Uh oh!

mtulio commented Jan 12, 2026

Uh oh!

mtulio commented Jan 12, 2026

Uh oh!

mtulio commented Jan 28, 2026

Uh oh!

mtulio commented Jan 28, 2026

Uh oh!

openshift-ci-robot commented Jan 28, 2026

Uh oh!

mtulio commented Jan 28, 2026

Uh oh!

openshift-ci-robot commented Jan 28, 2026

Uh oh!

mtulio commented Jan 28, 2026

Uh oh!

smg247 commented Jan 29, 2026

Uh oh!

openshift-ci bot commented Jan 29, 2026

Uh oh!

mtulio commented Jan 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mtulio commented Jan 29, 2026

Uh oh!

openshift-ci-robot commented Jan 29, 2026

Uh oh!

mtulio commented Jan 29, 2026

Uh oh!

openshift-ci-robot commented Jan 29, 2026

Uh oh!

mtulio commented Jan 29, 2026

Uh oh!

mtulio commented Jan 29, 2026

mtulio commented Nov 25, 2025 •

edited

Loading

openshift-ci-robot commented Nov 25, 2025 •

edited by openshift-ci bot

Loading

openshift-ci-robot commented Nov 25, 2025 •

edited by openshift-ci bot

Loading

openshift-ci-robot commented Nov 25, 2025 •

edited by openshift-ci bot

Loading

mtulio commented Dec 10, 2025 •

edited

Loading

mtulio commented Jan 29, 2026 •

edited

Loading