Skip to content

AUTOSCALE-890: Add tls scanner test step to CRO E2Es - #82176

Merged
openshift-merge-bot[bot] merged 1 commit into
openshift:mainfrom
joelsmith:main
Jul 22, 2026
Merged

AUTOSCALE-890: Add tls scanner test step to CRO E2Es#82176
openshift-merge-bot[bot] merged 1 commit into
openshift:mainfrom
joelsmith:main

Conversation

@joelsmith

@joelsmith joelsmith commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Summary by CodeRabbit

This updates the OpenShift CI configuration for the Cluster Resource Override Admission Operator to add TLS scanner coverage to its AWS CRO end-to-end test flow. In ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml, it introduces a tls-scanner-tool base image and extends the e2e-aws-olm workflow to:

  • set TLS scanner environment variables (including SCAN_NAMESPACE=openshift-cluster-resource-override, PQC_CHECK, and scanner CPU/memory limits),
  • deploy a ClusterResourceOverride operand into the cluster via oc apply,
  • wait for clusterresourceoverride/cluster to reach Available (5m timeout), and then
  • run the tls-scanner-run step against the configured namespace.

@openshift-ci
openshift-ci Bot requested review from jkyros and maxcao13 July 20, 2026 19:30
@openshift-ci openshift-ci Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 20, 2026
@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith, pj-rehearse: unable to determine affected jobs. This could be due to a branch that needs to be rebased. ERROR:

could not load configuration from candidate revision of release repo: failed to load ci-operator configuration from release repo: failed to load ci-operator config (error converting YAML to JSON: yaml: line 97: did not find expected key)
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

@joelsmith, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 16 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 09c1bf6c-abce-4402-aadc-00fe40637f1f

📥 Commits

Reviewing files that changed from the base of the PR and between 0fd667c and df3b6ae.

📒 Files selected for processing (1)
  • ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml

Walkthrough

The CI configuration adds a TLS scanner image and updates the e2e-aws-olm workflow to configure scanner settings, deploy a ClusterResourceOverride, wait for availability, and run TLS scanning.

Changes

TLS scanner integration

Layer / File(s) Summary
Configure and execute OLM TLS scanning
ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml
Adds the tls-scanner-tool base image and scanner environment variables, applies a ClusterResourceOverride requesting 100m CPU, waits for its Available condition, and invokes tls-scanner-run in e2e-aws-olm.

Estimated code review effort: 2 (Simple) | ~10 minutes

Suggested reviewers: maxcao13, jkyros

Sequence Diagram(s)

sequenceDiagram
  participant E2E as e2e-aws-olm
  participant OC as oc
  participant CRO as ClusterResourceOverride
  participant Scanner as tls-scanner-run
  E2E->>OC: Apply ClusterResourceOverride
  OC->>CRO: Wait for Available condition
  E2E->>Scanner: Run TLS scan with configured settings
Loading
🚥 Pre-merge checks | ✅ 15
✅ Passed checks (15 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately summarizes the main change: adding TLS scanner coverage to CRO end-to-end tests.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names ✅ Passed PR only changes ci-operator YAML and adds step refs/env; no Ginkgo It/Describe/Context/When titles or dynamic test names were introduced.
Test Structure And Quality ✅ Passed PASS: The PR only changes ci-operator YAML/step-registry config; no Ginkgo test code or assertions were modified, so this test-quality check is not applicable.
Microshift Test Compatibility ✅ Passed The PR only changes ci-operator YAML; no new Ginkgo test code or MicroShift-skip logic was added.
Single Node Openshift (Sno) Test Compatibility ✅ Passed Only CI job config changed; the added tls-scanner step is namespace-scoped and the scanner script has no multi-node/HA assumptions.
Topology-Aware Scheduling Compatibility ✅ Passed Only CI job config changed; it adds TLS scanner steps and a test-time ClusterResourceOverride apply, with no pod scheduling fields or workload manifests.
Ote Binary Stdout Contract ✅ Passed Diff only updates ci-operator YAML; no OTE binary code or process-level stdout logging changes were introduced.
Ipv6 And Disconnected Network Test Compatibility ✅ Passed PASS: This PR only updates ci-operator config; it adds no new Ginkgo tests and the tls-scanner step scans cluster-internal pods, with no IPv4-only or public-internet assumptions.
No-Weak-Crypto ✅ Passed Changed YAML only wires in tls-scanner refs/env vars; no weak algorithms, custom crypto, or secret/token comparisons appear.
Container-Privileges ✅ Passed The changed CI config adds env vars and an oc apply/wait step, but no privileged, hostPID/hostNetwork/hostIPC, SYS_ADMIN, or allowPrivilegeEscalation settings.
No-Sensitive-Data-In-Logs ✅ Passed The new TLS-scanner e2e step only echoes a generic status message and applies/waits on a CRO manifest; no secrets, PII, or hostnames are logged.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In
`@ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml`:
- Line 98: Fix the YAML structure around the deploy-operand entry: align
deploy-operand with the mapping keys under test (including cluster_profile and
workflow), or consistently convert steps to a list, so the job parses correctly
while preserving the intended test workflow.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 131accf8-dff2-4f92-a7c0-fc6c2714379e

📥 Commits

Reviewing files that changed from the base of the PR and between 272f7b6 and 70131f5.

📒 Files selected for processing (1)
  • ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml

@joelsmith

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm,pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-operator

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: job(s): pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm,pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-operator either don't exist or were not found to be affected, and cannot be rehearsed

@joelsmith

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-operator

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@joelsmith joelsmith changed the title Add tls scanner test step to CRO E2Es AUTOSCALE-890: Add tls scanner test step to CRO E2Es Jul 20, 2026
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Jul 20, 2026
@openshift-ci-robot

openshift-ci-robot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

@joelsmith: This pull request references AUTOSCALE-890 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the task to target the "5.0.0" version, but no target version was set.

Details

In response to this:

Summary by CodeRabbit

Adds TLS scanner coverage to the Cluster Resource Override Admission Operator’s OpenShift CI end-to-end tests. The pipeline now deploys a ClusterResourceOverride test operand and runs the TLS scanner against the openshift-cluster-resource-override namespace at two test stages.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In
`@ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml`:
- Around line 105-117: Update both command blocks at
ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml
lines 105-117 and 147-159 to use oc apply instead of oc create, then wait for
the ClusterResourceOverride reconciliation and operand pod rollout to complete
before the deploy-operand step exits. Ensure both sites block until the pods are
ready for the subsequent tls-scanner-run step.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: 8301be0b-f7be-4355-8651-0b68562af537

📥 Commits

Reviewing files that changed from the base of the PR and between 70131f5 and ec4406e.

📒 Files selected for processing (1)
  • ci-operator/config/openshift/cluster-resource-override-admission-operator/openshift-cluster-resource-override-admission-operator-main.yaml

@joelsmith

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-operator

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@joelsmith
joelsmith force-pushed the main branch 2 times, most recently from 0fd667c to df3b6ae Compare July 21, 2026 04:07
@joelsmith

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

[REHEARSALNOTIFIER]
@joelsmith: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-openshift-cluster-resource-override-admission-operator-main-ci-bundle-cluster-resource-override-admission-operator-bundle openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-operator openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-upgrade openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-images openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-security openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-unit openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-verify openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
pull-ci-openshift-cluster-resource-override-admission-operator-main-verify-deps openshift/cluster-resource-override-admission-operator presubmit Ci-operator config changed
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@joelsmith

Copy link
Copy Markdown
Contributor Author

/pj-rehearse pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-olm

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@joelsmith: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot openshift-merge-bot Bot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Jul 21, 2026
@openshift-ci

openshift-ci Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

@joelsmith: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/rehearse/openshift/cluster-resource-override-admission-operator/main/e2e-aws-operator cce7721 link unknown /pj-rehearse pull-ci-openshift-cluster-resource-override-admission-operator-main-e2e-aws-operator

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@joelsmith

Copy link
Copy Markdown
Contributor Author

@shyadav10

Copy link
Copy Markdown
Contributor

/lgtm

@openshift-ci openshift-ci Bot added the lgtm Indicates that a PR is ready to be merged. label Jul 22, 2026
@openshift-ci

openshift-ci Bot commented Jul 22, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: joelsmith, shyadav10

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-bot
openshift-merge-bot Bot merged commit b92e323 into openshift:main Jul 22, 2026
15 checks passed
apahim pushed a commit to apahim/release that referenced this pull request Jul 24, 2026
mrniranjan pushed a commit to mrniranjan/release that referenced this pull request Jul 28, 2026
amogh-redhat pushed a commit to amogh-redhat/release that referenced this pull request Aug 5, 2026
TimurMP pushed a commit to TimurMP/release that referenced this pull request Sep 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. rehearsals-ack Signifies that rehearsal jobs have been acknowledged

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants