Skip to content

Improve scorecard test to avoid running on kind cluster inside OCP cl…#1589

Merged
istio-testing merged 3 commits intoistio-ecosystem:mainfrom
fjglira:improve-scorecard
Feb 11, 2026
Merged

Improve scorecard test to avoid running on kind cluster inside OCP cl…#1589
istio-testing merged 3 commits intoistio-ecosystem:mainfrom
fjglira:improve-scorecard

Conversation

@fjglira
Copy link
Copy Markdown
Contributor

@fjglira fjglira commented Feb 11, 2026

…usters

What type of PR is this?

  • Enhancement / New Feature
  • Bug Fix
  • Refactor
  • Optimization
  • Test
  • Documentation Update

What this PR does / why we need it:

Running on CI againt OCP cluster can be set by using OCP=true make test.scorecard

Which issue(s) this PR fixes:

Fixes #

Related Issue/PR #

Additional information:

…usters

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
@fjglira fjglira requested a review from a team as a code owner February 11, 2026 10:20
@codecov
Copy link
Copy Markdown

codecov bot commented Feb 11, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 81.20%. Comparing base (871f07e) to head (53059e1).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1589      +/-   ##
==========================================
+ Coverage   80.75%   81.20%   +0.44%     
==========================================
  Files          50       50              
  Lines        2458     2458              
==========================================
+ Hits         1985     1996      +11     
+ Misses        348      341       -7     
+ Partials      125      121       -4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
if [[ "${OCP}" == "true" ]]; then
NAMESPACE="${SCORECARD_NAMESPACE:-scorecard-test}"
# Create namespace if it doesn't exist
oc create namespace "${NAMESPACE}" --dry-run=client -o yaml | oc apply -f -
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not using simple oc create namespace?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oc create namespace xxxx |true to avoid failing the test can work also

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's use that as it's what we do in other parts as well

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
@istio-testing istio-testing merged commit 1747f2d into istio-ecosystem:main Feb 11, 2026
16 of 17 checks passed
@istio-testing
Copy link
Copy Markdown
Collaborator

In response to a cherrypick label: new pull request created: #1590

@istio-testing
Copy link
Copy Markdown
Collaborator

In response to a cherrypick label: new pull request created: #1591

@istio-testing
Copy link
Copy Markdown
Collaborator

In response to a cherrypick label: new pull request created: #1592

openshift-service-mesh-bot pushed a commit to openshift-service-mesh-bot/sail-operator that referenced this pull request Feb 11, 2026
* upstream/main: (38 commits)
  Improve scorecard test to avoid running on kind cluster inside OCP cl… (istio-ecosystem#1589)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1587)
  Adding TARGET_ARCH to tag definition when run on CI true (istio-ecosystem#1583)
  Expose "peerCaCrl" Ztunnel param added in Helm (istio-ecosystem#1578)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1579)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1577)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1576)
  feat(helm): add RenderChart functions for template rendering (istio-ecosystem#1575)
  refactor: extract shared reconciliation logic into pkg/reconcile (istio-ecosystem#1572)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1573)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1571)
  Add automation for updating EOL Istio versions (istio-ecosystem#1562)
  Fix e2e midstream CI mode (istio-ecosystem#1564)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1565)
  Migrate to fs.FS as the sole resource loading interface (istio-ecosystem#1561)
  Adding documentation for zero downtime ztunnel upgrade (istio-ecosystem#1552)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1563)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1560)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1559)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1558)
  ...
openshift-service-mesh-bot pushed a commit to openshift-service-mesh-bot/sail-operator that referenced this pull request Feb 11, 2026
* upstream/main: (38 commits)
  Improve scorecard test to avoid running on kind cluster inside OCP cl… (istio-ecosystem#1589)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1587)
  Adding TARGET_ARCH to tag definition when run on CI true (istio-ecosystem#1583)
  Expose "peerCaCrl" Ztunnel param added in Helm (istio-ecosystem#1578)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1579)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1577)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1576)
  feat(helm): add RenderChart functions for template rendering (istio-ecosystem#1575)
  refactor: extract shared reconciliation logic into pkg/reconcile (istio-ecosystem#1572)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1573)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1571)
  Add automation for updating EOL Istio versions (istio-ecosystem#1562)
  Fix e2e midstream CI mode (istio-ecosystem#1564)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1565)
  Migrate to fs.FS as the sole resource loading interface (istio-ecosystem#1561)
  Adding documentation for zero downtime ztunnel upgrade (istio-ecosystem#1552)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1563)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1560)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1559)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1558)
  ...
openshift-service-mesh-bot pushed a commit to openshift-service-mesh-bot/sail-operator that referenced this pull request Feb 11, 2026
* upstream/main: (39 commits)
  Add Claude /refactor command for code improvements (istio-ecosystem#1489)
  Improve scorecard test to avoid running on kind cluster inside OCP cl… (istio-ecosystem#1589)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1587)
  Adding TARGET_ARCH to tag definition when run on CI true (istio-ecosystem#1583)
  Expose "peerCaCrl" Ztunnel param added in Helm (istio-ecosystem#1578)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1579)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1577)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1576)
  feat(helm): add RenderChart functions for template rendering (istio-ecosystem#1575)
  refactor: extract shared reconciliation logic into pkg/reconcile (istio-ecosystem#1572)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1573)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1571)
  Add automation for updating EOL Istio versions (istio-ecosystem#1562)
  Fix e2e midstream CI mode (istio-ecosystem#1564)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1565)
  Migrate to fs.FS as the sole resource loading interface (istio-ecosystem#1561)
  Adding documentation for zero downtime ztunnel upgrade (istio-ecosystem#1552)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1563)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1560)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1559)
  ...
openshift-service-mesh-bot pushed a commit to openshift-service-mesh-bot/sail-operator that referenced this pull request Feb 11, 2026
* upstream/main: (39 commits)
  Add Claude /refactor command for code improvements (istio-ecosystem#1489)
  Improve scorecard test to avoid running on kind cluster inside OCP cl… (istio-ecosystem#1589)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1587)
  Adding TARGET_ARCH to tag definition when run on CI true (istio-ecosystem#1583)
  Expose "peerCaCrl" Ztunnel param added in Helm (istio-ecosystem#1578)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1579)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1577)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1576)
  feat(helm): add RenderChart functions for template rendering (istio-ecosystem#1575)
  refactor: extract shared reconciliation logic into pkg/reconcile (istio-ecosystem#1572)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1573)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1571)
  Add automation for updating EOL Istio versions (istio-ecosystem#1562)
  Fix e2e midstream CI mode (istio-ecosystem#1564)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1565)
  Migrate to fs.FS as the sole resource loading interface (istio-ecosystem#1561)
  Adding documentation for zero downtime ztunnel upgrade (istio-ecosystem#1552)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1563)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1560)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1559)
  ...
openshift-service-mesh-bot pushed a commit to openshift-service-mesh-bot/sail-operator that referenced this pull request Feb 12, 2026
* upstream/main: (39 commits)
  Add Claude /refactor command for code improvements (istio-ecosystem#1489)
  Improve scorecard test to avoid running on kind cluster inside OCP cl… (istio-ecosystem#1589)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1587)
  Adding TARGET_ARCH to tag definition when run on CI true (istio-ecosystem#1583)
  Expose "peerCaCrl" Ztunnel param added in Helm (istio-ecosystem#1578)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1579)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1577)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1576)
  feat(helm): add RenderChart functions for template rendering (istio-ecosystem#1575)
  refactor: extract shared reconciliation logic into pkg/reconcile (istio-ecosystem#1572)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1573)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1571)
  Add automation for updating EOL Istio versions (istio-ecosystem#1562)
  Fix e2e midstream CI mode (istio-ecosystem#1564)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1565)
  Migrate to fs.FS as the sole resource loading interface (istio-ecosystem#1561)
  Adding documentation for zero downtime ztunnel upgrade (istio-ecosystem#1552)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1563)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1560)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1559)
  ...
openshift-service-mesh-bot pushed a commit to openshift-service-mesh-bot/sail-operator that referenced this pull request Feb 12, 2026
* upstream/main: (39 commits)
  Add Claude /refactor command for code improvements (istio-ecosystem#1489)
  Improve scorecard test to avoid running on kind cluster inside OCP cl… (istio-ecosystem#1589)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1587)
  Adding TARGET_ARCH to tag definition when run on CI true (istio-ecosystem#1583)
  Expose "peerCaCrl" Ztunnel param added in Helm (istio-ecosystem#1578)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1579)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1577)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1576)
  feat(helm): add RenderChart functions for template rendering (istio-ecosystem#1575)
  refactor: extract shared reconciliation logic into pkg/reconcile (istio-ecosystem#1572)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1573)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1571)
  Add automation for updating EOL Istio versions (istio-ecosystem#1562)
  Fix e2e midstream CI mode (istio-ecosystem#1564)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1565)
  Migrate to fs.FS as the sole resource loading interface (istio-ecosystem#1561)
  Adding documentation for zero downtime ztunnel upgrade (istio-ecosystem#1552)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1563)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1560)
  Automator: Update dependencies in istio-ecosystem/sail-operator@main (istio-ecosystem#1559)
  ...
MaxBab pushed a commit to MaxBab/sail-operator that referenced this pull request Mar 9, 2026
istio-ecosystem#1589)

* Improve scorecard test to avoid running on kind cluster inside OCP clusters

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* Adding default values to scorecard test

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* CHange from review

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

---------

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
istio-testing pushed a commit that referenced this pull request Mar 9, 2026
* Improve scorecard test to avoid running on kind cluster inside OCP cl… (#1589)

* Improve scorecard test to avoid running on kind cluster inside OCP clusters

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* Adding default values to scorecard test

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* CHange from review

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

---------

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* Fix scorecard test failure (#1598)

Scorecard test fails with "namespace not found".
Make sure the namespace is created before executing the scorecard flow.

Signed-off-by: Maxim Babushkin <mbabushk@redhat.com>

---------

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Maxim Babushkin <mbabushk@redhat.com>
Co-authored-by: Francisco Herrera <fjglira@gmail.com>
dgn pushed a commit to dgn/sail-operator that referenced this pull request Mar 17, 2026
istio-ecosystem#1589)

* Improve scorecard test to avoid running on kind cluster inside OCP clusters

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* Adding default values to scorecard test

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

* CHange from review

Signed-off-by: Francisco Herrera <fjglira@gmail.com>

---------

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Daniel Grimm <dgrimm@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants