Skip to content

Conversation

@wking
Copy link
Member

@wking wking commented Oct 18, 2023

We'd tried this previously in 3c1da8e (#32153), but had to roll it back with d61129c (#32249), to avoid failing:

Prometheus when installed on the cluster should report telemetry if a cloud.openshift.com token is present

Subsequently, openshift/origin@76652fa4fa (openshift/origin#27422) taught that test-case about the config knob this step uses to disable Telemetry. Those test-case changes are present in origin test suites starting in 4.12:

$ for Y in $(seq 11 15); do git --no-pager grep 'should report telemetry' "origin/release-4.${Y}" -- test/extended/prometheus/prometheus.go; done
origin/release-4.11:test/extended/prometheus/prometheus.go:             g.It("should report telemetry if a cloud.openshift.com token is present [Late]", func() {
origin/release-4.12:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
origin/release-4.13:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
origin/release-4.14:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {
origin/release-4.15:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {

and 4.10 is end-of-life since 2023-09-10. That leaves tests using 4.11 versions of the origin suite, and I'm addressing those via the JOB_NAME checks. The checks are brittle, leaving out 4.9 and earlier, and possibly not matching some 4.11 jobs, but they will hopefully be sufficient to get us through until 4.11 goes end-of-life on 2024-02-10. And when the defaulting logic breaks down, jobs that have an opinion can set TELEMETRY_ENABLED explicitly to match their needs.

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Oct 18, 2023
@openshift-ci-robot
Copy link
Contributor

@wking: This pull request references OTA-740 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.15.0" version, but no target version was set.

Details

In response to this:

We'd tried this previously in 3c1da8e (#32153), but had to roll it back with d61129c (#32249), to avoid failing:

Prometheus when installed on the cluster should report telemetry if a cloud.openshift.com token is present

Subsequently, openshift/origin@76652fa4fa (openshift/origin#27422) taught that test-case about the config knob this step uses to disable Telemetry. Those test-case changes are present in origin test suites starting in 4.12:

$ for Y in $(seq 11 15); do git --no-pager grep 'should report telemetry' "origin/release-4.${Y}" -- test/extended/prometheus/prometheus.go; done
origin/release-4.11:test/extended/prometheus/prometheus.go:             g.It("should report telemetry if a cloud.openshift.com token is present [Late]", func() {
origin/release-4.12:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
origin/release-4.13:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
origin/release-4.14:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {
origin/release-4.15:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {

and 4.10 is end-of-life since 2023-09-10. That leaves tests using 4.11 versions of the origin suite, and I'm addressing those via the JOB_NAME checks. The checks are brittle, leaving out 4.9 and earlier, and possibly not matching some 4.11 jobs, but they will hopefully be sufficient to get us through until 4.11 goes end-of-life on 2024-02-10. And when the defaulting logic breaks down, jobs that have an opinion can set TELEMETRY_ENABLED explicitly to match their needs.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot
Copy link
Contributor

@wking, pj-rehearse: unable to determine affected jobs. This could be due to a branch that needs to be rebased. ERROR:

couldn't prepare candidate: couldn't get ref: Get "http://ghproxy/repos/openshift/release/git/refs/heads/master": dial tcp 172.30.229.2:80: i/o timeout
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 10 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 20 rehearsals
Comment: /pj-rehearse max to run up to 35 rehearsals
Comment: /pj-rehearse auto-ack to run up to 10 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@wking
Copy link
Member Author

wking commented Oct 19, 2023

Maybe the proxy is alive again:

/pj-rehearse

@wking
Copy link
Member Author

wking commented Oct 19, 2023

Not sure where Prow/Tide got off too. Closing/reopening, to see if that unsticks them.

@wking wking closed this Oct 19, 2023
@wking wking reopened this Oct 19, 2023
@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Oct 19, 2023

@wking: This pull request references OTA-740 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.15.0" version, but no target version was set.

Details

In response to this:

We'd tried this previously in 3c1da8e (#32153), but had to roll it back with d61129c (#32249), to avoid failing:

Prometheus when installed on the cluster should report telemetry if a cloud.openshift.com token is present

Subsequently, openshift/origin@76652fa4fa (openshift/origin#27422) taught that test-case about the config knob this step uses to disable Telemetry. Those test-case changes are present in origin test suites starting in 4.12:

$ for Y in $(seq 11 15); do git --no-pager grep 'should report telemetry' "origin/release-4.${Y}" -- test/extended/prometheus/prometheus.go; done
origin/release-4.11:test/extended/prometheus/prometheus.go:             g.It("should report telemetry if a cloud.openshift.com token is present [Late]", func() {
origin/release-4.12:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
origin/release-4.13:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
origin/release-4.14:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {
origin/release-4.15:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {

and 4.10 is end-of-life since 2023-09-10. That leaves tests using 4.11 versions of the origin suite, and I'm addressing those via the JOB_NAME checks. The checks are brittle, leaving out 4.9 and earlier, and possibly not matching some 4.11 jobs, but they will hopefully be sufficient to get us through until 4.11 goes end-of-life on 2024-02-10. And when the defaulting logic breaks down, jobs that have an opinion can set TELEMETRY_ENABLED explicitly to match their needs.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 19, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: wking

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 19, 2023
@openshift-ci-robot
Copy link
Contributor

@wking, pj-rehearse: failed to create rehearsal jobs ERROR:

failed to ensure imagestreamtags in cluster build01: failed waiting for imagestreamtag openshift/knative-v0.26.0:knative-eventing-src to appear: timed out waiting for the condition

If the problem persists, please contact Test Platform.

@wking wking force-pushed the disable-telemetry-v2 branch from bdb8486 to be53f06 Compare October 19, 2023 02:54
@jupierce
Copy link
Contributor

Trying to fix shellcheck anger here: #44591

@petr-muller
Copy link
Member

/cc

@openshift-ci openshift-ci bot requested a review from petr-muller October 19, 2023 13:35
We'd tried this previously in 3c1da8e (OTA-740:
ci-operator/step-registry/ipi/conf/telemetry: Disable Telemetry
(openshift#32153), 2022-09-13), but had to roll it back with d61129c
(ci-operator/step-registry/ipi/conf/telemetry: Restore Telemetry
(openshift#32249), 2022-09-13), to avoid failing:

  Prometheus when installed on the cluster should report telemetry if a cloud.openshift.com token is present

Subsequently, openshift/origin@76652fa4fa (test/extended/prometheus:
Consider telemeterClient.enabled, 2022-09-15, openshift/origin#27422)
taught that test-case about the config knob this step uses to disable
Telemetry.  Those test-case changes are present in origin test suites
starting in 4.12:

  $ for Y in $(seq 11 15); do git --no-pager grep 'should report telemetry' "origin/release-4.${Y}" -- test/extended/prometheus/prometheus.go; done
  origin/release-4.11:test/extended/prometheus/prometheus.go:             g.It("should report telemetry if a cloud.openshift.com token is present [Late]", func() {
  origin/release-4.12:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
  origin/release-4.13:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Late]", func() {
  origin/release-4.14:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {
  origin/release-4.15:test/extended/prometheus/prometheus.go:             g.It("should report telemetry [Serial] [Late]", func() {

and 4.10 is end-of-life since 2023-09-10 [1].  That leaves tests using
4.11 versions of the origin suite, and I'm addressing those via the
JOB_NAME checks [2,3].  The checks are brittle, leaving out 4.9 and
earlier, and possibly not matching some 4.11 jobs, but they will
hopefully be sufficient to get us through until 4.11 goes end-of-life
on 2024-02-10 [3].  And when the defaulting logic breaks down, jobs
that have an opinion can set TELEMETRY_ENABLED explicitly to match
their needs.

[1]: https://access.redhat.com/support/policy/updates/openshift/#dates
[2]: https://docs.ci.openshift.org/docs/architecture/step-registry/#available-environment-variables
[3]: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
@wking wking force-pushed the disable-telemetry-v2 branch from be53f06 to eeb5314 Compare October 19, 2023 14:58
@openshift-ci-robot
Copy link
Contributor

[REHEARSALNOTIFIER]
@wking: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-openshift-etcd-openshift-4.16-e2e-aws-ovn openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.15-e2e-aws-ovn openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.14-e2e-aws-ovn openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.13-e2e-aws-ovn openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.12-e2e-aws-ovn openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.11-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.10-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.9-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.8-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.7-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.6-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.5-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.4-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.3-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.2-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.1-e2e-aws openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.16-e2e-aws-etcd-recovery openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.15-e2e-aws-etcd-recovery openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.14-e2e-aws-etcd-recovery openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.13-e2e-aws-etcd-recovery openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.12-e2e-aws-etcd-recovery openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.11-e2e-aws-etcd-recovery openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.16-e2e-aws-ovn-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.15-e2e-aws-ovn-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.14-e2e-aws-ovn-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.13-e2e-aws-ovn-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.12-e2e-aws-ovn-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.11-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.10-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.9-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.8-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.7-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.6-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.5-e2e-aws-serial openshift/etcd presubmit Registry content changed
pull-ci-openshift-etcd-openshift-4.4-e2e-aws-serial openshift/etcd presubmit Registry content changed

A total of 14133 jobs have been affected by this change. The above listing is non-exhaustive and limited to 35 jobs.

A full list of affected jobs can be found here

Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 10 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 20 rehearsals
Comment: /pj-rehearse max to run up to 35 rehearsals
Comment: /pj-rehearse auto-ack to run up to 10 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@wking
Copy link
Member Author

wking commented Oct 19, 2023

Replaced by #44591 🙇

@wking wking closed this Oct 19, 2023
@wking wking deleted the disable-telemetry-v2 branch October 19, 2023 23:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants