Skip to content

Bug 1983614: Add renamed Prometheus test into skipped disconnected list#26261

Merged
openshift-merge-robot merged 1 commit intoopenshift:masterfrom
ardaguclu:fix-renamed-prometheus-test
Jul 21, 2021
Merged

Bug 1983614: Add renamed Prometheus test into skipped disconnected list#26261
openshift-merge-robot merged 1 commit intoopenshift:masterfrom
ardaguclu:fix-renamed-prometheus-test

Conversation

@ardaguclu
Copy link
Member

This PR updates Skipped:Disconnected list with the renamed test.

Previously;
[sig-instrumentation][Late] Alerts shouldn't report any alerts in firing state apart from Watchdog and AlertmanagerReceiversNotConfigured

Currently;
[sig-instrumentation][Late] Alerts shouldn't report any alerts in firing or pending state apart from Watchdog and AlertmanagerReceiversNotConfigured and have no gaps in Watchdog firing

@openshift-ci openshift-ci bot requested review from deads2k and smarterclayton June 22, 2021 14:42
@ardaguclu
Copy link
Member Author

/retest

@ardaguclu
Copy link
Member Author

/test e2e-gcp

@ardaguclu
Copy link
Member Author

/retest

1 similar comment
@ardaguclu
Copy link
Member Author

/retest

@andfasano
Copy link
Contributor

/lgtm
/assign @deads2k

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jul 2, 2021
@deads2k
Copy link
Contributor

deads2k commented Jul 12, 2021

I lack some background here. Why should alerts be allowed to fire in the disconnected case?

If we can detect this, why not simply determine which alerts can fire as opposed to those that shouldn't?

@ardaguclu
Copy link
Member Author

@deads2k, tests under the ICSP section try to pull image-registry.openshift-image-registry.svc:5000/openshift/tools:latest image but they can not accomplish that in disconnected as filed in https://bugzilla.redhat.com/show_bug.cgi?id=1918376 (which seems verified but not backported to 4.8 yet.). Thereby, this Prometheus test in this PR could not go beyond the first step of the test which create a test pod.

As you said, if it did not have any image pull problem, it would be expected to not fire alerts even in disconnected.

@ardaguclu ardaguclu changed the title Add renamed Prometheus test into skipped disconnected list Bug 1983614: Add renamed Prometheus test into skipped disconnected list Jul 19, 2021
@openshift-ci openshift-ci bot added bugzilla/severity-high Referenced Bugzilla bug's severity is high for the branch this PR is targeting. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. labels Jul 19, 2021
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jul 19, 2021

@ardaguclu: This pull request references Bugzilla bug 1983614, which is valid. The bug has been moved to the POST state. The bug has been updated to refer to the pull request using the external bug tracker.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target release (4.9.0) matches configured target release for branch (4.9.0)
  • bug is in the state NEW, which is one of the valid states (NEW, ASSIGNED, ON_DEV, POST, POST)
Details

In response to this:

Bug 1983614: Add renamed Prometheus test into skipped disconnected list

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

`\[sig-instrumentation\]\[Late\] Alerts should have a Watchdog alert in firing state the entire cluster run`,
`\[sig-instrumentation\]\[Late\] Alerts shouldn't exceed the 500 series limit of total series sent via telemetry from each cluster`,
`\[sig-instrumentation\]\[Late\] Alerts shouldn't report any alerts in firing state apart from Watchdog and AlertmanagerReceiversNotConfigured`,
`\[sig-instrumentation\]\[Late\] Alerts shouldn't report any alerts in firing or pending state apart from Watchdog and AlertmanagerReceiversNotConfigured and have no gaps in Watchdog firing`,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we still firing alerts in disconnected mode? Or is this because we can't access the test? This is such a fundamental safety net that the fact that we shipped 4.8 with this failing means we have a huge knowledge gap as to whether disconnected is safe.

Is there a story covering reenabling this test because "we've fixed this"? I see there's a comment up above for "ICSP" - isn't that bug fixed? In the future, please add bugzilla links to these sections that have a bug we can track for "this problem is now fixed".

@smarterclayton
Copy link
Contributor

/approve

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jul 20, 2021

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andfasano, ardaguclu, smarterclayton

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 20, 2021
@openshift-bot
Copy link
Contributor

/retest-required

Please review the full test history for this PR and help us cut down flakes.

3 similar comments
@openshift-bot
Copy link
Contributor

/retest-required

Please review the full test history for this PR and help us cut down flakes.

@openshift-bot
Copy link
Contributor

/retest-required

Please review the full test history for this PR and help us cut down flakes.

@openshift-bot
Copy link
Contributor

/retest-required

Please review the full test history for this PR and help us cut down flakes.

@openshift-merge-robot openshift-merge-robot merged commit 402dba7 into openshift:master Jul 21, 2021
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jul 21, 2021

@ardaguclu: All pull requests linked via external trackers have merged:

Bugzilla bug 1983614 has been moved to the MODIFIED state.

Details

In response to this:

Bug 1983614: Add renamed Prometheus test into skipped disconnected list

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ardaguclu
Copy link
Member Author

/cherrypick release-4.8

@openshift-cherrypick-robot

@ardaguclu: new pull request created: #26344

Details

In response to this:

/cherrypick release-4.8

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ardaguclu ardaguclu deleted the fix-renamed-prometheus-test branch January 25, 2022 08:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. bugzilla/severity-high Referenced Bugzilla bug's severity is high for the branch this PR is targeting. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. lgtm Indicates that a PR is ready to be merged.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants