Skip to content

Conversation

@cgwalters
Copy link
Member

@cgwalters cgwalters commented Jul 28, 2020

This effectively reverts
fb1c4b4

e2e-fips is currently failing with
/bin/bash: line 15: nodes[i]: unbound variable

See example: https://prow.ci.openshift.org/view/gcs/origin-ci-test/pr-logs/pull/openshift_installer/3918/pull-ci-openshift-installer-master-e2e-aws-fips/1287800541086224384

Looking at this...we already have code to validate
the state of FIPS in the MCO, see:

https://github.com/openshift/machine-config-operator/blob/091afde36ac117ef8b782a85b38ae8783ddf4b70/pkg/daemon/update.go#L571

openshift/machine-config-operator#1252
openshift/machine-config-operator#1233

I think these types of checks should be the MCO's role,
or if we choose not to do that, let's at least implement
them in Go in the existing e2e suite and avoid
nontrivial shell-in-YAML.

@cgwalters
Copy link
Member Author

cc @sallyom

@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: cgwalters
To complete the pull request process, please assign smarterclayton
You can assign the PR to them by writing /assign @smarterclayton in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

This effectively reverts
fb1c4b4

e2e-fips is currently failing with
`/bin/bash: line 15: nodes[i]: unbound variable`

Looking at this...we already have code to validate
the state of FIPS in the MCO, see:

https://github.com/openshift/machine-config-operator/blob/091afde36ac117ef8b782a85b38ae8783ddf4b70/pkg/daemon/update.go#L571

openshift/machine-config-operator#1252
openshift/machine-config-operator#1233

I think these types of checks should be the MCO's role,
or if we choose not to do that, let's at least implement
them in Go in the existing e2e suite and avoid
nontrivial shell-in-YAML.
@cgwalters cgwalters force-pushed the remove-fips-check branch from 786b289 to e2e01f9 Compare July 28, 2020 14:13
value: e2e-aws-fips
- name: TEST_COMMAND
value: |
fips_check
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see no need for pull-ci-openshift-installer-master-e2e-aws-fips and similar jobs if we feel that the MCO test already covers the FIPS angle sufficiently. Can we just drop the jobs, instead of editing them to be identical to vanilla e2e? Or do we feel like we still need coverage on installer PRs of installs with FIPS enabled?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The job injects the fips: true install config still and we're still testing that.

@cgwalters
Copy link
Member Author

/test ci/prow/pj-rehearse

@openshift-ci-robot
Copy link
Contributor

@cgwalters: The specified target(s) for /test were not found.
The following commands are available to trigger jobs:

  • /test promrules
  • /test app-ci-config-dry
  • /test build-farm-consistency
  • /test build01-dry
  • /test build02-dry
  • /test ci-operator-config
  • /test ci-operator-config-metadata
  • /test ci-operator-registry
  • /test config
  • /test core-dry
  • /test core-valid
  • /test correctly-sharded-config
  • /test generated-config
  • /test generated-dashboards
  • /test ordered-prow-config
  • /test owners
  • /test pj-rehearse
  • /test prow-config
  • /test prow-config-filenames
  • /test prow-config-semantics
  • /test release-controller-config
  • /test services-dry
  • /test services-valid
  • /test step-registry-shellcheck
  • /test vsphere-dry
  • /test pylint

Use /test all to run the following jobs:

  • pull-ci-openshift-release-master-app-ci-config-dry
  • pull-ci-openshift-release-master-build-farm-consistency
  • pull-ci-openshift-release-master-build01-dry
  • pull-ci-openshift-release-master-build02-dry
  • pull-ci-openshift-release-master-ci-operator-config
  • pull-ci-openshift-release-master-ci-operator-config-metadata
  • pull-ci-openshift-release-master-ci-operator-registry
  • pull-ci-openshift-release-master-config
  • pull-ci-openshift-release-master-core-dry
  • pull-ci-openshift-release-master-core-valid
  • pull-ci-openshift-release-master-correctly-sharded-config
  • pull-ci-openshift-release-master-generated-config
  • pull-ci-openshift-release-master-generated-dashboards
  • pull-ci-openshift-release-master-ordered-prow-config
  • pull-ci-openshift-release-master-owners
  • pull-ci-openshift-release-master-pj-rehearse
  • pull-ci-openshift-release-master-prow-config
  • pull-ci-openshift-release-master-prow-config-filenames
  • pull-ci-openshift-release-master-prow-config-semantics
  • pull-ci-openshift-release-master-release-controller-config
  • pull-ci-openshift-release-master-services-dry
  • pull-ci-openshift-release-master-services-valid
  • pull-ci-openshift-release-master-step-registry-shellcheck
  • pull-ci-openshift-release-master-vsphere-dry
Details

In response to this:

/test ci/prow/pj-rehearse

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@cgwalters
Copy link
Member Author

/retest

3 similar comments
@cgwalters
Copy link
Member Author

/retest

@cgwalters
Copy link
Member Author

/retest

@cgwalters
Copy link
Member Author

/retest

@smarterclayton
Copy link
Contributor

/hold

The point of the fips check is to verify FIPS is actually on. We need at least one check in test suite or infra that verifies that FIPS turns on. Where is that test? We can't remove this until that exists (MCO checking is not sufficient unless this code changes to check that MCO actually has fips on)

@openshift-ci-robot openshift-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 31, 2020
@cgwalters
Copy link
Member Author

It would be totally possible for the MCO fips check to break and we wouldn't notice (MCO e2es don't currently test fips). But if fips somehow failed to be enabled, the MCO would notice.

I'd agree this is probably worth a "double check". How about a simple e2e test that's the equivalent of this code which checks that if fips: true in the install config, validates that? I will look at writing that.

cgwalters added a commit to cgwalters/origin that referenced this pull request Jul 31, 2020
See discussion in
openshift/release#10488
and https://bugzilla.redhat.com/show_bug.cgi?id=1861095

This test replaces the bash code in the release repo
with a more proper test here.

While here I noticed that the topology tests had some code
that reused the MCD as a handy privileged pod; extract
that to the toplevel utils and use both here and there.
@cgwalters
Copy link
Member Author

Filed
openshift/origin#25362
(My first attempt at writing at test there but if reviewed nicely I promise to try to write more 😉 )

@smarterclayton
Copy link
Contributor

See my comments in the PR - we have to do a couple of things:

  1. continue to support older releases (so this can't be removed for older releases, since otherwise you have to backport to all previous releases and that's not realistic)
  2. preserve the ability to test any suite against a FIPS cluster, and not require every suite to have a FIPS variant
  3. have at least some verification that the environment acknowledged the install request

@smarterclayton
Copy link
Contributor

smarterclayton commented Aug 3, 2020

Since we have to do 1, I'd like to see a version specific or double check that either the old path or some new path is checked in bash and then we can improve this with other code.

@openshift-ci-robot openshift-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Aug 9, 2020
@openshift-ci-robot
Copy link
Contributor

@cgwalters: PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

cgwalters added a commit to cgwalters/origin that referenced this pull request Aug 20, 2020
See discussion in
openshift/release#10488
and https://bugzilla.redhat.com/show_bug.cgi?id=1861095

This test replaces the bash code in the release repo
with a more proper test here.

While here I noticed that the topology tests had some code
that reused the MCD as a handy privileged pod; extract
that to the toplevel utils and use both here and there.
cgwalters added a commit to cgwalters/origin that referenced this pull request Sep 21, 2020
See discussion in
openshift/release#10488
and https://bugzilla.redhat.com/show_bug.cgi?id=1861095

This test replaces the bash code in the release repo
with a more proper test here.

While here I noticed that the topology tests had some code
that reused the MCD as a handy privileged pod; extract
that to the toplevel utils and use both here and there.
cgwalters added a commit to cgwalters/origin that referenced this pull request Sep 22, 2020
See discussion in
openshift/release#10488
and https://bugzilla.redhat.com/show_bug.cgi?id=1861095

This test replaces the bash code in the release repo
with a more proper test here.

While here I noticed that the topology tests had some code
that reused the MCD as a handy privileged pod; extract
that to the toplevel utils and use both here and there.
cgwalters added a commit to cgwalters/origin that referenced this pull request Sep 22, 2020
See discussion in
openshift/release#10488
and https://bugzilla.redhat.com/show_bug.cgi?id=1861095

This test replaces the bash code in the release repo
with a more proper test here.

While here I noticed that the topology tests had some code
that reused the MCD as a handy privileged pod; extract
that to the toplevel utils and use both here and there.
cgwalters added a commit to cgwalters/origin that referenced this pull request Oct 6, 2020
See discussion in
openshift/release#10488
and https://bugzilla.redhat.com/show_bug.cgi?id=1861095

This test replaces the bash code in the release repo
with a more proper test here.

While here I noticed that the topology tests had some code
that reused the MCD as a handy privileged pod; extract
that to the toplevel utils and use both here and there.
@openshift-ci-robot
Copy link
Contributor

@cgwalters: The following tests failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/prow/pj-rehearse e2e01f9 link /test pj-rehearse
ci/prow/ci-testgrid-allow-list e2e01f9 link /test ci-testgrid-allow-list
ci/prow/yamllint e2e01f9 link /test yamllint
ci/prow/boskos-config e2e01f9 link /test boskos-config

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-merge-robot
Copy link
Contributor

@cgwalters: The following tests failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/prow/release-config e2e01f9 link /test release-config
ci/prow/boskos-config-generation e2e01f9 link /test boskos-config-generation
ci/prow/secret-generator-config-valid e2e01f9 link /test secret-generator-config-valid
ci/prow/deprecate-templates e2e01f9 link /test deprecate-templates

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 14, 2021

@cgwalters: The following test failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/prow/ci-secret-generator-config e2e01f9 link /test ci-secret-generator-config

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-bot
Copy link
Contributor

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

@openshift-ci-robot openshift-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 14, 2021
@openshift-bot
Copy link
Contributor

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

@openshift-ci openshift-ci bot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels May 14, 2021
@openshift-bot
Copy link
Contributor

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 13, 2021

@openshift-bot: Closed this PR.

Details

In response to this:

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci openshift-ci bot closed this Jun 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants