Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@ tests:
container:
from: src
- as: e2e-aws
commands: TEST_FOCUS='should provide DNS for the cluster' run-tests
commands: TEST_FOCUS='DNS' TEST_SKIP='(\[Disabled:.+\]|\[Disruptive\]|\[Skipped\]|\[Slow\]|\[Flaky\]|\[local\]|\[Local\])'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@smarterclayton Should these skips be necessary?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need at least [Disabled:.+] option to skip the wildcard dns test.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I thought that problematic tests are skipped internally in the extended test setup code.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe I see the problem now. Only tests who don't match the exclusion list get the suite conformance tags added to them: https://github.com/openshift/origin/blob/master/test/extended/util/test.go#L117

But I think if you're using TEST_FOCUS the internal exclusion list doesn't matter. I still feel like there must be some other way to specify a focus but also use the exclusion list.

Unless @smarterclayton or @stevekuznetsov knows what to do here I say we merge it and revisit.

run-tests
openshift_installer:
cluster_profile: aws
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@ tests:
container:
from: src
- as: e2e-aws
commands: TEST_FOCUS='should provide DNS for the cluster' run-tests
commands: TEST_FOCUS='DNS' TEST_SKIP='(\[Disabled:.+\]|\[Disruptive\]|\[Skipped\]|\[Slow\]|\[Flaky\]|\[local\]|\[Local\])'
run-tests
openshift_installer:
cluster_profile: aws
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,8 @@ presubmits:
- name: JOB_NAME_SAFE
value: e2e-aws
- name: TEST_COMMAND
value: TEST_FOCUS='should provide DNS for the cluster' run-tests
value: TEST_FOCUS='DNS' TEST_SKIP='(\[Disabled:.+\]|\[Disruptive\]|\[Skipped\]|\[Slow\]|\[Flaky\]|\[local\]|\[Local\])'
run-tests
image: ci-operator:latest
imagePullPolicy: Always
name: ""
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,8 @@ presubmits:
- name: JOB_NAME_SAFE
value: e2e-aws
- name: TEST_COMMAND
value: TEST_FOCUS='should provide DNS for the cluster' run-tests
value: TEST_FOCUS='DNS' TEST_SKIP='(\[Disabled:.+\]|\[Disruptive\]|\[Skipped\]|\[Slow\]|\[Flaky\]|\[local\]|\[Local\])'
run-tests
image: ci-operator:latest
imagePullPolicy: Always
name: ""
Expand Down