WIP [DO NOT MERGE]: Increase timeout for TestAWSELBConnectionIdleTimeout

[gcs278]

WIP DO NOT MERGE

CI testing for TestAWSELBConnectionIdleTimeout increased timeout.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from gcs278. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[gcs278]

/test e2e-aws-operator

[gcs278]

still failed extending the DNS Lookup to 10 minutes https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/openshift_cluster-ingress-operator/940/pull-ci-openshift-cluster-ingress-operator-master-e2e-aws-operator/1663890285484052480

Edit: see #940 (comment)

[gcs278]

Actually, I take that back. It looks like it actually made progress, but it's super messy.

1. It took just over 5 minutes, then it passed, the net.LookupIP(route.Spec.Host) polling loop.
2. Then I see:

=== NAME  TestAll/parallel/TestAWSELBConnectionIdleTimeout
    operator_test.go:2737: found expected annotation service.beta.kubernetes.io/aws-load-balancer-connection-idle-timeout=120

which means it moved on to the last polling loop where it does a client.Do(request):

cluster-ingress-operator/test/e2e/operator_test.go

Line 2762 in 5cd2a01

response, err := client.Do(request)

3. It then switches to these EOF errors (seems like progress):

=== NAME  TestAll/parallel/TestAWSELBConnectionIdleTimeout
    operator_test.go:2765: got unexpected error after elapsed time 2.589120429s: Get "http://idle-timeout-httpd-openshift-ingress.test-idle-timeout.ci-op-f53br6ii-43abb.origin-ci-int-aws.dev.rhcloud.com": EOF

for a little bit
4. Then it switches back to no such host:

    operator_test.go:2765: got unexpected error after elapsed time 2.071273ms: Get "http://idle-timeout-httpd-openshift-ingress.test-idle-timeout.ci-op-f53br6ii-43abb.origin-ci-int-aws.dev.rhcloud.com": dial tcp: lookup idle-timeout-httpd-openshift-ingress.test-idle-timeout.ci-op-f53br6ii-43abb.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: no such host

Adding a larger timeout to the last polling loop, I wonder if the update to the LB Service needs another rollout/update of the ELB. Things might be getting slower with AWS.

[gcs278]

It worked once: https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/openshift_cluster-ingress-operator/940/pull-ci-openshift-cluster-ingress-operator-master-e2e-aws-operator/1664269914006884352
Will review timing to see if it mattered this time.
/test e2e-aws-operator

[gcs278]

2nd try, it worked, failed on other things
/test e2e-aws-operator

[gcs278]

3rd try - TestRouterCompressionOperation failed...
/test e2e-aws-operator

[gcs278]

The last run seemed to work okay, didn't see the "bouncing"
/test e2e-aws-operator

[openshift-ci]

@gcs278: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-azure-ovn	f798341	link	false	/test e2e-azure-ovn
ci/prow/e2e-hypershift	f798341	link	true	/test e2e-hypershift
ci/prow/e2e-gcp-ovn	f798341	link	false	/test e2e-gcp-ovn
ci/prow/e2e-aws-operator	f798341	link	true	/test e2e-aws-operator
ci/prow/e2e-aws-ovn-upgrade	f798341	link	true	/test e2e-aws-ovn-upgrade

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[openshift-merge-robot]

PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[gcs278]

I think I got out of this what I needed to solve the bug.
https://issues.redhat.com/browse/OCPBUGS-14966 has now been opened and I have a reproducer that is not in CI.

[gcs278]

/close

[openshift-ci]

@gcs278: Closed this PR.

Details

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.