Skip to content

Change logout timer test to be less specific#8653

Closed
jmax-gsa wants to merge 1 commit intomainfrom
flaky-tests/fix-flaky-countdown-timer-check
Closed

Change logout timer test to be less specific#8653
jmax-gsa wants to merge 1 commit intomainfrom
flaky-tests/fix-flaky-countdown-timer-check

Conversation

@jmax-gsa
Copy link
Contributor

🛠 Summary of changes

We were checking for the actual value of the countdown timer; now we're just checking that it's here and numeric. Flaky test failure where the generated regex was covering 49-58 seconds, and the displayed seconds value was 59.

📜 Testing Plan

Monitor CI for failures of this spec.

We were checking for the actual value of the countdown timer; now
we're just checking that it's here and numeric. Flaky test failure
where the generated regex was covering 49-58 seconds, and the
displayed seconds value was 59.

[skip changelog]
@jmax-gsa jmax-gsa requested a review from aduth June 23, 2023 18:38
@aduth
Copy link
Contributor

aduth commented Jun 26, 2023

Is there an example failing build to link to for comparison?

Flaky test failure where the generated regex was covering 49-58 seconds, and the displayed seconds value was 59.

The goal with the spec is to make sure that it does count downward, which I think is being lost in the revisions. I'd have assumed that even if it was displaying 59, the wait: 5 would wait for a number within the 49-58 range.

Maybe it's enough to check the minutes go down from session_timeout_in_minutes to session_timeout_in_minutes - 1. In other words, we only need the minutes_pattern check? I don't see any difference in checking seconds_pattern, since it's essentially the same as minutes_pattern.

@aduth
Copy link
Contributor

aduth commented Jun 26, 2023

Some thoughts for future debugging / reintroducing the specific checks:

@jmax-gsa jmax-gsa closed this Aug 1, 2023
@aduth aduth deleted the flaky-tests/fix-flaky-countdown-timer-check branch December 7, 2023 18:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants