Skip to content

LG-10922: Display new headings for Hybrid Handoff page on AB test#9316

Merged
night-jellyfish merged 12 commits intomainfrom
brittany/lg-10922-hybrid-handoff-ab-test
Oct 20, 2023
Merged

LG-10922: Display new headings for Hybrid Handoff page on AB test#9316
night-jellyfish merged 12 commits intomainfrom
brittany/lg-10922-hybrid-handoff-ab-test

Conversation

@night-jellyfish
Copy link
Contributor

@night-jellyfish night-jellyfish commented Oct 5, 2023

🎫 Ticket

https://cm-jira.usa.gov/browse/LG-10922

🛠 Summary of changes

This adds a change of heading text to the Hybrid Handoff page, if idv_phone_question_a_b_testing is set to 1. If it's set to 0, (the default), the old copy should remain.

📜 Testing Plan

  • First, check that the old copy still remains:
    • Follow the flow to the /verify/hybrid_handoff page
    • Check that the h1 has the hybrid_handoff text ("How would you like to add your ID?" in English)
    • Check that the h2 has the upload_from_phone text ("Use your phone to take photos" in English)
  • Second, check that the new copy is there:
    • Set idv_phone_question_a_b_testing: '{"bypass_phone_question":0, "show_phone_question":100}' in your application.yml
    • Follow the flow to the /verify/hybrid_handoff page
    • Check that the h1 has the upload_from_phone text ("Use your phone to take photos" in English)
    • Check that the h2 has the upload_from_phone text ("Switch to your phone" in English)

👀 Screenshots

If relevant, include a screenshot or screen capture of the changes.

Before / with `idv_phone_question_a_b_testing: '{"bypass_phone_question":100, "show_phone_question":0}'`: 10922_A_case
After / with `idv_phone_question_a_b_testing: '{"bypass_phone_question":0, "show_phone_question":100}'` 10922_B_case

@night-jellyfish night-jellyfish requested review from a team, eileen-nava and kellular and removed request for a team October 5, 2023 00:11
@night-jellyfish night-jellyfish force-pushed the brittany/lg-10922-hybrid-handoff-ab-test branch from 8bf8d46 to 6c5a108 Compare October 5, 2023 22:55
Copy link

@kellular kellular left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This LGTM! I just wanted to confirm that we have the French and Spanish translations in place for the 1 version: "Use your phone to take photos"? I only saw the "Switch to your phone" translations in the .yml files

@night-jellyfish
Copy link
Contributor Author

@kellular good question (and it made me realize I had a couple of typos in my PR message (fixed now))!

We have Spanish here and French here. Luckily since "Use your phone to take photos" was already used as an h2 in our control / current text, the translations were already there, and we're just bumping it to an h1 for this change.

@night-jellyfish night-jellyfish force-pushed the brittany/lg-10922-hybrid-handoff-ab-test branch from 6099ede to 0d89348 Compare October 16, 2023 21:49
@amirbey
Copy link
Contributor

amirbey commented Oct 17, 2023

looks great @night-jellyfish 👍🏿 ... lastly, can we add a few a/b content checks to feature tests?

@night-jellyfish night-jellyfish force-pushed the brittany/lg-10922-hybrid-handoff-ab-test branch from 15d674f to 7f4e0f4 Compare October 18, 2023 23:15
@night-jellyfish
Copy link
Contributor Author

night-jellyfish commented Oct 18, 2023

@amirbey I added some feature tests in 7f4e0f4, but please let me know if you think more are needed!

Comment on lines 270 to 273
Copy link
Contributor

@amirbey amirbey Oct 19, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding these checks @night-jellyfish ... is it possible these checks could be inserted into one of the already existing tests to reduce the time it takes for our long running batch of specs?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a good point. I struggled with that myself but I wasn't sure how to incorporate them into another spec and keep the reasoning for testing clear. I sometimes think about tests like documentation, and I liked that the context and it blocks let me communicate exactly what I'm testing / what I expect the code to do. It seems like it might help towards your other point of making the test easy to delete, as it's encapsulated.

But, I understand your point about test speed as well, as slow tests can cause problems and pain as well.

Have you found a way to merge the gap between those two pulls (clarity vs speed)?

My thoughts were, since there aren't other tests focused on copy, if I added it to a test, the it block would become a little strange, ex: it 'rate limits sending the link and displays the expected headings', which aren't really related. But, maybe I'm overthinking it.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i also contemplate the same 🤔 .... i've often left the it/context heading unchanged but commented within ... it can be a tough call ... in this case this is more verifying the presence of the text and not so much a result of actions which makes me a bit more comfortable with combining it in a test that is really trying to test a scenario

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the feedback! As discussed over Slack, I agree that since it's just a text change, it's fine to move into the context of other test to reduce impact on test time. I've pushed up this change in 3f7b868.

Since you approved, I'll merge if CI passes - but please let me know if you have any hesitancy on that!

@amirbey amirbey self-requested a review October 19, 2023 15:40
Copy link
Contributor

@amirbey amirbey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ... thanks @night-jellyfish 👍🏿

@night-jellyfish night-jellyfish force-pushed the brittany/lg-10922-hybrid-handoff-ab-test branch from a72d192 to 3f7b868 Compare October 20, 2023 18:09
@night-jellyfish night-jellyfish merged commit 7c5729f into main Oct 20, 2023
@night-jellyfish night-jellyfish deleted the brittany/lg-10922-hybrid-handoff-ab-test branch October 20, 2023 19:01
@mdiarra3 mdiarra3 mentioned this pull request Oct 23, 2023
mdiarra3 added a commit that referenced this pull request Oct 24, 2023
* LG-11083: Enable USPS Public Endpoint (#9355)

* changelog: Internal, In-Person Proofing, Enable public USPS post office search

* Use EnrollmentHelper to switch between mock/real thing

* Try behaves_like

* Revert shared examples for now

* Use full name

* Update report mailer preview to be more realistic (#9419)


**How**: stubs CloudwatchClient

changelog: Internal, Reporting, Updates report preview to use live code

* Add analytics section to frontend documentation (#9421)

* Add analytics section to frontend documentation

changelog: Internal, Documentation, Add analytics frontend documentation

* link to correct javascript package

* LG-11101: Support multiple valid MFA to satisfy authentication request (#9335)

changelog: User-Facing Improvements, MFA, Avoid prompting for MFA in some scenarios where a recent MFA satisfies the requirement

* LG-11148 | Adds monthly report on total verified users (#9376)

changelog: Internal, Reporting, Monthly report now includes total verified users

Also incorporates LG-11150

Co-authored-by: Zach Margolis <zachary.margolis@gsa.gov>

* Remove second MFA prompt exception for strict MFA requirement (#9422)

changelog: User-Facing Improvements, MFA Setup, Add second MFA reminder screen for single-MFA accounts when signing in at AAL2

* LG-11126 Update Start over verifying your identity screen (#9313)

* change text for start over verify screen

* add translations for page

* add changelog

changelog: User-Facing Improvements, IdV By Mail, update text in start
over verifying identity screen

* remove unused i18n

* create new translation with question mark added

* current step indicator for user not in gpo flow yet

* a missing period

* Restore deleted translations, and rename start_over to start_over_new_address

Co-authored-by: Doug Price <douglas.price@gsa.gov>

* New template for confirm start over from request_letter

Add source param to indicate whether referer is request_letter

* Update specs to check for correct template

Co-authored-by: Doug Price <douglas.price@gsa.gov>

* Add before_letter route for new screen, don't use it yet

And analytics

* Lint, unused arg in analytics_events

* alphabetization lint

* Add suggested comment

Co-authored-by: Matt Hinz <matt.hinz@gsa.gov>

* lints

---------

Co-authored-by: Douglas Price <douglas.price@gsa.gov>
Co-authored-by: Sonia Connolly <sonia.connolly@gsa.gov>
Co-authored-by: Matt Hinz <matt.hinz@gsa.gov>

* LG-11198: Update address text (#9420)

Update address text

changelog: User-Facing Improvements, IdV, Update text for address

* LG-10922: Display new headings for Hybrid Handoff page on AB test (#9316)

* changelog: User-Facing Improvements, Doc Auth, Display new headings for Hybrid Handoff page on AB test

Adds:

* Conditional headers depending on which flag is on
* Hybrid handoff show view test
* Translations

* LG-11235: Rename double address verification as ipp_enrollment_in_progress (#9390)

* Removed double address verification replaced with ipp_enrollment_in_progress

* changelog: Internal, In-person Proofing, change DAV references to reflect reality

* Change test description to be closer to what is being changed in the controller

* Addressing 50/50 state concerns in proofer and adjudicator

* Addressing linter issues

* Set missing initial value for dav

* Moving arg with default value to end of list

* Apply suggestions from code review

Adding proper input to job_arguments hash.

Co-authored-by: Zach Margolis <zachmargolis@users.noreply.github.com>

* Adding note about existing ticket for work post 50/50 state

* Resolving Shannon's comments

* Adding back in test for dav, need reader on adjudicator

* Adding back in test for dav, need reader on adjudicator

---------

Co-authored-by: jack.ryan@gsa.gov <johnaryan@fcoh2j-f4t79kf4.myfiosgateway.com>
Co-authored-by: Zach Margolis <zachmargolis@users.noreply.github.com>

* Add --deflate option to data-pull and action-account scripts (#9424)


changelog: Internal, Scripts, Add --deflate option to data-pull and action-account scripts

---------

Co-authored-by: Matt Gardner <wilburnforce@gmail.com>
Co-authored-by: Zach Margolis <zachmargolis@users.noreply.github.com>
Co-authored-by: Andrew Duthie <andrew.duthie@gsa.gov>
Co-authored-by: Matt Wagner <mattwagner@navapbc.com>
Co-authored-by: Zach Margolis <zachary.margolis@gsa.gov>
Co-authored-by: Alex Bradley <alexander.bradley@gsa.gov>
Co-authored-by: Douglas Price <douglas.price@gsa.gov>
Co-authored-by: Sonia Connolly <sonia.connolly@gsa.gov>
Co-authored-by: Matt Hinz <matt.hinz@gsa.gov>
Co-authored-by: jc-gsa <104452882+jc-gsa@users.noreply.github.com>
Co-authored-by: Brittany Greaner <35475380+night-jellyfish@users.noreply.github.com>
Co-authored-by: Jack Ryan <jackryan@navapbc.com>
Co-authored-by: jack.ryan@gsa.gov <johnaryan@fcoh2j-f4t79kf4.myfiosgateway.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants