Skip to content

LG-8754 Targeted AB test logging#7806

Merged
jess-fortier merged 30 commits intomainfrom
jess/LG-8754-targeted-ab-test-logging
Mar 2, 2023
Merged

LG-8754 Targeted AB test logging#7806
jess-fortier merged 30 commits intomainfrom
jess/LG-8754-targeted-ab-test-logging

Conversation

@jess-fortier
Copy link
Contributor

@jess-fortier jess-fortier commented Feb 10, 2023

🎫 Ticket

LG-8754

🛠 Summary of changes

AB test bucket data is now included in the event_properties of the following log events:

  • IdV: IPP CTA Variant Displayed
  • IdV: verify in person troubleshooting option clicked
  • IdV: in person proofing location visited
  • IdV: in person proofing location submitted
  • IdV: in person ready to verify visited

📜 Testing Plan

Proceed through the IPP flow with IPP CTA variant testing enabled and confirm that variant data is present in the event_properties of each of the above events, and that the supplied variant data is consistent with the IPP CTA that is shown to the user when they first fail doc auth. Special cases:

  • PO Search enabled still shows variant data for location log events
  • PO Search disabled still shows variant data for location log events
  • Ready to verify shows variant data the first time and on re-visit as long as the user has not logged out
  • Ready to verify shows empty variant data if accessed after logging out and back in
  • Logs are still present if the user cancels their barcode and restarts the process, perhaps with a different variant bucket.

👀 Screenshots

Samples of each of the 5 log events before and after these changes

Screen Shot 2023-02-23 at 12 51 40 PM

… in select logs to facilitate variant analysis
@jess-fortier jess-fortier changed the title WIP LG-8754 targeted ab test logging LG-8754 Targeted AB test logging Feb 23, 2023
@jess-fortier jess-fortier marked this pull request as ready for review February 23, 2023 20:53
@jess-fortier jess-fortier force-pushed the jess/LG-8754-targeted-ab-test-logging branch from 9ffd6e6 to 90be58d Compare February 27, 2023 22:17
Copy link
Contributor

@zachmargolis zachmargolis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jess-fortier jess-fortier merged commit 5891554 into main Mar 2, 2023
@jess-fortier jess-fortier deleted the jess/LG-8754-targeted-ab-test-logging branch March 2, 2023 17:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants