Skip to content

LG-16117 Create A/B test toggle to support manual upload removal#12139

Merged
theabrad merged 4 commits intomainfrom
abrad-lg-16117-ab-test-for-manual-upload
May 6, 2025
Merged

LG-16117 Create A/B test toggle to support manual upload removal#12139
theabrad merged 4 commits intomainfrom
abrad-lg-16117-ab-test-for-manual-upload

Conversation

@theabrad
Copy link
Copy Markdown
Contributor

@theabrad theabrad commented May 5, 2025

🎫 Ticket

Link to the relevant ticket:
LG-16117

🛠 Summary of changes

Set up the initial A/B testing for disabling manual document upload.

📜 Testing Plan

Provide a checklist of steps to confirm the changes.

  • Make sure A/B test specs pass

theabrad and others added 2 commits May 5, 2025 17:33
Co-authored-by: Malik Warren <malik.warren@gsa.gov>
changelog: Upcoming Features, Doc Auth, add a/b test for disabling manual document upload
doc_auth_error_glare_threshold: 40
doc_auth_error_sharpness_threshold: 40
doc_auth_manual_upload_disabled_a_b_testing_enabled: false
doc_auth_manual_upload_disabled_a_b_testing_percent: 50
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
doc_auth_manual_upload_disabled_a_b_testing_percent: 50
doc_auth_manual_upload_disabled_a_b_testing_percent: 0

user&.uuid
end.freeze

DOC_AUTH_MANUAL_UPLOAD_DISABLED = AbTest.new(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
DOC_AUTH_MANUAL_UPLOAD_DISABLED = AbTest.new(
DOC_AUTH_MANUAL_UPLOAD_ENABLED = AbTest.new(

for readability, i prefer affirmative as opposed to having to later use/read double negatives( ie: !disabled)... could choose to rename throughout PR, but your call

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True. Would we have to change the percentage around for the affirmative if we change to enabled? For example with the disabled name it would be doc_auth_manual_upload_disabled_percent: 15. Would we use doc_auth_manual_upload_enabled_percent: 85 instead?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i tend to default percentages to 0 .... and i see your point

ultimately... this is temporary ... i think it's fine to leave as is 👍🏿

Copy link
Copy Markdown
Contributor

@amirbey amirbey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍🏿

@theabrad theabrad merged commit a0ad53e into main May 6, 2025
1 check passed
@theabrad theabrad deleted the abrad-lg-16117-ab-test-for-manual-upload branch May 6, 2025 14:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants