-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update experiment slug for goals-first experience #99133
Conversation
Developers can start using the Explat interface for the calypso_signup_onboarding_goals_first_flow_holdout_v2_20250131 experiment.
Jetpack Cloud live (direct link)
Automattic for Agencies live (direct link)
|
This PR modifies the release build for the following Calypso Apps: For info about this notification, see here: PCYsg-OT6-p2
To test WordPress.com changes, run |
Here is how your PR affects size of JS and CSS bundles shipped to the user's browser: App Entrypoints (~22 bytes added 📈 [gzipped])
Common code that is always downloaded and parsed every time the app is loaded, no matter which route is used. Legend What is parsed and gzip size?Parsed Size: Uncompressed size of the JS and CSS files. This much code needs to be parsed and stored in memory. Generated by performance advisor bot at iscalypsofastyet.com. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As described:
✅ Control group see account creation
✅ Treatment cumulative and Treatment frozen both the goals screen
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Related to #99011
Proposed Changes
calypso_signup_onboarding_goals_first_flow_holdout_v2_20250131
experiment slugIt implements the first branch in this flow chart
p1738272885652059/1738193377.949839-slack-C085HCWCEDN
Why are these changes being made?
We are adjusting weightings for the goal-first experience. It's now 10% control and 90% with the goals-first experience. That 90% is split into holdout and cumulative cohorts, but that doesn't make any difference for the
useGoalsFirstExperiment()
hook. Both treatment cohorts get the goals-first experience.wpcalypso
will continue to be forced onto the goals-first experience for stakeholders. But now that we have the new experiment slugs, developers should explicitly choose the cohorts they want to test with.Testing Instructions
calypso_signup_onboarding_goals_first_flow_holdout_v2_20250131
experiment to your desired cohort 22180-explat-experiment/setup/onboarding
control
sees the domains step (or account creation) as the first steptreatment_frozen
andtreatment_cumulative
see the goals screen as the first stepPre-merge Checklist