Frequently Asked Questions

In the scenario where you have two experiments running for two different groups of users (for instance, free users and paid users), and a user transitions from one experiment to another (like from a free user to a paid user), there isn't a direct way to ensure that this user will be placed in the same group (TEST GROUP) in the new experiment. The assignment of users to experiment groups is randomized to maintain the integrity of the experiment results.

However, if you want to maintain consistency in the user experience, you might consider using the Stable ID as the experiment's unit type. This ID persists on the user's device, allowing them to have the same experience across different states (like logged out to logged in, or free to paid). It's important not to change the experiment type midway. If the experiment spans different user states, it's best to stick with the Stable ID.

In addition, we offer a feature called Layers which allows you to ensure experiments are mutually exclusive, and that a user is only assigned to one of the tests within the Layer. We also support “Targeting Gates”, which determines if a user should be allocated to an experiment based on some criteria (ie; targeting paid vs free users).

Once a user is qualified for an experiment, we randomize that user into either Test or Control by default. So it’s possible for a user to be in Test in ExperimentA and Control in experimentB.