Statsig currently supports metrics calculation for a single production environment. If you have multiple environments set up, you will only be able to use one as your production environment for metrics and experiments.
When running an experiment, the default behavior is that the experiment will run in all environments. This means that if you try to access the config values of the experiment, you will get a valid value, even if you are in a non-production environment.
If you want your experiment to only run on production, you can set a targeting gate. This will ensure that only users in the production environment will pass the gate and be included in the experiment.
Here is an example of how you might access the config values of an experiment:
javascript useExperiment(XXX).config.get(YYY, false);
In this example, XXX
is the experiment you are running, and YYY
is the config value you are trying to access. If the experiment is not running in the current environment, you will get the default fallback value, which is false
in this case.
Remember, once you start an experiment, it will run in all environments unless you set a targeting gate to restrict it to specific environments.
The best practice is to use the experiment checklist and diagnostics tab to instrument the test, enable it in lower environments, and validate that exposures are flowing through. Then, when you’ve validated these, you click “Start” to go to production. This workflow is typically adequate for most users.
Please note that this is subject to change as Statsig continues to evolve and add new features. Always refer to the official Statsig documentation for the most up-to-date information.