Frequently Asked Questions

Date of slack thread: 6/30/24

Anonymous: I have created 2 new metrics (last Thursday) for this experiment (AB testing) already checked that metrics are well collected, I select users and overrode them into certain groups, however, I am not getting any results as under. Is there any problem in this setting? and what should I do?

Lin Jia (Statsig): Hi <@U07AC0X2MFB>, in the screenshot you shared, there are only override users who are exposed to the experiment, but no user has passed the targeting gate - is it what you expected?

Lin Jia (Statsig): wrt override users, by default we exclude them from pulse. If you want to include them there is a toggle that you can toggle on.

Anonymous: I only want specific users to be in specific groups but I need the results of them. Are the settings wrong?

Lin Jia (Statsig): You can toggle on ‘Include Overrides in Pulse’ as shown here. Note that this might lead to bias in the experiment result if they are not well randomized.

Anonymous: The save button doesn’t become active. Should I add or give a change in userID?

Vijaye (Statsig): Try that. My guess is the toggle itself will trigger the results, but the UI is confusing. <@U05U0DEQ8V9>