Today, we’re thrilled to introduce two upgrades to our Diagnostics tab, which enable easier debugging of gates & experiments-
Upgraded Logstream- We’ve added the ability to access longer-term log history, as well as filter by things like rule, reason, experiment group, user properties, and other metadata to enable easily pinpointing the most important logs for your debugging.
Imbalanced exposures are the last thing you want to see when launching a new experiment, and often seeing this failing health check kicks off a deep-dive into isolating where the imbalance is coming from. We’ve now exposed more detail into the SRM we’re observing, including how the p-value is trending over time, as well as some auto-generated cuts of p-value (e.g. by browser_version, os, region, etc.) to help you isolate where the imbalance may be disproportionately coming from.