Experimentation Week 2025

Experimentation Week is back this summer!

5 days. 5 launches.

At Statsig, we take pride in being the most advanced experimentation platform, and we’re committed to continuously innovating and pushing the boundaries.

To celebrate Experimentation Week ’25, we’re rolling out five new advanced capabilities.

Follow along on LinkedIn for daily drops throughout the week.

Experimentation Week 2025

Day 1 - CURE

CURE: (variance) control using regression estimates is our advanced implementation of CUPED that lets you add arbitrary covariate data for regression adjustment.

🎥 Watch the demo

Mystery Box

Day 2 - SPRT

Sequential probability ratio test: This is an advanced A/B testing technique that accelerates decision-making. It moves away from communicating p-values and instead computes ‘likelihood ratios’. Learn more in our docs.

🎥 Watch the demo

Mystery Box

Day 3 - Grid Search

This technique allows you to systematically test combinations of model hyperparameters to find the best-performing one.

🎥 Watch the demo

Mystery Box

Day 4 - Experiment Exposures Analysis

You can treat experiment exposures just like any other event in metrics drilldowns and funnel charts, helping you debug faster and gain insights into the conversion paths of users exposed to an experiment variant.

🎥 Watch the demo

Mystery Box

Day 5 - Offline Evaluations

Store prompts and models as configs and benchmark them against your eval dataset whenever you make a change. Then, ship to production as an experiment to measure the real user impact.

🎥 Watch the demo

Mystery Box

Benchmark your experimentation platform

Curious about the key features of a modern experimentation system and how yours compares?
We use cookies to ensure you get the best experience on our website.
Privacy Policy