Introducing Experiment Templates: Streamline your A/B testing

Tue May 21 2024

Ryan Musser

Head of Solutions Engineering, Statsig

We heard you loud and clear: Experiment Templates have arrived.

When you’re running experiments at scale, experiment setup can often be time-consuming and repetitive, especially when you're running multiple tests across different features or products.

That's why we're thrilled to announce the launch of Experiment Templates on Statsig—a new tool to help standardize and accelerate your experimentation process!

What are Experiment Templates?

Experiment Templates are pre-configured blueprints for your A/B tests. They allow you to quickly set up new experiments by reusing configurations, metrics, and settings from successful past experiments. This not only saves time but also ensures consistency across your testing efforts.

With Experiment Templates, you can:

  • Standardize metrics: Define a set of core metrics that are automatically included in every experiment, ensuring you always measure what matters most.

    using experiment templates to standardize metrics
  • Replicate success: Use the settings from your most impactful experiments as a starting point for new tests.

    reusing settings from an existing experiment
  • Collaborate efficiently: Share templates with your team to align on methodologies and accelerate onboarding for new experimenters.

How to create and use Experiment Templates

Creating a new template is simple:

  1. Navigate to the Templates tab: Within your project settings, you'll find the option to manage your templates.

    managing experiment templates
  2. Create from scratch or templatize an existing Experiment: Start with a blank slate or convert an existing experiment into a template with just a few clicks.

    converting an existing experiment into a template
  3. Define your blueprint: Set up your metrics, feature flags, and any other configurations you want to standardize.

  4. Save and share: Once you're happy with your template, save it and make it available to your team.

When you're ready to start a new experiment, simply select your template, and all the predefined settings will be applied, allowing you to focus on the unique aspects of your current test.

Why Experiment Templates matter

In our ongoing conversations with Statsig users, we've heard a clear need for tools that make experimentation more accessible and manageable. Whether it's through our Slack community or direct feedback, you've told us that you want to spend less time setting up and more time analyzing and learning from your experiments.

Experiment Templates are designed to help this by:

  • Reducing setup time: Get your experiments up and running faster, so you can iterate and learn at a quicker pace.

  • Improving experiment quality: By standardizing on proven configurations, you reduce the risk of errors and increase the reliability of your results.

  • Fostering a culture of experimentation: Make it easier for everyone on your team to propose, set up, and run experiments, democratizing the process and encouraging a data-first mindset.

Looking ahead

We can't wait to see how you'll use Experiment Templates! As always, we're here to support you, so if you have any questions or suggestions, don't hesitate to reach out.

Happy experimenting!

Get a free account

Get a free Statsig account today, and ping us if you have questions. No credit card required, of course.
an enter key that says "free account"

Build fast?

Subscribe to Scaling Down: Our newsletter on building at startup-speed.

Try Statsig Today

Get started for free. Add your whole team!
We use cookies to ensure you get the best experience on our website.
Privacy Policy