Platform

Resources

Docs Blog Pricing

Platform

Resources

Platform

Resources

Experiment Setup Configuration UX, Automated A/A Test Reports, and more

< All updates

9/30/2022

Permalink ›

Experiment Setup Configuration UX, Automated A/A Test Reports, and more!

Happy FRIDAY, Statsig Community! We've made it to the end of the week, which means it's time for another set of product launch announcements!

New Experiment Setup Configuration UX

Today, we’re excited to debut a sleek new configuration UX for experiment groups and parameters. Easily see your layer allocation, any targeting gates you’re using, experiment parameters, groups, and group split percentages in one, clear visual breakdown.

We believe this will make setting up experiments more intuitive for members of your team who are newer to Statsig, as well as give experiment creators and viewers alike an intuitive overview of how the experiment is configured.

Automated A/A Test Reports

It’s oftentimes considered best practice to regularly ensure the health of your stats engine and your metrics by running periodic A/A tests. We’ve made running these A/A tests at scale easy by setting up simulated A/A tests that run every day in the background, for every company on the platform. Starting today, you can download the running history of your simulated A/A test performance via the “Tools” menu in your Statsig Console.

We run 10 tests/ day, and the download will include your last 30 days of test results. Please note that we only started running these simulations ~1 week ago, so a download today will only include ~70 sets of simulation results.

Loved by customers at every stage of growth

See what our users have to say about building with Statsig

Testimonials

"At OpenAI, we want to iterate as fast as possible. Statsig enables us to grow, scale, and learn efficiently. Integrating experimentation with product analytics and feature flagging has been crucial for quickly understanding and addressing our users' top priorities."

Dave Cummings

Engineering Manager, ChatGPT

"We evaluated Optimizely, LaunchDarkly, Split, and Eppo, but ultimately selected Statsig due to its comprehensive end-to-end integration. We wanted a complete solution rather than a partial one, including everything from the stats engine to data ingestion."

Don Browning

SVP, Data & Platform Engineering

"Statsig has been a game changer for how we combine product development and A/B testing. It's made it a breeze to implement experiments with complex targeting logic and feel confident that we're getting back trusted results. It’s the first commercially available A/B testing tool that feels like it was built by people who really get product experimentation."

Joel Witten

Head of Data

"We knew upon seeing Statsig’s user interface that it was something a lot of teams could use."

Laura Spencer

Chief of Staff

"The beauty is that Statsig allows us to both run experiments, but also track the impact of feature releases."

Evelina Achilli

Product Growth Manager

"Statsig is my most recommended product for PMs."

Erez Naveh

VP of Product

"Brex's mission is to help businesses move fast. Statsig is now helping our engineers move fast. It has been a game changer to automate the manual lift typical to running experiments and has helped product teams ship the right features to their users quickly."

Karandeep Anand

President

"We only had so many analysts. Statsig provided the necessary tools to remove the bottleneck. I know that we are able to impact our key business metrics in a positive way with Statsig. We are definitely heading in the right direction with Statsig."

Partha Sarathi

Director of Engineering

"Statsig has enabled us to quickly understand the impact of the features we ship."

Shannon Priem

Lead PM

"I know that we are able to impact our key business metrics in a positive way with Statsig. We are definitely heading in the right direction with Statsig."

Partha Sarathi

Director of Engineering

"Working with the Statsig team feels like we’re working with a team within our own company."

Jeff To

Engineering Manager

"[Statsig] enables shipping software 10x faster, each feature can be in production from day 0 and no big bang releases are needed."

Matteo Hertel

Founder

"At Notion, we're continuously learning what our users value and want every team to run experiments to learn more. It’s also critical to maintain speed as a habit. Statsig's experimentation platform enables both this speed and learning for us."

Mengying Li

Data Science Manager

"Excited to bring Statsig to Whatnot! We finally found a product that moves just as fast as we do and have been super impressed with how closely our teams collaborate."

Rami Khalaf

Product Engineering Manager

"We realized that Statsig was investing in the right areas that will benefit us in the long-term."

Omar Guenena

Engineering Manager

"Having a dedicated Slack channel and support was really helpful for ramping up quickly."

Michael Sheldon

Head of Data

"Statsig takes away all the pre-work of doing experiments. It's really easy to setup, also it does all the analysis."

Elaine Tiburske

Data Scientist

We use cookies to ensure you get the best experience on our website.