BLOG
For builders, by builders
ANNOUNCEMENTS
CUPED on Statsig
Run experiments with more speed and accuracy We’re pleased to announce the rollout of CUPED for all our customers. Statsig will now automatically use CUPED to reduce variance and bias on experiments’ key metrics. This gives you access to a powerful experiment...
Introducing the Events Explorer
Today, quickly querying and understanding your product data can be an intimidating task. More often than not, you’ll need knowledge of SQL (or other query language), good understanding of your underlying data model and schema to get started, and the time and...
Monitoring Databricks Structured Streaming Queries in Datadog
At Statsig, we recently transitioned to using structured streaming for our ETL. As the number of streaming queries grew, we wanted a centralized place where we could quickly view a snapshot of all our pipelines. What we want to monitor When it comes to...
POSTS
Quant vs. Qual
💡 How to decide between leaning on data vs. research when diagnosing and solving product problems Four heuristics I’ve found helpful when deciding between data vs. research to diagnose + solve a problem. Earth image credit of Moncast Drawing. As a PM, data...
The Importance of Default Values
Have you ever sent an email to the wrong person? Well I have. At work. From a generic support email address. To a group of our top customers. Facepalm. In March of 2018, I was working on the games team at Facebook. You may remember that month as a tumultuous...
CUPED on Statsig
Run experiments with more speed and accuracy We’re pleased to announce the rollout of CUPED for all our customers. Statsig will now automatically use CUPED to reduce variance and bias on experiments’ key metrics. This gives you access to a powerful experiment...
Culture of Experimentation
You Can’t Invent Without Experimenting When Amazon launched Home Services, the team was convinced that most people want to schedule home installations in the mornings, evenings, or weekends. This naturally constrained the number of available time slots, and...
Leading a team of lions
Training your team to make independent decisions Image Courtesy: The New Yorker “It was like the debate of a group of savages as to how to extract a screw from a piece of wood. Accustomed only to nails, they had made one effort to pull out the screw by main...
Why do my Facebook Groups look different?
Photo by Joshua Hoehne on Unsplash By now, most people realize that when they open Facebook or Instagram on their phone, their experience is very different than the person next to them. It goes deeper than just the content that you see, and the ranking...
Introducing the Events Explorer
Today, quickly querying and understanding your product data can be an intimidating task. More often than not, you’ll need knowledge of SQL (or other query language), good understanding of your underlying data model and schema to get started, and the time and...
Picking Metrics 101
Today we’re going to walk through some thoughts on how to approach picking metrics for an experiment. This isn’t exhaustive, but it should lay solid groundwork for setting yourself up for success with experimentation. Let’s start with a short video,...
Creating a Meme bot for Workplace (by Facebook) Using Statsig
One of my favorite and most used tools at Facebook was the macro tool. The macro tool allowed employees to upload an image or gif, name it, and then use it across many internal surfaces. Within Workplace, all you had to do was type #m followed by the name of...
Early startup journey: My first year at Statsig
Celebrating my first Statsig-versary with a blog post full of memories. A year ago on May 19th, 2021, I took a big leap of faith and departed my satisfying job at Facebook to join an early stage startup called Statsig. Today, I’ve reached my one year mark...
Using Pulse Time Series for Deeper Insights
The Statsig Pulse results page offers a snapshot of all the metric movements driven by an experiment. Sometimes, a brief scan of the color coded score card is enough to validate that all metrics behave as expected, and we quickly proceed with the launch. Other...
Should I Flip That Tailgater Off?
A Bayesian exploration of road rage methodology, and its important applications to experimentation Disclaimer: this is in good fun and I don’t advocate road rage. You, dear reader, are driving somewhere nice. However, the driver behind you is determined to...
Don’t be a Holdout holdout
An opinionated guide on using Holdouts Feature Level Holdouts Good teams move fast. They’re trying several ideas at any given time. When they find something that works, they ship it and find the next idea to try. With some features — it is useful to measure...
Monitoring Databricks Structured Streaming Queries in Datadog
At Statsig, we recently transitioned to using structured streaming for our ETL. As the number of streaming queries grew, we wanted a centralized place where we could quickly view a snapshot of all our pipelines. What we want to monitor When it comes to...
There’s More To Learn From Tests
Split testing has become an important tool for companies across many industries. There’s a huge amount of literature (and Medium posts!) dedicated to examples and explanations of why this is, and why large companies in Tech have built their cultures around...
Try Statsig Today
Explore Statsig’s smart feature gates with built-in A/B tests, or create an account instantly and start optimizing your web and mobile applications. You can also schedule a live demo or chat with us to design a custom package for your business.