While I heard some people referring to this event as “Spring Break for Geeks,” this event felt like the center of the modern data stack universe. MDS companies were everywhere; both well-known big players but also data startups trying to make a name. As a data meeting, buzzwords were well-represented; Generative AI, the Semantic Layer, data observability—and did we say AI?
This was the first time I’ve attended Data Council and was impressed by the caliber of attendees, the approachability of the venue—and the sheer number of happy hours! But make no mistake, content was King.
Keynote talks were of exceptional quality ranging from DJ Patil, former U.S. Chief Data Scientist and inventor of the term “Data Scientist,” to Jordan Tigani’s “Big Data is Dead” talk. There was so much to take in over the three-day event, but these are my top 3 takeaways:
AI is now! Many AI experts were present, but even those not in the field were trying to figure out the implications. The industry is driving for cheaper, faster, and smaller models, and as LLMs become ubiquitous it seems training data and UX could be an important differentiator. Getting the mode of interaction right to make AI feel natural will be critical.
The Modern Data Stack is Spaghetti with Tomato Sauce kinda mess: Many talks and startups highlighted the duality between problems the MDS has solved and the problems it’s created. The fundamentals matter more than ever: ROI, costs, data quality, and observability. Bundling is a trend to watch out for.
WTF is the semantic layer? This buzzword was everywhere but it’s a critical part of making data accessible for non-data stakeholders. The industry continues its trend in democratizing data and fueling the need for data-driven insights. Augmenting SQL and AI-based querying are making their way into the data warehouse.
Here's a video of my talk from Data Council 2023, on the topic of scaling experimentation to 20 billion users. Enjoy! :)
Hypothesis Testing often confuses data scientists due to mixed teachings on p-values and significance testing. This article clarifies 10 key concepts with visuals and intuitive explanations.
I discussed 8 A/B testing mistakes with Allon Korem (Bell Statistics) and Tyler VanHaren (Statsig). Learn fixes to improve accuracy and drive better business outcomes.
Introducing Differential Impact Detection: Identify how different user groups respond to treatments and gain useful insights from varied experiment results.
Identify power users to drive growth and engagement. Learn to pinpoint and leverage these key players with targeted experiments for maximum impact.
Simplify data pipelines with Statsig. Use SDKs, third-party integrations, and Data Warehouse Native Solution for effortless data ingestion at any stage.
Learn how we use Statsig to enhance our NestJS API servers, reducing request processing time and CPU usage through performance experiments.