Webinar On-Demand

Sanity checks to conduct with every experiment

Ronny Kohavi and Luke Sonnet dig into A/B tests that looked like winners, but were not trustworthy

Ronny Kohavi, best-selling author, Maven instructor, and experimentation expert, joins Luke Sonnet, Head of Experimentation at GrowthBook, to share why some winning A/B tests are not trustworthy.

They'll cover the red flags and how pressure-test your own experiments before you act on them.

Topics

  • Why power calculations are non-negotiable
  • How to read p-values and false positive risk correctly
  • Catching Sample Ratio Mismatch and other data red flags

Speakers

  • Ronny Kohavi – Technical Fellow and VP at Microsoft & Airbnb, Maven instructor, and co-author of: Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
  • Luke Sonnet – Head of Experimentation, GrowthBook, previously Twitter and Facebook

More events

Live Event

Experimentation that runs in Snowflake

Live Event

Ship safely, measure everything

Live Event

Learn as fast as you ship: Experimentation for product builders and their AI agents

Ready to ship faster?

No credit card required. Start with feature flags, experimentation, and product analytics — free.

Simplified white illustration of a right angle ruler or carpenter's square tool.White checkmark symbol with a scattered pixelated effect around its edges on a transparent background.