Notable Quotes
"You almost have to earn the right to A-B test within the customer environment. It's not just something that any old idea is going to get thrown into the mix."
"Sometimes you get a chance to influence people's perspectives and opinions once."
"I think too many companies stack too many of these non-facts into beliefs within their organization. And that prevents actual progress and growth."
Takeaways
Purge “anti-knowledge” by standardizing design, instituting cross-functional reviews, and only codifying learnings supported by repeatable data.
Enforce experiment hygiene: change one variable at a time, randomize at the right unit (account vs. user), and run long enough for effect size.
Add video interviewer options to increase response richness (14x more words) while keeping completion rates steady.
