Notable Quotes
"Diligent's one of those biggest things you've never heard of. We're probably like 2,000 people. We serve maybe 70% of the Fortune 1000."
"It probably took us four months and three to four rounds of tests to get right, but we uncovered like a massive unlock."
"It's almost like the Middle Eastern oil. Anywhere you drill, you hit something."
"Retention and engagement should always ride whatever the natural use case is."
"Claude is a pretty good data scientist, at least for simple A/B test analysis."
Takeaways
Separate your two experimentation modes: high-volume CRO chases many small wins, while big uncertain bets deserve multiple shots to de-risk.
Persistence pays: four months and three to four rounds of trial-model testing at Codecademy produced a 35% conversion increase.
Anchor retention and engagement to the product's natural use case, and use AI to synthesize research and simple A/B analysis in hours instead of weeks.
