Notable Quotes
"We run over about 12,000 experiments per year. Over 42 million monthly active users on DoorDash's platform at peak range, something like 300 million evaluations of experiments with feature flags per second."
"Our leadership, including our CEO, Tony, would read and reply to those experiment emails and would congratulate folks, but also encourage them to try some alternative ways."
"With AI, we've been able to ship a lot more features. The barrier to entry to build and test and launch a feature has been lowered. But with more and more features coming, we want to make sure that we experiment with them and those features provide customer value."
"There's no such thing as a failed experiment. Every experiment is a learning opportunity, no matter how it goes."
"We can have a lot of opinions, but at the end of the day, it doesn't matter what we think. What matters is what our customers actually do — their behavior."
Takeaways
Win rate matters less than learnings per test — DoorDash ships company-wide experiment summaries (win or lose) that the CEO actively reads and responds to, creating cultural accountability around testing rigor.
AI scales institutional knowledge, not just analysis speed — mining past experiment readouts to auto-generate new hypotheses turns your testing history into a compounding advantage.
Democratization requires opinionated templates, not open-ended tools — enabling non-technical users to run tests means embedding success metrics and guardrails into pre-built experiment configs.
