Notable Quotes
"You fail fast. Once you fail fast, you learn from it and get back to from where you started and make this product better, even better than what you have imagined before."
"Why not make this platform self-serve that anyone who does not know a thing, anything about technology, they can start using those platforms and run those experiments for customers."
"Every customer matters. It is even if five percent of the customers are not able to see those experiences, that is a big deal."
"Once you learn it and until unless it is not documented, it was never encountered."
"It is combination of primary KPI, secondary KPI, but it should be driven by hypothesis, not by a leader wants to run some experiment or develop a product."
Takeaways
AI saves real time in experiment analysis, but a human in the loop must validate anything AI produces before it goes live.
A simple fallback, like a two second load rule, can save an ambitious experiment without sacrificing coverage or security.
Metrics should be driven by the experiment's hypothesis, not chosen by leadership in a silo. Pair a primary KPI with secondary KPIs for return behavior.
