See all guests
Mayank Agarwal
Mayank Agarwal is Director of Product Management for AI Products at RingCentral, where he builds and measures AI agents in production. He created DART, a four-metric framework for evaluating AI agent performance, and focuses on how teams can test, measure, and ultimately trust increasingly autonomous AI features before putting them in front of customers.
Notable Quotes
"An AI agent can be accurate on the narrow task defined in the test dataset and still fail the user completely."
"When people rewrite everything that the AI gives them, you know that you have not earned the user's trust."
"It finished the job, but nobody trusted the output."
"If you keep showing someone a flash sale, then people are trained to assume that another one is always around the corner."
"You cannot A/B test a probabilistic system the way you would test a button color."
Top takeaways from our favorite conversations
All Takeaways
No items found.
