See all guests

Ashraf Karim
Ashraf Karim is Senior Vice President of Connected Customer Experiences and Technology at ServiceNow, where she owns the entire post-sale experience and leads the company's Customer Zero program, running ServiceNow on ServiceNow. Her background spans data-driven customer experience work at Google, PayPal and Verizon. She brings deep expertise in agentic AI adoption and in measuring nondeterministic systems with LLM judges and customer effort scores.
Takeaways
All Takeaways
Nondeterministic output needs its own evaluation layer, so ServiceNow built an LLM judge that scores against a golden data set before anything reaches a customer.
Users did not want the agentified version of the human process. They wanted the outcome and the next best action, not the steps.
The fix was a feedback loop that narrates what the AI is doing in the background, which buys the patience a long task needs.
