See all guests

Guest Spotlight: Michael Mathews

Michael Mathews, Director, Data & AI Product at FanDuel
Michael Mathews
FanDuel | Product

About Michael Mathews

Michael Mathews is Director of Data and AI Product at FanDuel, where he leads the data platform, machine learning platform, data science and AI Solutions teams behind FanDuel's experimentation program. His teams built the auto researcher, an agent that proposes, writes and scores hundreds of model strategies in a single run, and he champions earning experiment autonomy one evidence-backed level at a time.
No items found.

Subscribe to the podcast

Takeaways

All Takeaways

Autonomy is earned in shadow mode, where the machine's complete package is recorded against every human decision until six months of evidence settles the trust question.

Go to S | E

Losing tests become coded constraints: two losing popular parlays tests turned into a 2.5x penalty weight and a hard floor in the next experiment's envelope.

Go to S | E

One churn run cut 750 features to 20, lifted F1 by 6% and tested live across three arms of 47,000 users, worth roughly a million dollars over baseline.

Go to S | E

The agent builds its own features (756 candidates to 20), never sees the validation set, and will reframe a problem when the scoring rules make a wrong guess cost more than a right one earns.

Go to S | E

FanDuel's auto researcher reads an objective function, proposes a strategy, writes the model, scores it and repeats about 300 times in an hour for around $300, returning the winner as readable code.

Go to S | E
The experimentation edge podcast logo with a picture of host Ashley Stirrup