How to Argue With a Language Model (And Win)

You’ve built an AI agent, it mostly works, and now you’re stuck in a loop of tweaking prompts and hoping for the best. Sound familiar? In this talk we’ll move past vibes-based development and into structured experimentation. We’ll cover how to set up A/B tests for your agents, build and curate datasets from captured interactions or static data, and wire up evals that actually tell you whether your changes made things better or worse.