The state of harness engineering

Description

Models are getting better fast. But when an agent fails in production, the model often isn’t the problem these days. Instead, problems increasingly start and stop with the agent harness. The failure might be in the context it received, the tool it called, the path it took through a workflow, the state it carried forward, or the recovery logic that kicked in when something went wrong. Together, those systems make up the agent harness, and they increasingly determine whether an agent actually works. Join Arize and Google DeepMind in London for a practical evening on how to find and fix failures across the systems surrounding the model. We’ll look at where agent harnesses break in production, how teams use traces and evals to understand what went wrong, and the patterns developers are using to make agents more reliable as models become more capable. You’ll hear perspectives from Arize, Google DeepMind, and another team building agents in production, followed by drinks, food, and time to compare notes with fellow AI builders. Who this is forAI engineers, agent builders, technical leads, and PMs building LLM-based products, especially anyone working on tools, context, evals, tracing, orchestration, or agent reliability. What you'll leave with FormatThree talks plus networking, approximately 2.5 hours. LevelBeginner to advanced. No specific platform experience required.Agenda (TBC)