Forward Deployed: Evals - Beyond the Vibe Check

Most teams still evaluate their AI the same way: run a few prompts, eyeball the outputs, and ship if it feels right. That works until it doesn't — until the agent fails silently in production, the hallucination reaches a customer, or nobody can explain why last week's change made things worse. This fireside gets into what comes after the vibe check: what a production eval actually is and how to build one, where eval datasets come from, using online evals as live guardrails, the LLM-as-judge vs. purpose-built eval models debate, and whether you can grade a multi-step agent's whole trajectory or just its final answer. Plus the practical calls every team faces — build vs. buy, and who owns evals inside a company. 🎤 🎤 🎤 SPEAKERS 🎤 🎤 🎤 🏠 HOSTED BY FORWARD DEPLOYED Forward Deployed is an AI-Native startup building agentic products for PE portfolio companies, Insurers, and other Enterprise teams. We also host fireside chats and podcasts with operators at the forefront of forward deployed engineering. 📅 Tue, Sep 1st, 6-8:30pm PT📍 Super secret, San Francisco 🎟 Seats are limited ✌️ Hosted at the Founders Cafe, AngelList's founder community and co-working space on the first floor of AngelList HQ. Apply here.