Framework session: safe to infer?

Опис

Safe to infer: open, closed and what’s actually in productionA voice engineer worries about time-to-first-token. A content engineer worries about cost-per-output. Same word, inference, completely different math behind it.This is a small, technical afternoon for engineers and researchers actually running inference systems in production. Ten to twelve people, operators feeling the tradeoffs day to day, plus researchers working on scheduling and cost-latency problems who can connect what you're dealing with to what's actually being worked on right now.We start from different priority metrics, latency, cost, utilisation, compute, and build a shared framework live from wherever the insights lead.Saturday, August 29th, 2:30pm