Submit event
AI Research Night — Case Studies in Pretraining

AI Research Night — Case Studies in Pretraining

03 Aug 202618:30 - 21:00 Europe/LondonLondon, United Kingdom4 AttendeesOpen

Description

with ElevenLabs, Geodesic Research & PostHog · at the Shoreditch TreehouseIf you've pretrained a model before you know you need data worth learning from, compute, and a serious answer to "why not just call an API?" This is an evening with three teams who have answers — at different scales — followed by an open discussion and plenty of canapés to keep us going.Talks (15 min each + Q&A)Pretraining a GPT on a laptop — Angelos Perivolaropoulos, (Research Engineer at ElevenLabs) - What intuition from 10M parameters does (and doesn't) transfer upward.A from-scratch encoder for session replay data — Nico Waltz, (AI Research Engineer at PostHog) - A self-supervised encoder trained directly on DOM recordings, built to replace a video-rasterizer + VLM pipeline in production.Alignment pretraining — Cameron Tice (Co-Founder & Executive Director, Geodesic Research) - Lessons from training 6.9B-parameter LLMs on 500B tokens across four different data conditions to test how AI discourse in pretraining corpora affects alignment.Who this is for​Active PhD students and AI researchers with hands-on experience applying their work — people who have trained models. Registration is approved manually.Agenda

Event location

Let your network know you`re going

Share this event to start conversations, invite colleagues, and connect before it begins.

Related events

Artificial Intelligence Platform

Free