Introduction to AI Evals | San Francisco

Join our interactive AI Evaluations Workshop to learn practical skills in evaluating large language models (LLMs) and AI agents!

We’ll cover key concepts including using LLM APIs, understanding jailbreaks, why evaluations (evals) are essential yet challenging, and insights from Anthropics “Alignment Faking Paper”. The session features live coding exercises based on the ARENA materials (section 3.1), using Python and Jupyter notebooks.

Prior Python experience is required. Ideal for AI practitioners, researchers, or enthusiasts looking to deepen their understanding of AI safety and evaluations.

Find us at the McLaren Conference center at 130 Fulton Street, McLaren 200, San Francisco CA 94117 in room MC 251.