Adventures in RAG: Are Chocolate Covered Pickles Delicious?

Abstract

RAG sounds simple in the demo. In production it gets messy: chunking strategies, retrieval failures, hallucinations on your own data, latency, cost. This talk shares hard-won lessons building RAG systems that actually hold up - with Kyle Barker. Also presented at AI Engineer London (Jan 2025) and LondonR (Jan 2025).