Growing Pains in RAG (super-techie version)

Abstract

RAG sounds simple in the demo. In production it gets messy: chunking strategies, retrieval failures, hallucinations on your own data, latency, cost. This talk shares hard-won lessons building RAG systems that actually hold up - with Kyle Barker. Also presented at Data Science Festival (Oct 2024) and LondonR (Feb 2025).