Is RAG dead now that models have long context?
In the old days of AI (not that long ago! 🤣), models had tiny 4K-token context windows. You couldn’t give an LLM your entire knowledge base, so Retrieval-Augmented Generation (RAG) was essential. It had one job, find the most relevant information and add it to the prompt. This gave the model access to private, recent, […]