Long Context vs. RAG for LLMs
Xinze Li, Yixin Cao, Yubo Ma, et al.
This paper compares Long Context and RAG for LLMs, finding LC generally outperforms RAG on QA benchmarks, with summarization-based retrieval matching LC, and highlights context relevance as an overlooked factor.