AI Research

AI & ML Research Papers

A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.

All Papers

2 papers

PreprintarXiv.org2025

Rethinking Reflection in Pre-Training

Essential AI Darsh J Shah, Peter Rushton, Somanshu Singla, et al.

This paper shows that language models' self-reflection ability emerges during pre-training, not just reinforcement learning, by introducing deliberate errors into chains-of-thought.

45Apr 5, 2025Reinforcement LearningReasoning

arXiv

PreprintConference on Empirical Methods in Natural Language Processing2024

RAG vs. Long-Context LLMs

Zhuowan Li, Cheng Li, Mingyang Zhang, et al.

Compares RAG and long-context LLMs, finding long-context outperforms RAG but at higher cost, and proposes Self-Route to route queries based on model self-reflection.

163Jul 23, 2024Large Language ModelsRetrieval Augmented Generation

arXiv