ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
456
Citations
10
Influential Citations
ACM Transactions on Information Systems
Venue
2024
Year
With the rapid development of online services and web applications, recommender systems (RS) have become increasingly indispensable for mitigating information overload and matching users’ information needs by providing personalized suggestions over items. Although the RS research community has made remarkable progress over the past decades, conventional recommendation models (CRM) still have some limitations, e.g., lacking open-domain world knowledge, and difficulties in comprehending users’ underlying preferences and motivations. Meanwhile, large language models (LLM) have shown impressive general intelligence and human-like capabilities for various natural language processing (NLP) tasks, which mainly stem from their extensive open-world knowledge, logical and commonsense reasoning abilities, as well as their comprehension of human culture and society. Consequently, the emergence of LLM is inspiring the design of RS and pointing out a promising research direction, i.e., whether we can incorporate LLM and benefit from their common knowledge and capabilities to compensate for the limitations of CRM. In this article, we conduct a comprehensive survey on this research direction, and draw a bird’s-eye view from the perspective of the whole pipeline in real-world RS. Specifically, we summarize existing research works from two orthogonal aspects: where and how to adapt LLM to RS. For the “ WHERE ” question, we discuss the roles that LLM could play in different stages of the recommendation pipeline, i.e., feature engineering, feature encoder, scoring/ranking function, user interaction, and pipeline controller. For the “ HOW ” question, we investigate the training and inference strategies, resulting in two fine-grained taxonomy criteria, i.e., whether to tune LLM or not during training, and whether to involve CRM for inference. Detailed analysis and general development paths are provided for both “WHERE” and “HOW” questions, respectively. Then, we highlight the key challenges in adapting LLM to RS from three aspects, i.e., efficiency, effectiveness, and ethics. Finally, we summarize the survey and discuss the future prospects.
Recommender systems are central to managing information overload in online services, yet conventional recommendation models (CRMs) often lack open-domain world knowledge and struggle to infer users' underlying preferences and motivations. Large language models (LLMs) have demonstrated impressive general intelligence, including extensive open-world knowledge, logical and commonsense reasoning, and comprehension of human culture and society. This survey is significant because it systematically explores how LLMs can compensate for the limitations of CRMs, providing a timely and comprehensive overview of a rapidly growing research direction.
The paper's bird's-eye view from the perspective of the whole recommendation pipeline makes it particularly valuable. By organizing existing research along two orthogonal aspects—where to adapt LLMs to recommender systems and how to adapt them—the survey offers a clear and actionable framework for researchers and practitioners. This structure helps clarify the roles LLMs can play at different stages, from feature engineering to pipeline control, and the training and inference strategies that determine their integration.
Moreover, the survey highlights critical challenges in efficiency, effectiveness, and ethics, which are essential considerations for deploying LLM-enhanced recommender systems in real-world applications. By discussing future prospects, it also sets a research agenda that can guide subsequent work.
As a survey paper, it does not present new experimental results or quantitative comparisons. Instead, it synthesizes findings from existing literature, categorizes methods, and discusses their strengths and weaknesses qualitatively. The paper's contribution lies in its organizational framework and analysis rather than empirical metrics.
The survey's significance lies in providing a structured foundation for the emerging field of LLM-enhanced recommender systems. By mapping the landscape and identifying challenges, it helps researchers navigate the rapidly expanding literature and design more effective and ethical systems. It also underscores the potential of LLMs to transform recommendation by leveraging their common knowledge and reasoning capabilities, while cautioning about efficiency and ethical concerns. This work is likely to influence both academic research and industrial practice in personalized recommendation.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba