Journal Article
Large Language Models

How Can Recommender Systems Benefit from Large Language Models: A Survey

Jianghao Lin(Shanghai Jiao Tong University), Xinyi Dai(Huawei Technologies (China)), Yunjia Xi(Shanghai Jiao Tong University), Weiwen Liu(Huawei Technologies (China)), Bo Chen(Huawei Technologies (China)), Hao Zhang(Huawei Technologies (China)), Yong Liu(Huawei Technologies (China)), Chuhan Wu(Shanghai Jiao Tong University), Xiangyang Li(Huawei Technologies (China)), Chenxu Zhu(Huawei Technologies (China)), Huifeng Guo(Huawei Technologies (China)), Yong Hai Yu(Shanghai Jiao Tong University), Ruiming Tang(Huawei Technologies (China)), Weinan Zhang(Shanghai Jiao Tong University)
July 13, 2024ACM Transactions on Information Systems456 citations

456

Citations

10

Influential Citations

ACM Transactions on Information Systems

Venue

2024

Year

Abstract

With the rapid development of online services and web applications, recommender systems (RS) have become increasingly indispensable for mitigating information overload and matching users’ information needs by providing personalized suggestions over items. Although the RS research community has made remarkable progress over the past decades, conventional recommendation models (CRM) still have some limitations, e.g., lacking open-domain world knowledge, and difficulties in comprehending users’ underlying preferences and motivations. Meanwhile, large language models (LLM) have shown impressive general intelligence and human-like capabilities for various natural language processing (NLP) tasks, which mainly stem from their extensive open-world knowledge, logical and commonsense reasoning abilities, as well as their comprehension of human culture and society. Consequently, the emergence of LLM is inspiring the design of RS and pointing out a promising research direction, i.e., whether we can incorporate LLM and benefit from their common knowledge and capabilities to compensate for the limitations of CRM. In this article, we conduct a comprehensive survey on this research direction, and draw a bird’s-eye view from the perspective of the whole pipeline in real-world RS. Specifically, we summarize existing research works from two orthogonal aspects: where and how to adapt LLM to RS. For the “ WHERE ” question, we discuss the roles that LLM could play in different stages of the recommendation pipeline, i.e., feature engineering, feature encoder, scoring/ranking function, user interaction, and pipeline controller. For the “ HOW ” question, we investigate the training and inference strategies, resulting in two fine-grained taxonomy criteria, i.e., whether to tune LLM or not during training, and whether to involve CRM for inference. Detailed analysis and general development paths are provided for both “WHERE” and “HOW” questions, respectively. Then, we highlight the key challenges in adapting LLM to RS from three aspects, i.e., efficiency, effectiveness, and ethics. Finally, we summarize the survey and discuss the future prospects.

Analysis

Why This Paper Matters

Recommender systems are central to managing information overload in online services, yet conventional recommendation models (CRMs) often lack open-domain world knowledge and struggle to infer users' underlying preferences and motivations. Large language models (LLMs) have demonstrated impressive general intelligence, including extensive open-world knowledge, logical and commonsense reasoning, and comprehension of human culture and society. This survey is significant because it systematically explores how LLMs can compensate for the limitations of CRMs, providing a timely and comprehensive overview of a rapidly growing research direction.

The paper's bird's-eye view from the perspective of the whole recommendation pipeline makes it particularly valuable. By organizing existing research along two orthogonal aspects—where to adapt LLMs to recommender systems and how to adapt them—the survey offers a clear and actionable framework for researchers and practitioners. This structure helps clarify the roles LLMs can play at different stages, from feature engineering to pipeline control, and the training and inference strategies that determine their integration.

Moreover, the survey highlights critical challenges in efficiency, effectiveness, and ethics, which are essential considerations for deploying LLM-enhanced recommender systems in real-world applications. By discussing future prospects, it also sets a research agenda that can guide subsequent work.

Technical Contributions

  • Where to adapt LLMs: The survey identifies five roles for LLMs in the recommendation pipeline: feature engineering, feature encoder, scoring/ranking function, user interaction, and pipeline controller. This taxonomy provides a comprehensive map of integration points.
  • How to adapt LLMs: It introduces a fine-grained taxonomy based on two criteria: whether to tune the LLM during training and whether to involve CRM for inference. This yields four categories of training and inference strategies, enabling systematic comparison.
  • Detailed analysis and development paths: For each dimension, the paper provides detailed analysis and outlines general development paths, helping researchers understand the evolution and trade-offs of different approaches.
  • Challenge identification: The survey highlights key challenges from three aspects—efficiency, effectiveness, and ethics—offering a balanced view of the opportunities and risks of LLM-enhanced recommender systems.

Results

As a survey paper, it does not present new experimental results or quantitative comparisons. Instead, it synthesizes findings from existing literature, categorizes methods, and discusses their strengths and weaknesses qualitatively. The paper's contribution lies in its organizational framework and analysis rather than empirical metrics.

Significance

The survey's significance lies in providing a structured foundation for the emerging field of LLM-enhanced recommender systems. By mapping the landscape and identifying challenges, it helps researchers navigate the rapidly expanding literature and design more effective and ethical systems. It also underscores the potential of LLMs to transform recommendation by leveraging their common knowledge and reasoning capabilities, while cautioning about efficiency and ethical concerns. This work is likely to influence both academic research and industrial practice in personalized recommendation.