Journal Article
Machine Learning

Backdoor Learning: A Survey

Yiming Li(Tsinghua Shenzhen International Graduate School), Yong Jiang(Peng Cheng Laboratory), Zhifeng Li(Tencent (China)), Shu‐Tao Xia(Peng Cheng Laboratory)
June 22, 2022IEEE Transactions on Neural Networks and Learning Systems678 citations

678

Citations

0

Influential Citations

IEEE Transactions on Neural Networks and Learning Systems

Venue

2022

Year

Abstract

Backdoor attack intends to embed hidden backdoors into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by attacker-specified triggers. This threat could happen when the training process is not fully controlled, such as training on third-party datasets or adopting third-party models, which poses a new and realistic threat. Although backdoor learning is an emerging and rapidly growing research area, there is still no comprehensive and timely review of it. In this article, we present the first comprehensive survey of this realm. We summarize and categorize existing backdoor attacks and defenses based on their characteristics, and provide a unified framework for analyzing poisoning-based backdoor attacks. Besides, we also analyze the relation between backdoor attacks and relevant fields (i.e., adversarial attacks and data poisoning), and summarize widely adopted benchmark datasets. Finally, we briefly outline certain future research directions relying upon reviewed works. A curated list of backdoor-related resources is also available at https://github.com/THUYimingLi/backdoor-learning-resources.

Analysis

Why This Paper Matters

Backdoor learning has emerged as a critical security concern in deep learning, where attackers can embed hidden triggers into models during training, causing malicious behavior only when the trigger is present. Despite its growing importance, the field lacked a comprehensive and timely review. This paper fills that gap by providing the first extensive survey of backdoor attacks and defenses, offering a structured overview that is essential for both researchers and practitioners. By consolidating scattered knowledge, it enables a deeper understanding of the threat landscape and facilitates the development of robust defenses.

The survey is particularly timely given the increasing reliance on third-party datasets and pre-trained models, which are common vectors for backdoor injection. As deep learning models are deployed in security-sensitive applications, understanding backdoor risks is paramount. This paper not only categorizes existing work but also establishes a unified framework for analyzing poisoning-based attacks, which helps in systematically comparing different methods and identifying gaps. Its comprehensive nature makes it a go-to resource for anyone entering the field or seeking to stay updated.

Moreover, the paper connects backdoor attacks to related areas such as adversarial attacks and data poisoning, highlighting both similarities and differences. This cross-domain perspective enriches the understanding of backdoor learning and encourages knowledge transfer. The inclusion of benchmark datasets and future directions further enhances its practical value, guiding empirical research and fostering reproducibility.

Technical Contributions

  • Comprehensive Taxonomy: The paper systematically categorizes backdoor attacks and defenses based on their characteristics, providing a clear organizational structure for the field.
  • Unified Framework: It introduces a unified framework for analyzing poisoning-based backdoor attacks, which decomposes the attack process into key components, enabling systematic comparison and evaluation.
  • Relation Analysis: It analyzes the connections between backdoor attacks and adversarial attacks and data poisoning, clarifying distinctions and overlaps.
  • Benchmark Datasets: The survey summarizes widely adopted benchmark datasets, facilitating standardized evaluation of future methods.
  • Future Directions: It outlines promising research directions based on the reviewed literature, guiding upcoming work.

Results

As a survey paper, it does not present new experimental results. Instead, it synthesizes findings from numerous studies, providing a meta-analysis of attack success rates, defense effectiveness, and evaluation practices across the literature. The paper reports that backdoor attacks can achieve high attack success rates (often above 90%) while maintaining benign accuracy, and that defenses vary in their robustness. It also highlights the lack of standardized evaluation metrics and the need for more rigorous benchmarks. The curated list of resources (GitHub repository) serves as a practical outcome, offering a continuously updated collection of backdoor-related papers and tools.

Significance

This survey has significant impact on the AI security community by establishing a common vocabulary and framework for backdoor learning. It raises awareness of backdoor threats among practitioners and provides a foundation for developing standardized defenses. By identifying open challenges and future directions, it steers research towards critical areas such as certified defenses, backdoor detection in federated learning, and robustness against adaptive attacks. The paper's comprehensive nature and practical resources make it an essential reference, likely accelerating progress in securing deep learning systems against backdoor manipulations.