ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
678
Citations
0
Influential Citations
IEEE Transactions on Neural Networks and Learning Systems
Venue
2022
Year
Backdoor attack intends to embed hidden backdoors into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by attacker-specified triggers. This threat could happen when the training process is not fully controlled, such as training on third-party datasets or adopting third-party models, which poses a new and realistic threat. Although backdoor learning is an emerging and rapidly growing research area, there is still no comprehensive and timely review of it. In this article, we present the first comprehensive survey of this realm. We summarize and categorize existing backdoor attacks and defenses based on their characteristics, and provide a unified framework for analyzing poisoning-based backdoor attacks. Besides, we also analyze the relation between backdoor attacks and relevant fields (i.e., adversarial attacks and data poisoning), and summarize widely adopted benchmark datasets. Finally, we briefly outline certain future research directions relying upon reviewed works. A curated list of backdoor-related resources is also available at https://github.com/THUYimingLi/backdoor-learning-resources.
Backdoor learning has emerged as a critical security concern in deep learning, where attackers can embed hidden triggers into models during training, causing malicious behavior only when the trigger is present. Despite its growing importance, the field lacked a comprehensive and timely review. This paper fills that gap by providing the first extensive survey of backdoor attacks and defenses, offering a structured overview that is essential for both researchers and practitioners. By consolidating scattered knowledge, it enables a deeper understanding of the threat landscape and facilitates the development of robust defenses.
The survey is particularly timely given the increasing reliance on third-party datasets and pre-trained models, which are common vectors for backdoor injection. As deep learning models are deployed in security-sensitive applications, understanding backdoor risks is paramount. This paper not only categorizes existing work but also establishes a unified framework for analyzing poisoning-based attacks, which helps in systematically comparing different methods and identifying gaps. Its comprehensive nature makes it a go-to resource for anyone entering the field or seeking to stay updated.
Moreover, the paper connects backdoor attacks to related areas such as adversarial attacks and data poisoning, highlighting both similarities and differences. This cross-domain perspective enriches the understanding of backdoor learning and encourages knowledge transfer. The inclusion of benchmark datasets and future directions further enhances its practical value, guiding empirical research and fostering reproducibility.
As a survey paper, it does not present new experimental results. Instead, it synthesizes findings from numerous studies, providing a meta-analysis of attack success rates, defense effectiveness, and evaluation practices across the literature. The paper reports that backdoor attacks can achieve high attack success rates (often above 90%) while maintaining benign accuracy, and that defenses vary in their robustness. It also highlights the lack of standardized evaluation metrics and the need for more rigorous benchmarks. The curated list of resources (GitHub repository) serves as a practical outcome, offering a continuously updated collection of backdoor-related papers and tools.
This survey has significant impact on the AI security community by establishing a common vocabulary and framework for backdoor learning. It raises awareness of backdoor threats among practitioners and provides a foundation for developing standardized defenses. By identifying open challenges and future directions, it steers research towards critical areas such as certified defenses, backdoor detection in federated learning, and robustness against adaptive attacks. The paper's comprehensive nature and practical resources make it an essential reference, likely accelerating progress in securing deep learning systems against backdoor manipulations.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba