ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
3.4k
Citations
36
Influential Citations
Computational Intelligence and Neuroscience
Venue
2018
Year
Over the last years deep learning methods have been shown to outperform previous state-of-the-art machine learning techniques in several fields, with computer vision being one of the most prominent cases. This review paper provides a brief overview of some of the most significant deep learning schemes used in computer vision problems, that is, Convolutional Neural Networks, Deep Boltzmann Machines and Deep Belief Networks, and Stacked Denoising Autoencoders. A brief account of their history, structure, advantages, and limitations is given, followed by a description of their applications in various computer vision tasks, such as object detection, face recognition, action and activity recognition, and human pose estimation. Finally, a brief overview is given of future directions in designing deep learning schemes for computer vision problems and the challenges involved therein.
This 2018 review paper by Voulodimos et al. arrives at a pivotal moment when deep learning is rapidly transforming computer vision. With over 3,300 citations, it has become a foundational reference for practitioners entering the field. The paper distills the core architectures—CNNs, Deep Boltzmann Machines, Deep Belief Networks, and Stacked Denoising Autoencoders—into a digestible format, making it accessible to a broad audience. Its significance lies in its timing and scope: it captures the state of the art just as deep learning solidifies its dominance in vision tasks, providing a roadmap for newcomers and a concise refresher for experienced researchers.
The paper's primary contribution is its structured taxonomy of deep learning methods for computer vision:
As a review, the paper does not present new experimental results. Instead, it synthesizes findings from prior works, noting that deep learning methods consistently outperform traditional machine learning on benchmarks like ImageNet (for object detection) and LFW (for face recognition). The paper emphasizes that CNNs achieve top-5 error rates below 5% on ImageNet by 2017, and that deep models for pose estimation reduce error by over 30% compared to classical approaches. These aggregated metrics underscore the transformative impact of deep learning.
This review has had a lasting impact on the AI community by democratizing knowledge of deep learning for computer vision. It serves as a starting point for countless research projects and industrial applications, helping practitioners quickly grasp the landscape. The paper's emphasis on both strengths and limitations encourages critical thinking about architecture selection. Its high citation count reflects its role as a trusted reference, and its forward-looking discussion of challenges—such as data efficiency and model interpretability—remains relevant today. For Neura Market's audience, this paper is a must-read for understanding the foundational technologies driving modern computer vision systems.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba