ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
2.3k
Citations
0
Influential Citations
Journal of The Royal Society Interface
Venue
2018
Year
Deep learning describes a class of machine learning algorithms that are capable of combining raw inputs into layers of intermediate features. These algorithms have recently shown impressive results across a variety of domains. Biology and medicine are data-rich disciplines, but the data are complex and often ill-understood. Hence, deep learning techniques may be particularly well suited to solve problems of these fields. We examine applications of deep learning to a variety of biomedical problems-patient classification, fundamental biological processes and treatment of patients-and discuss whether deep learning will be able to transform these tasks or if the biomedical sphere poses unique challenges. Following from an extensive literature review, we find that deep learning has yet to revolutionize biomedicine or definitively resolve any of the most pressing challenges in the field, but promising advances have been made on the prior state of the art. Even though improvements over previous baselines have been modest in general, the recent progress indicates that deep learning methods will provide valuable means for speeding up or aiding human investigation. Though progress has been made linking a specific neural network's prediction to input features, understanding how users should interpret these models to make testable hypotheses about the system under study remains an open challenge. Furthermore, the limited amount of labelled data for training presents problems in some domains, as do legal and privacy constraints on work with sensitive health records. Nonetheless, we foresee deep learning enabling changes at both bench and bedside with the potential to transform several areas of biology and medicine.
Deep learning has transformed fields like computer vision and natural language processing, but its application to biology and medicine presents unique challenges. This paper, authored by a large consortium of researchers, provides a critical assessment of the state of deep learning in biomedicine as of 2018. With over 2,200 citations, it has become a landmark reference for practitioners seeking to understand both the promise and the pitfalls of applying deep learning to biomedical problems.
The paper matters because it tempers enthusiasm with evidence. While many have heralded deep learning as a revolutionary force in healthcare, Ching et al. find that progress has been more incremental. By systematically reviewing applications across patient classification, fundamental biological processes, and treatment, the authors identify where deep learning has made genuine advances and where obstacles remain. This balanced perspective is essential for guiding future research and investment.
Moreover, the paper highlights critical open challenges that are often overlooked in technical deep learning literature: the scarcity of labeled data in many biomedical domains, legal and privacy constraints on working with sensitive health records, and the difficulty of interpreting models to generate testable hypotheses. These insights are invaluable for AI practitioners transitioning into biomedicine.
The paper's main finding is that deep learning has yet to revolutionize biomedicine or definitively resolve any of the most pressing challenges. Improvements over previous baselines have been modest in general, though recent progress indicates that deep learning methods will provide valuable means for speeding up or aiding human investigation. The authors note that while some advances have been made on the prior state of the art, the field is still in its early stages. They also emphasize that linking a specific neural network's prediction to input features has seen progress, but understanding how users should interpret these models to make testable hypotheses about the system under study remains an open challenge. Additionally, the limited amount of labeled data for training presents problems in some domains, as do legal and privacy constraints on work with sensitive health records.
The paper's significance lies in its role as a sobering yet hopeful guide for the field. It cautions against overhyping deep learning in biomedicine while acknowledging its potential to enable changes at both bench and bedside. By clearly articulating the obstacles, it directs attention to areas needing methodological innovation, such as semi-supervised learning, interpretability, and privacy-preserving techniques. For AI practitioners, it underscores the importance of domain-specific considerations and the need for collaborative efforts between computer scientists and biomedical researchers. As a highly cited review, it has shaped the discourse around deep learning in healthcare, influencing both research directions and funding priorities. Its balanced assessment continues to be relevant as the field progresses toward more mature applications.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba