ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
0
Citations
0
Influential Citations
—
Venue
2022
Year
… graph neural networks, and then refer to up to 327 relevant literatures to show the panorama of the graph neural networks. … In order to drive the graph neural networks into a new stage, …
Graph neural networks (GNNs) have become a cornerstone of deep learning on relational data, powering advances in knowledge graphs, social network analysis, and drug discovery. However, the field has grown so rapidly that navigating the literature is daunting. This paper addresses that challenge by offering a structured taxonomy that organizes GNN methods into coherent categories, making it easier for researchers to understand the landscape and identify gaps. By synthesizing 327 references, it provides a comprehensive snapshot of the state of the art as of 2022, which is invaluable for both newcomers and seasoned practitioners.
The paper's timing is significant: it captures a period of intense innovation, from early spectral methods to the rise of attention-based and scalable models. Its taxonomy not only categorizes existing work but also highlights trends, such as the shift toward more expressive architectures and the integration of GNNs with other learning paradigms. This makes the paper a useful roadmap for deciding which directions to pursue.
The paper's primary contribution is its taxonomy, which classifies GNNs along multiple dimensions:
Additionally, the paper reviews key applications and benchmarks, providing a practical guide to where GNNs have been successfully applied. It also identifies open challenges, such as oversmoothing, over-squashing, and interpretability, which are critical for future progress.
As a survey, the paper does not present new experimental results. Instead, its 'results' are the synthesized insights from 327 papers. It highlights that GNNs have evolved from early spectral methods (e.g., ChebNet, GCN) to more flexible spatial and attention-based models (e.g., GAT, GraphSAGE), and more recently to powerful architectures like Graph Transformers. The taxonomy reveals a clear trend toward models that balance expressiveness with scalability, and an increasing focus on self-supervised and pre-training strategies. The paper also notes the growing adoption of GNNs in domains such as chemistry, biology, and recommendation systems.
The broader impact of this survey is substantial. By providing a clear taxonomy, it helps standardize terminology and concepts, facilitating communication among researchers. It also serves as a comprehensive entry point for practitioners looking to apply GNNs to new problems. The identified trends and challenges can guide funding and research priorities, potentially accelerating progress in areas like dynamic graph learning and explainability. As GNNs continue to integrate with large language models and other AI paradigms, this foundational review will remain a valuable reference for understanding the field's evolution.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba