Preprint
Knowledge Graphs

Graph neural networks: Taxonomy, advances, and trends

January 1, 2022

0

Citations

0

Influential Citations

Venue

2022

Year

Abstract

… graph neural networks, and then refer to up to 327 relevant literatures to show the panorama of the graph neural networks. … In order to drive the graph neural networks into a new stage, …

Analysis

Why This Paper Matters

Graph neural networks (GNNs) have become a cornerstone of deep learning on relational data, powering advances in knowledge graphs, social network analysis, and drug discovery. However, the field has grown so rapidly that navigating the literature is daunting. This paper addresses that challenge by offering a structured taxonomy that organizes GNN methods into coherent categories, making it easier for researchers to understand the landscape and identify gaps. By synthesizing 327 references, it provides a comprehensive snapshot of the state of the art as of 2022, which is invaluable for both newcomers and seasoned practitioners.

The paper's timing is significant: it captures a period of intense innovation, from early spectral methods to the rise of attention-based and scalable models. Its taxonomy not only categorizes existing work but also highlights trends, such as the shift toward more expressive architectures and the integration of GNNs with other learning paradigms. This makes the paper a useful roadmap for deciding which directions to pursue.

Technical Contributions

The paper's primary contribution is its taxonomy, which classifies GNNs along multiple dimensions:

  • Architecture types: It distinguishes between convolutional, attention-based, autoencoder, and generative GNNs, among others.
  • Learning paradigms: It covers supervised, unsupervised, and self-supervised learning approaches, as well as hybrid methods.
  • Structural variations: It addresses models for different graph types, including static, dynamic, heterogeneous, and temporal graphs.
  • Scalability and expressiveness: It discusses techniques for scaling GNNs to large graphs and improving their representational power.

Additionally, the paper reviews key applications and benchmarks, providing a practical guide to where GNNs have been successfully applied. It also identifies open challenges, such as oversmoothing, over-squashing, and interpretability, which are critical for future progress.

Results

As a survey, the paper does not present new experimental results. Instead, its 'results' are the synthesized insights from 327 papers. It highlights that GNNs have evolved from early spectral methods (e.g., ChebNet, GCN) to more flexible spatial and attention-based models (e.g., GAT, GraphSAGE), and more recently to powerful architectures like Graph Transformers. The taxonomy reveals a clear trend toward models that balance expressiveness with scalability, and an increasing focus on self-supervised and pre-training strategies. The paper also notes the growing adoption of GNNs in domains such as chemistry, biology, and recommendation systems.

Significance

The broader impact of this survey is substantial. By providing a clear taxonomy, it helps standardize terminology and concepts, facilitating communication among researchers. It also serves as a comprehensive entry point for practitioners looking to apply GNNs to new problems. The identified trends and challenges can guide funding and research priorities, potentially accelerating progress in areas like dynamic graph learning and explainability. As GNNs continue to integrate with large language models and other AI paradigms, this foundational review will remain a valuable reference for understanding the field's evolution.