Journal Article
Machine Learning

A Survey on Network Embedding

Peng Cui(Tsinghua University), Xiao Wang(Tsinghua University), Jian Pei(Simon Fraser University), Wenwu Zhu(Tsinghua University)
June 22, 2018IEEE Transactions on Knowledge and Data Engineering1,273 citations

1.3k

Citations

0

Influential Citations

IEEE Transactions on Knowledge and Data Engineering

Venue

2018

Year

Abstract

Network embedding assigns nodes in a network to low-dimensional representations and effectively preserves the network structure. Recently, a significant amount of progresses have been made toward this emerging network analysis paradigm. In this survey, we focus on categorizing and then reviewing the current development on network embedding methods, and point out its future research directions. We first summarize the motivation of network embedding. We discuss the classical graph embedding algorithms and their relationship with network embedding. Afterwards and primarily, we provide a comprehensive overview of a large number of network embedding methods in a systematic manner, covering the structure- and property-preserving network embedding methods, the network embedding methods with side information, and the advanced information preserving network embedding methods. Moreover, several evaluation approaches for network embedding and some useful online resources, including the network data sets and softwares, are reviewed, too. Finally, we discuss the framework of exploiting these network embedding methods to build an effective system and point out some potential future directions.

Analysis

Why This Paper Matters

Network embedding has become a cornerstone of modern network analysis, enabling the application of powerful machine learning techniques to graph-structured data. This survey, published in IEEE TKDE in 2018, arrives at a time when network embedding research was rapidly expanding, with numerous methods proposed but lacking a unified framework for understanding. By systematically categorizing and reviewing the landscape, the paper provides researchers and practitioners with a coherent map of the field, making it easier to navigate the diverse approaches and identify gaps.

The paper's significance is further amplified by its high citation count (over 1,200), indicating its widespread adoption as a reference in both academia and industry. It bridges classical graph embedding techniques with contemporary network embedding methods, clarifying their relationships and evolution. This historical perspective is valuable for understanding the foundations upon which newer methods, such as graph neural networks, are built.

Moreover, the survey goes beyond mere enumeration by discussing evaluation approaches and practical resources, including datasets and software. This practical guidance is essential for practitioners aiming to apply network embedding in real-world systems. The identification of future research directions also helps steer the community toward open problems, fostering continued innovation.

Technical Contributions

  • Taxonomy of network embedding methods: The paper proposes a clear categorization into structure- and property-preserving methods, methods with side information, and advanced information-preserving methods. This taxonomy helps organize the vast literature and highlights the different objectives and assumptions of each category.
  • Integration of classical graph embedding: It reviews classical graph embedding algorithms (e.g., spectral clustering, multidimensional scaling) and discusses their connection to network embedding, providing a unified view.
  • Evaluation and resources: The survey compiles evaluation approaches, including reconstruction and downstream task performance, and lists useful online resources such as datasets and software tools, facilitating reproducibility and application.
  • System-building framework: It outlines a framework for exploiting network embedding methods to build effective systems, emphasizing the pipeline from embedding to application.
  • Future directions: The paper points out potential research directions, such as handling dynamic networks, incorporating heterogeneous information, and improving scalability.

Results

As a survey paper, it does not present new experimental results. Instead, it synthesizes findings from the literature, providing a qualitative comparison of methods based on their preservation properties and use of side information. The paper reports on evaluation metrics and datasets commonly used, but does not offer quantitative benchmarks. Its "results" are the organized knowledge and insights derived from reviewing numerous studies, which have been valuable to the community.

Significance

The survey's significance lies in its role as a foundational reference that has shaped the research agenda in network embedding. By providing a systematic taxonomy and highlighting future directions, it has guided both newcomers and experts. Its discussion of evaluation and resources has promoted standardized practices. The paper's influence is evident in its high citation count and its continued relevance as a starting point for research in graph representation learning, including the transition to graph neural networks. It has also facilitated cross-disciplinary adoption of network embedding techniques in fields such as social network analysis, bioinformatics, and recommender systems.