ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
1.3k
Citations
0
Influential Citations
IEEE Transactions on Knowledge and Data Engineering
Venue
2018
Year
Network embedding assigns nodes in a network to low-dimensional representations and effectively preserves the network structure. Recently, a significant amount of progresses have been made toward this emerging network analysis paradigm. In this survey, we focus on categorizing and then reviewing the current development on network embedding methods, and point out its future research directions. We first summarize the motivation of network embedding. We discuss the classical graph embedding algorithms and their relationship with network embedding. Afterwards and primarily, we provide a comprehensive overview of a large number of network embedding methods in a systematic manner, covering the structure- and property-preserving network embedding methods, the network embedding methods with side information, and the advanced information preserving network embedding methods. Moreover, several evaluation approaches for network embedding and some useful online resources, including the network data sets and softwares, are reviewed, too. Finally, we discuss the framework of exploiting these network embedding methods to build an effective system and point out some potential future directions.
Network embedding has become a cornerstone of modern network analysis, enabling the application of powerful machine learning techniques to graph-structured data. This survey, published in IEEE TKDE in 2018, arrives at a time when network embedding research was rapidly expanding, with numerous methods proposed but lacking a unified framework for understanding. By systematically categorizing and reviewing the landscape, the paper provides researchers and practitioners with a coherent map of the field, making it easier to navigate the diverse approaches and identify gaps.
The paper's significance is further amplified by its high citation count (over 1,200), indicating its widespread adoption as a reference in both academia and industry. It bridges classical graph embedding techniques with contemporary network embedding methods, clarifying their relationships and evolution. This historical perspective is valuable for understanding the foundations upon which newer methods, such as graph neural networks, are built.
Moreover, the survey goes beyond mere enumeration by discussing evaluation approaches and practical resources, including datasets and software. This practical guidance is essential for practitioners aiming to apply network embedding in real-world systems. The identification of future research directions also helps steer the community toward open problems, fostering continued innovation.
As a survey paper, it does not present new experimental results. Instead, it synthesizes findings from the literature, providing a qualitative comparison of methods based on their preservation properties and use of side information. The paper reports on evaluation metrics and datasets commonly used, but does not offer quantitative benchmarks. Its "results" are the organized knowledge and insights derived from reviewing numerous studies, which have been valuable to the community.
The survey's significance lies in its role as a foundational reference that has shaped the research agenda in network embedding. By providing a systematic taxonomy and highlighting future directions, it has guided both newcomers and experts. Its discussion of evaluation and resources has promoted standardized practices. The paper's influence is evident in its high citation count and its continued relevance as a starting point for research in graph representation learning, including the transition to graph neural networks. It has also facilitated cross-disciplinary adoption of network embedding techniques in fields such as social network analysis, bioinformatics, and recommender systems.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba