ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
2.6k
Citations
0
Influential Citations
ACM SIGCOMM Computer Communication Review
Venue
1999
Year
Despite the apparent randomness of the Internet, we discover some surprisingly simple power-laws of the Internet topology. These power-laws hold for three snapshots of the Internet, between November 1997 and December 1998, despite a 45% growth of its size during that period. We show that our power-laws fit the real data very well resulting in correlation coefficients of 96% or higher.Our observations provide a novel perspective of the structure of the Internet. The power-laws describe concisely skewed distributions of graph properties such as the node outdegree. In addition, these power-laws can be used to estimate important parameters such as the average neighborhood size, and facilitate the design and the performance analysis of protocols. Furthermore, we can use them to generate and select realistic topologies for simulation purposes.
This paper is a landmark in network science and Internet topology analysis. Before its publication, the Internet was largely viewed as a random or ad-hoc structure, making it difficult to model, simulate, or design efficient protocols. By uncovering simple power-law relationships that hold across multiple snapshots and despite significant growth, the authors provided a concise mathematical description of the Internet's underlying order. This insight enabled researchers and practitioners to generate realistic synthetic topologies for simulation, which is critical for testing new protocols and algorithms in a controlled yet faithful environment.
The paper's impact extends beyond networking into AI and machine learning, where understanding graph structure is essential for tasks like node classification, link prediction, and graph generation. The power-law distributions observed here are now known to appear in many real-world graphs, including social networks, citation networks, and the web, making this work a precursor to modern graph representation learning and network embedding techniques.
The paper reports that the power-law relationships fit the real data with correlation coefficients of 96% or higher. For example, the outdegree distribution follows a power-law with exponent approximately -2.2, and the rank vs. outdegree plot shows a straight line on log-log axes. The eigenvalues of the adjacency matrix also follow a power-law. These results held across all three snapshots, even as the number of nodes grew from roughly 3,000 to 4,400 (a 45% increase). The authors also demonstrated that the power-laws can be used to accurately estimate the average number of neighbors within a given number of hops, which is a key parameter for network protocols.
The broader impact of this paper on AI and network science is substantial. It provided one of the first empirical demonstrations that complex, seemingly random networks can be described by simple mathematical laws. This inspired a wave of research into scale-free networks, preferential attachment models, and graph generative processes. In AI, these insights underpin modern graph neural networks, which often assume or exploit power-law degree distributions. The paper also influenced the design of distributed algorithms and protocols by providing a realistic model of network structure. Today, power-law thinking is embedded in many AI applications, from social network analysis to recommendation systems and anomaly detection.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba