ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
3.2k
Citations
174
Influential Citations
Journal of the ACM
Venue
1987
Year
In this paper we develop a new data structure for implementing heaps (priority queues). Our structure, Fibonacci heaps (abbreviated F-heaps ), extends the binomial queues proposed by Vuillemin and studied further by Brown. F-heaps support arbitrary deletion from an n -item heap in O (log n ) amortized time and all other standard heap operations in O (1) amortized time. Using F-heaps we are able to obtain improved running times for several network optimization algorithms. In particular, we obtain the following worst-case bounds, where n is the number of vertices and m the number of edges in the problem graph: O ( n log n + m ) for the single-source shortest path problem with nonnegative edge lengths, improved from O ( m log ( m/n +2) n ); O ( n 2 log n + nm ) for the all-pairs shortest path problem, improved from O ( nm log ( m/n +2) n ); O ( n 2 log n + nm ) for the assignment problem (weighted bipartite matching), improved from O ( nm log ( m/n +2) n ); O ( mβ ( m, n )) for the minimum spanning tree problem, improved from O ( m log log ( m/n +2) n ); where β ( m, n ) = min { i | log ( i ) n ≤ m/n }. Note that β ( m, n ) ≤ log * n if m ≥ n . Of these results, the improved bound for minimum spanning trees is the most striking, although all the results give asymptotic improvements for graphs of appropriate densities.
This paper is a cornerstone in the field of data structures and graph algorithms. It introduces Fibonacci heaps, a priority queue that achieves optimal amortized time bounds for key operations, particularly the decrease-key operation, which is critical for many network optimization algorithms. The paper's significance lies not only in the new data structure but also in demonstrating its power by improving the running times of several classic problems, including single-source shortest paths, all-pairs shortest paths, the assignment problem, and minimum spanning trees.
The improvements are asymptotic and apply to graphs of appropriate densities, making the results theoretically important. The minimum spanning tree bound of O(m β(m,n)) is particularly striking, as it nearly matches the linear-time lower bound for many practical cases. This work has inspired a long line of research on priority queues and has been a standard reference in algorithm courses and textbooks.
The paper reports the following worst-case time bounds, where n is the number of vertices and m the number of edges:
These results are asymptotic and show improvements for graphs of appropriate densities, with the minimum spanning tree bound being the most dramatic.
The introduction of Fibonacci heaps has had a lasting impact on algorithm design. It provided a theoretical foundation for efficient priority queues and influenced the development of other data structures like pairing heaps and relaxed heaps. The improved bounds for network optimization problems have been incorporated into standard algorithm references and have guided research on faster graph algorithms. While the constant factors and practical performance of Fibonacci heaps are often not competitive with simpler heaps, the theoretical insights have been invaluable. The paper remains a classic example of how a data structure can drive algorithmic improvements across multiple domains.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba