ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
3.2k
Citations
142
Influential Citations
ACM SIGACT News
Venue
1997
Year
Approximation algorithms have developed in response to the impossibility of solving a great variety of important optimization problems. Too frequently, when attempting to get a solution for a problem, one is confronted with the fact that the problem is NP-hard. This, in the words of Garey and Johnson, means "I can't find an efficient algorithm, but neither can all of these famous people." While this is a significant theoretical step, it hardly qualifies as a cheering piece of news.If the optimal solution is unattainable then it is reasonable to sacrifice optimality and settle for a "good" feasible solution that can be computed efficiently. Of course, we would like to sacrifice as little optimality as possible, while gaining as much as possible in efficiency. Trading-off optimality in favor of tractability is the paradigm of approximation algorithms.The main themes of this book revolve around the design of such algorithms and the "closeness" to optimum that is achievable in polynomial time. To evaluate the limits of approximability, it is important to derive lower bounds or inapproximability results. In some cases, approximation algorithms must satisfy additional structural requirements such as being on-line, or working within limited space. This book reviews the design techniques for such algorithms and the developments in this area since its inception about three decades ago.
This paper, published in 1997, provides a comprehensive survey of approximation algorithms for NP-hard problems, a topic of central importance in theoretical computer science and operations research. The impossibility of solving many optimization problems exactly in polynomial time has driven the development of approximation algorithms that trade optimality for efficiency. Hochba's survey systematically organizes the design techniques and inapproximability results that had emerged over the preceding three decades, making it an essential reference for both newcomers and experts.
The paper's significance is underscored by its 3217 citations, reflecting its role as a standard resource in the field. It addresses a fundamental question: how close can we get to the optimal solution in polynomial time? By covering both upper bounds (approximation algorithms) and lower bounds (inapproximability), the survey provides a balanced view of what is achievable and what is provably hard.
The survey's key contributions include:
As a survey, the paper does not present new experimental results. Instead, it summarizes known approximation guarantees for classic NP-hard problems such as the traveling salesman problem, set cover, vertex cover, and bin packing. For example, it notes that the greedy algorithm for set cover achieves an approximation ratio of O(log n), and that the vertex cover problem admits a 2-approximation via maximal matching. Inapproximability results are also cataloged, such as the fact that the traveling salesman problem cannot be approximated within any constant factor unless P = NP.
The broader impact of this survey lies in its role as a foundational text for researchers and practitioners. By organizing a vast body of knowledge, it has enabled subsequent advances in approximation algorithms and influenced the design of practical heuristics. The paper also highlights the interplay between algorithmic design and complexity theory, showing how lower bounds guide the search for better approximations. Even decades after publication, it remains a frequently cited reference, testament to its enduring value in the AI and optimization communities.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba