Preprint
Machine Learning
Featured

Combinatorial Optimization: Algorithms and Complexity.

David Johnson, Christos H. Papadimitriou(National Technical University of Athens), Kenneth Steiglitz(Princeton University)
March 1, 1984American Mathematical Monthly6,050 citations

6.0k

Citations

76

Influential Citations

American Mathematical Monthly

Venue

1984

Year

Abstract

This clearly written , mathematically rigorous text includes a novel algorithmic exposition of the simplex method and also discusses the Soviet ellipsoid algorithm for linear programming; efficient algorithms for network flow, matching, spanning trees, and matroids; the theory of NP-complete problems; approximation algorithms, local search heuristics for NPcomplete problems, more. All chapters are supplemented by thoughtprovoking problems. A useful work for graduate-level students with backgrounds in computer science, operations research, and electrical engineering. Mathematicians wishing a self-contained introduction need look no further.—American Mathematical Monthly. 1982 ed.

Analysis

Why This Paper Matters

This textbook, authored by David Johnson, Christos Papadimitriou, and Kenneth Steiglitz, is a cornerstone in the field of combinatorial optimization. Published in 1984, it synthesizes the core algorithmic and complexity results that underpin modern computer science and operations research. Its significance lies in its rigorous yet accessible presentation, making it a go-to resource for graduate students and researchers. The book's coverage of NP-completeness and approximation algorithms was particularly timely, as it helped codify the theory that now dominates algorithm design.

The book's impact is evidenced by its 6050 citations, indicating its enduring relevance. It bridges theory and practice, offering both the mathematical foundations and practical algorithmic techniques. For AI practitioners, understanding combinatorial optimization is crucial for solving problems like resource allocation, scheduling, and network design, which are common in machine learning pipelines and operations research.

Technical Contributions

The book makes several key technical contributions:

  • Simplex Method Exposition: It provides a novel algorithmic presentation of the simplex method, making it more intuitive and accessible.
  • Ellipsoid Algorithm: It discusses the Soviet ellipsoid algorithm, which was a breakthrough in linear programming, showing that LP can be solved in polynomial time.
  • Network Flow and Matching: It covers efficient algorithms for network flow, matching, and spanning trees, which are fundamental in many applications.
  • Matroid Theory: It introduces matroids, a unifying concept for optimization problems, and presents algorithms for matroid optimization.
  • NP-Completeness: It offers a comprehensive treatment of NP-complete problems, including reductions and classification.
  • Approximation and Heuristics: It discusses approximation algorithms and local search heuristics, which are essential for tackling NP-hard problems in practice.

Results

As a textbook, the 'results' are more about the synthesis and presentation of known results rather than new empirical findings. However, its impact is measurable: it has been cited over 6000 times, indicating its widespread adoption in academia. It has shaped the curriculum of graduate courses in algorithms and optimization. The book's problems are designed to provoke thought and deepen understanding, making it a valuable pedagogical tool.

Significance

The broader impact of this book on the AI field is profound. Combinatorial optimization is a core component of many AI systems, from planning and scheduling to resource allocation in machine learning. The book's rigorous treatment of NP-completeness helps AI practitioners understand the limits of tractability, guiding them toward approximation and heuristic methods when exact solutions are infeasible. Its influence extends to areas like constraint satisfaction, graph algorithms, and operations research, making it a timeless reference. For modern AI, where optimization is central, this book remains a foundational text that bridges theory and practice.