Attention Is All You Need
Ashish Vaswani, Noam Shazeer et al.
930
Citations
21
Influential Citations
IEEE Access
Venue
2021
Year
This paper provides an extensive review of the popular multi-objective optimization algorithm NSGA-II for selected combinatorial optimization problems viz. assignment problem, allocation problem, travelling salesman problem, vehicle routing problem, scheduling problem, and knapsack problem. It is identified that based on the manner in which NSGA-II has been implemented for solving the aforementioned group of problems, there can be three categories: Conventional NSGA-II, where the authors have implemented the basic version of NSGA-II, without making any changes in the operators; the second one is Modified NSGA-II, where the researchers have implemented NSGA-II after making some changes into it and finally, Hybrid NSGA-II variants, where the researchers have hybridized the conventional and modified NSGA-II with some other technique. The article analyses the modifications in NSGA-II and also discusses the various performance assessment techniques used by the researchers, i.e., test instances, performance metrics, statistical tests, case studies, benchmarking with other state-of-the-art algorithms. Additionally, the paper also provides a brief bibliometric analysis based on the work done in this study.
This review paper is significant because NSGA-II is one of the most widely used multi-objective evolutionary algorithms, yet its application to combinatorial optimization problems is often ad hoc. By systematically categorizing implementations into conventional, modified, and hybrid variants, the authors provide a clear framework for understanding how NSGA-II has been adapted for problems like scheduling, vehicle routing, and the knapsack problem. This taxonomy helps practitioners quickly identify which type of variant might be suitable for their specific problem and what modifications have been effective.
The inclusion of a bibliometric analysis adds a meta-perspective, revealing research trends, influential papers, and collaboration patterns. This is valuable for researchers looking to understand the evolution of the field and identify gaps or emerging directions. The paper also consolidates information on performance assessment techniques, which is often scattered across individual studies.
The paper does not present new experimental results but synthesizes findings from 930 cited works. Key observations include: (1) Hybrid NSGA-II variants are the most common, often combining NSGA-II with local search or other heuristics to improve convergence. (2) Modified NSGA-II frequently involves adaptive crossover/mutation rates or problem-specific encoding schemes. (3) Performance metrics like hypervolume and inverted generational distance are standard, but many studies lack statistical significance testing. The bibliometric analysis shows increasing publication volume and a shift toward hybrid approaches in recent years.
This review serves as a comprehensive reference for AI practitioners working on multi-objective combinatorial optimization. By clarifying the landscape of NSGA-II variants, it reduces the time needed to select an appropriate algorithm and highlights best practices for performance evaluation. The taxonomy also encourages more systematic comparisons and could inspire new hybrid or modified variants. For the broader AI field, the paper underscores the importance of adapting general-purpose algorithms to specific problem structures, a theme relevant beyond evolutionary computation.
Ashish Vaswani, Noam Shazeer et al.
Jakubův, Jan, Chvalovský, Karel et al.
Pauli Virtanen, Ralf Gommers et al.
Tom B. Brown, Benjamin Mann et al.