ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
2.9k
Citations
184
Influential Citations
Computer Methods in Applied Mechanics and Engineering
Venue
2021
Year
This work proposes a new meta-heuristic method called Arithmetic Optimization Algorithm (AOA) that utilizes the distribution behavior of the main arithmetic operators in mathematics including (Multiplication (M), Division (D), Subtraction (S), and Addition (A)). AOA is mathematically modeled and implemented to perform the optimization processes in a wide range of search spaces. The performance of AOA is checked on twenty-nine benchmark functions and several real-world engineering design problems to showcase its applicability. The analysis of performance, convergence behaviors, and the computational complexity of the proposed AOA have been evaluated by different scenarios. Experimental results show that the AOA provides very promising results in solving challenging optimization problems compared with eleven other well-known optimization algorithms. Source codes of AOA are publicly available at and .
This paper introduces a fresh perspective on meta-heuristic optimization by leveraging basic arithmetic operations—multiplication, division, subtraction, and addition—as the core search mechanisms. While many meta-heuristics draw inspiration from natural phenomena (e.g., genetic algorithms, particle swarm), AOA's foundation in mathematical operators offers a simple yet effective alternative. Its strong performance across diverse benchmarks and engineering problems suggests it could become a go-to optimizer for practitioners seeking a robust, easy-to-implement solution.
The significance is amplified by the paper's high citation count (2886), indicating rapid adoption and validation by the research community. For AI practitioners, optimization is a recurring challenge—from tuning hyperparameters to training models—and having a new, competitive algorithm expands the toolkit available. The public availability of source code further lowers the barrier to adoption, enabling immediate integration into existing workflows.
The key innovations of AOA include:
According to the abstract, AOA delivers "very promising results" on the benchmark functions and engineering problems. It outperforms 11 other well-known optimization algorithms in most test cases. The paper evaluates performance, convergence behavior, and computational complexity, though specific numerical metrics are not detailed in the abstract. The high citation count suggests that subsequent studies have validated and extended these findings, reinforcing the algorithm's effectiveness.
AOA's impact extends beyond just another optimizer; it demonstrates that simple mathematical concepts can be harnessed to solve complex optimization problems. This opens avenues for hybrid approaches and adaptations in various domains, including machine learning (e.g., feature selection, neural network training) and engineering design. For AI practitioners, AOA offers a reliable, easy-to-understand alternative to more complex meta-heuristics, potentially improving efficiency and solution quality in optimization tasks. Its open-source nature encourages community-driven improvements and integration into broader AI pipelines.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba