ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
686
Citations
17
Influential Citations
Applied Sciences
Venue
2022
Year
Particle swarm optimization (PSO) is one of the most famous swarm-based optimization techniques inspired by nature. Due to its properties of flexibility and easy implementation, there is an enormous increase in the popularity of this nature-inspired technique. Particle swarm optimization (PSO) has gained prompt attention from every field of researchers. Since its origin in 1995 till now, researchers have improved the original Particle swarm optimization (PSO) in varying ways. They have derived new versions of it, such as the published theoretical studies on various parameters of PSO, proposed many variants of the algorithm and numerous other advances. In the present paper, an overview of the PSO algorithm is presented. On the one hand, the basic concepts and parameters of PSO are explained, on the other hand, various advances in relation to PSO, including its modifications, extensions, hybridization, theoretical analysis, are included.
Particle Swarm Optimization (PSO) is a cornerstone of swarm intelligence and nature-inspired optimization, widely used across engineering, machine learning, and operations research. Since its introduction in 1995, PSO has spawned hundreds of variants aimed at improving convergence speed, avoiding local optima, and adapting to specific problem domains. This survey, published in Applied Sciences and with 686 citations, provides a timely and comprehensive overview of these developments, making it a valuable resource for both newcomers and experienced researchers.
The paper's significance lies in its systematic categorization of PSO advances—modifications, extensions, hybridization, and theoretical analysis—offering a structured map of the field. By consolidating decades of research, it helps practitioners identify which variant might suit their problem and highlights underexplored areas for future work.
The paper's main technical contributions are its taxonomy and synthesis of PSO research:
As a survey, the paper does not present new experimental results. Instead, it aggregates findings from the literature, noting that hybrid PSO variants often outperform pure PSO on benchmark functions, and that adaptive parameter control can improve convergence speed and solution quality. The paper also highlights that theoretical analyses have established conditions for guaranteed convergence, though many practical improvements remain heuristic.
This survey has broad impact by serving as a one-stop reference for PSO research, potentially accelerating the adoption of advanced PSO variants in real-world applications such as neural network training, feature selection, and engineering design optimization. By identifying gaps—such as the need for more rigorous theoretical grounding of hybrid methods—it can guide future research directions. For AI practitioners, the paper offers a curated list of techniques to improve optimization performance, making it a practical tool for algorithm selection and design.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba