Journal Article
Machine Learning

An Overview of Variants and Advancements of PSO Algorithm

Meetu Jain(Punjabi University), Vibha Saihjpal, Narinder Singh(Punjabi University), Satya Bir Singh(Punjabi University)
August 23, 2022Applied Sciences686 citations

686

Citations

17

Influential Citations

Applied Sciences

Venue

2022

Year

Abstract

Particle swarm optimization (PSO) is one of the most famous swarm-based optimization techniques inspired by nature. Due to its properties of flexibility and easy implementation, there is an enormous increase in the popularity of this nature-inspired technique. Particle swarm optimization (PSO) has gained prompt attention from every field of researchers. Since its origin in 1995 till now, researchers have improved the original Particle swarm optimization (PSO) in varying ways. They have derived new versions of it, such as the published theoretical studies on various parameters of PSO, proposed many variants of the algorithm and numerous other advances. In the present paper, an overview of the PSO algorithm is presented. On the one hand, the basic concepts and parameters of PSO are explained, on the other hand, various advances in relation to PSO, including its modifications, extensions, hybridization, theoretical analysis, are included.

Analysis

Why This Paper Matters

Particle Swarm Optimization (PSO) is a cornerstone of swarm intelligence and nature-inspired optimization, widely used across engineering, machine learning, and operations research. Since its introduction in 1995, PSO has spawned hundreds of variants aimed at improving convergence speed, avoiding local optima, and adapting to specific problem domains. This survey, published in Applied Sciences and with 686 citations, provides a timely and comprehensive overview of these developments, making it a valuable resource for both newcomers and experienced researchers.

The paper's significance lies in its systematic categorization of PSO advances—modifications, extensions, hybridization, and theoretical analysis—offering a structured map of the field. By consolidating decades of research, it helps practitioners identify which variant might suit their problem and highlights underexplored areas for future work.

Technical Contributions

The paper's main technical contributions are its taxonomy and synthesis of PSO research:

  • Basic Concepts and Parameters: Clearly explains the standard PSO algorithm, including velocity and position update equations, inertia weight, cognitive and social coefficients, and constriction factors.
  • Modifications: Reviews changes to the core algorithm, such as adaptive parameter control, different neighborhood topologies (e.g., ring, star, von Neumann), and multi-swarm approaches.
  • Extensions: Covers adaptations for multi-objective optimization, constrained optimization, discrete and combinatorial problems, and dynamic environments.
  • Hybridization: Discusses combinations of PSO with other algorithms like genetic algorithms, differential evolution, simulated annealing, and local search methods.
  • Theoretical Analysis: Summarizes studies on convergence analysis, parameter sensitivity, and stability conditions, providing a foundation for understanding why certain variants work.

Results

As a survey, the paper does not present new experimental results. Instead, it aggregates findings from the literature, noting that hybrid PSO variants often outperform pure PSO on benchmark functions, and that adaptive parameter control can improve convergence speed and solution quality. The paper also highlights that theoretical analyses have established conditions for guaranteed convergence, though many practical improvements remain heuristic.

Significance

This survey has broad impact by serving as a one-stop reference for PSO research, potentially accelerating the adoption of advanced PSO variants in real-world applications such as neural network training, feature selection, and engineering design optimization. By identifying gaps—such as the need for more rigorous theoretical grounding of hybrid methods—it can guide future research directions. For AI practitioners, the paper offers a curated list of techniques to improve optimization performance, making it a practical tool for algorithm selection and design.