Showing papers on "Particle swarm optimization published in 2021"

Archimedes optimization algorithm: a new metaheuristic algorithm for solving optimization problems

Abstract: The difficulty and complexity of the real-world numerical optimization problems has grown manifold, which demands efficient optimization methods. To date, various metaheuristic approaches have been introduced, but only a few have earned recognition in research community. In this paper, a new metaheuristic algorithm called Archimedes optimization algorithm (AOA) is introduced to solve the optimization problems. AOA is devised with inspirations from an interesting law of physics Archimedes’ Principle. It imitates the principle of buoyant force exerted upward on an object, partially or fully immersed in fluid, is proportional to weight of the displaced fluid. To evaluate performance, the proposed AOA algorithm is tested on CEC’17 test suite and four engineering design problems. The solutions obtained with AOA have outperformed well-known state-of-the-art and recently introduced metaheuristic algorithms such genetic algorithms (GA), particle swarm optimization (PSO), differential evolution variants L-SHADE and LSHADE-EpSin, whale optimization algorithm (WOA), sine-cosine algorithm (SCA), Harris’ hawk optimization (HHO), and equilibrium optimizer (EO). The experimental results suggest that AOA is a high-performance optimization tool with respect to convergence speed and exploration-exploitation balance, as it is effectively applicable for solving complex problems. The source code is currently available for public from: https://www.mathworks.com/matlabcentral/fileexchange/79822-archimedes-optimization-algorithm

A Review on Representative Swarm Intelligence Algorithms for Solving Optimization Problems: Applications and Trends

Abstract: Swarm intelligence algorithms are a subset of the artificial intelligence (AI) field, which is increasing popularity in resolving different optimization problems and has been widely utilized in various applications. In the past decades, numerous swarm intelligence algorithms have been developed, including ant colony optimization (ACO), particle swarm optimization (PSO), artificial fish swarm (AFS), bacterial foraging optimization (BFO), and artificial bee colony (ABC). This review tries to review the most representative swarm intelligence algorithms in chronological order by highlighting the functions and strengths from 127 research literatures. It provides an overview of the various swarm intelligence algorithms and their advanced developments, and briefly provides the description of their successful applications in optimization problems of engineering fields. Finally, opinions and perspectives on the trends and prospects in this relatively new research domain are represented to support future developments.

Major Advances in Particle Swarm Optimization: Theory, Analysis, and Application

Abstract: Over the ages, nature has constantly been a rich source of inspiration for science, with much still to discover about and learn from. Swarm Intelligence (SI), a major branch of artificial intelligence, was rendered to model the collective behavior of social swarms in nature. Ultimately, Particle Swarm Optimization algorithm (PSO) is arguably one of the most popular SI paradigms. Over the past two decades, PSO has been applied successfully, with good return as well, in a wide variety of fields of science and technology with a wider range of complex optimization problems, thereby occupying a prominent position in the optimization field. However, through in-depth studies, a number of problems with the algorithm have been detected and identified; e.g., issues regarding convergence, diversity, and stability. Consequently, since its birth in the mid-1990s, PSO has witnessed a myriad of enhancements, extensions, and variants in various aspects of the algorithm, specifically after the twentieth century, and the related research has therefore now reached an impressive state. In this paper, a rigorous yet systematic review is presented to organize and summarize the information on the PSO algorithm and the developments and trends of its most basic as well as of some of the very notable implementations that have been introduced recently, bearing in mind the coverage of paradigm, theory, hybridization, parallelization, complex optimization, and the diverse applications of the algorithm, making it more accessible. Ease for researchers to determine which PSO variant is currently best suited or to be invented for a given optimization problem or application. This up-to-date review also highlights the current pressing issues and intriguing open challenges haunting PSO, prompting scholars and researchers to conduct further research both on the theory and application of the algorithm in the forthcoming years.

A Particle Swarm Optimization Algorithm for Mixed-Variable Optimization Problems

Abstract: Many optimization problems in reality involve both continuous and discrete decision variables, and these problems are called mixed-variable optimization problems (MVOPs). The mixed decision variables of MVOPs increase the complexity of search space and make them difficult to be solved. The Particle Swarm Optimization (PSO) algorithm is easy to implement due to its simple framework and high speed of convergence, and has been successfully applied to many difficult optimization problems. Many existing PSO variants have been proposed to solve continuous or discrete optimization problems, which make it feasible and promising for solving MVOPs. In this paper, a new PSO algorithm for solving MVOPs is proposed, namely P S O m v , which can deal with both continuous and discrete decision variables simultaneously. To efficiently handle mixed variables, the P S O m v employs a mixed-variable encoding scheme. Based on the mixed-variable encoding scheme, two reproduction methods respectively for continuous variables and discrete variables are proposed. Furthermore, an adaptive parameter tuning strategy is employed and a constraints handling method is utilized to improve the overall efficiency of the P S O m v .The experimental results on 28 artificial MVOPs and two practical MVOPs demonstrate that the proposed P S O m v is a competitive algorithm for MVOPs.

A Novel Sigmoid-Function-Based Adaptive Weighted Particle Swarm Optimizer

Abstract: In this paper, a novel particle swarm optimization (PSO) algorithm is put forward where a sigmoid-function-based weighting strategy is developed to adaptively adjust the acceleration coefficients. The newly proposed adaptive weighting strategy takes into account both the distances from the particle to the global best position and from the particle to its personal best position, thereby having the distinguishing feature of enhancing the convergence rate. Inspired by the activation function of neural networks, the new strategy is employed to update the acceleration coefficients by using the sigmoid function. The search capability of the developed adaptive weighting PSO (AWPSO) algorithm is comprehensively evaluated via eight well-known benchmark functions including both the unimodal and multimodal cases. The experimental results demonstrate that the designed AWPSO algorithm substantially improves the convergence rate of the particle swarm optimizer and also outperforms some currently popular PSO algorithms.

Multiobjective Particle Swarm Optimization for Feature Selection With Fuzzy Cost

Abstract: Feature selection (FS) is an important data processing technique in the field of machine learning. There have been various FS methods, but all assume that the cost associated with a feature is precise, which restricts their real applications. Focusing on the FS problem with fuzzy cost, a fuzzy multiobjective FS method with particle swarm optimization, called PSOMOFS, is studied in this article. The proposed method develops a fuzzy dominance relationship to compare the goodness of candidate particles and defines a fuzzy crowding distance measure to prune the elitist archive and determine the global leader of particles. Also, a tolerance coefficient is introduced into the proposed method to ensure that the Pareto-optimal solutions obtained satisfy decision makers’ preferences. The developed method is used to tackle a series of the UCI datasets and is compared with three fuzzy multiobjective evolutionary methods and three typical multiobjective FS methods. Experimental results show that the proposed method can achieve feature sets with superior performances in approximation, diversity, and feature cost.

A Dynamic Neighborhood-Based Switching Particle Swarm Optimization Algorithm.

Abstract: In this article, a dynamic-neighborhood-based switching PSO (DNSPSO) algorithm is proposed, where a new velocity updating mechanism is designed to adjust the personal best position and the global best position according to a distance-based dynamic neighborhood to make full use of the population evolution information among the entire swarm. In addition, a novel switching learning strategy is introduced to adaptively select the acceleration coefficients and update the velocity model according to the searching state at each iteration, thereby contributing to a thorough search of the problem space. Furthermore, the differential evolution algorithm is successfully hybridized with the particle swarm optimization (PSO) algorithm to alleviate premature convergence. A series of commonly used benchmark functions (including unimodal, multimodal, and rotated multimodal cases) is utilized to comprehensively evaluate the performance of the DNSPSO algorithm. The experimental results demonstrate that the developed DNSPSO algorithm outperforms a number of existing PSO algorithms in terms of the solution accuracy and convergence performance, especially for complicated multimodal optimization problems.

Dynamic Salp swarm algorithm for feature selection

Abstract: Recently, many optimization algorithms have been applied for Feature selection (FS) problems and show a clear outperformance in comparison with traditional FS methods. Therefore, this has motivated our study to apply the new Salp swarm algorithm (SSA) on the FS problem. However, SSA, like other optimizations algorithms, suffer from the problem of population diversity and fall into local optima. To solve these problems, this study presents an enhanced version of SSA which is known as the Dynamic Salp swarm algorithm (DSSA). Two main improvements were included in SSA to solve its problems. The first improvement includes the development of a new equation for salps’ position update. The use of this new equation is controlled by using Singer's chaotic map. The purpose of the first improvement is to enhance SSA solutions' diversity. The second improvement includes the development of a new local search algorithm (LSA) to improve SSA exploitation. The proposed DSSA was combined with the K-nearest neighbor (KNN) classifier in a wrapper mode. 20 benchmark datasets were selected from the UCI repository and 3 Hadith datasets to test and evaluate the effectiveness of the proposed DSSA algorithm. The DSSA results were compared with the original SSA and four well-known optimization algorithms including Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Ant Lion Optimizer (ALO), and Grasshopper Optimization Algorithm (GOA). From the obtained results, DSSA outperformed the original SSA and the other well-known optimization algorithms over the 23 datasets in terms of classification accuracy, fitness function values, the number of selected features, and convergence speed. Also, DSSA accuracy results were compared with the most recent variants of the SSA algorithm. DSSA showed a significant improvement over the competing algorithms in statistical analysis. These results confirm the capability of the proposed DSSA to simultaneously improve the classification accuracy while selecting the minimal number of the most informative features.

A multi-layered gravitational search algorithm for function optimization and real-world problems

Abstract: A gravitational search algorithm ( GSA ) uses gravitational force among individuals to evolve population. Though GSA is an effective population-based algorithm, it exhibits low search performance and premature convergence. To ameliorate these issues, this work proposes a multi-layered GSA called MLGSA. Inspired by the two-layered structure of GSA, four layers consisting of population, iteration-best, personal-best and global-best layers are constructed. Hierarchical interactions among four layers are dynamically implemented in different search stages to greatly improve both exploration and exploitation abilities of population. Performance comparison between MLGSA and nine existing GSA variants on twenty-nine CEC2017 test functions with low, medium and high dimensions demonstrates that MLGSA is the most competitive one. It is also compared with four particle swarm optimization variants to verify its excellent performance. Moreover, the analysis of hierarchical interactions is discussed to illustrate the influence of a complete hierarchy on its performance. The relationship between its population diversity and fitness diversity is analyzed to clarify its search performance. Its computational complexity is given to show its efficiency. Finally, it is applied to twenty-two CEC2011 real-world optimization problems to show its practicality.

Adaptive Granularity Learning Distributed Particle Swarm Optimization for Large-Scale Optimization

Abstract: Large-scale optimization has become a significant and challenging research topic in the evolutionary computation (EC) community. Although many improved EC algorithms have been proposed for large-scale optimization, the slow convergence in the huge search space and the trap into local optima among massive suboptima are still the challenges. Targeted to these two issues, this article proposes an adaptive granularity learning distributed particle swarm optimization (AGLDPSO) with the help of machine-learning techniques, including clustering analysis based on locality-sensitive hashing (LSH) and adaptive granularity control based on logistic regression (LR). In AGLDPSO, a master–slave multisubpopulation distributed model is adopted, where the entire population is divided into multiple subpopulations, and these subpopulations are co-evolved. Compared with other large-scale optimization algorithms with single population evolution or centralized mechanism, the multisubpopulation distributed co-evolution mechanism will fully exchange the evolutionary information among different subpopulations to further enhance the population diversity. Furthermore, we propose an adaptive granularity learning strategy (AGLS) based on LSH and LR. The AGLS is helpful to determine an appropriate subpopulation size to control the learning granularity of the distributed subpopulations in different evolutionary states to balance the exploration ability for escaping from massive suboptima and the exploitation ability for converging in the huge search space. The experimental results show that AGLDPSO performs better than or at least comparable with some other state-of-the-art large-scale optimization algorithms, even the winner of the competition on large-scale optimization, on all the 35 benchmark functions from both IEEE Congress on Evolutionary Computation (IEEE CEC2010) and IEEE CEC2013 large-scale optimization test suites.

A Fast Hybrid Feature Selection Based on Correlation-Guided Clustering and Particle Swarm Optimization for High-Dimensional Data

Abstract: The ``curse of dimensionality'' and the high computational cost have still limited the application of the evolutionary algorithm in high-dimensional feature selection (FS) problems. This article proposes a new three-phase hybrid FS algorithm based on correlation-guided clustering and particle swarm optimization (PSO) (HFS-C-P) to tackle the above two problems at the same time. To this end, three kinds of FS methods are effectively integrated into the proposed algorithm based on their respective advantages. In the first and second phases, a filter FS method and a feature clustering-based method with low computational cost are designed to reduce the search space used by the third phase. After that, the third phase applies oneself to finding an optimal feature subset by using an evolutionary algorithm with the global searchability. Moreover, a symmetric uncertainty-based feature deletion method, a fast correlation-guided feature clustering strategy, and an improved integer PSO are developed to improve the performance of the three phases, respectively. Finally, the proposed algorithm is validated on 18 publicly available real-world datasets in comparison with nine FS algorithms. Experimental results show that the proposed algorithm can obtain a good feature subset with the lowest computational cost.

CSCF: a chaotic sine cosine firefly algorithm for practical application problems

Abstract: Recently, numerous meta-heuristic-based approaches are deliberated to reduce the computational complexities of several existing approaches that include tricky derivations, very large memory space requirement, initial value sensitivity, etc. However, several optimization algorithms namely firefly algorithm, sine–cosine algorithm, and particle swarm optimization algorithm have few drawbacks such as computational complexity and convergence speed. So to overcome such shortcomings, this paper aims in developing a novel chaotic sine–cosine firefly (CSCF) algorithm with numerous variants to solve optimization problems. Here, the chaotic form of two algorithms namely the sine–cosine algorithm and the firefly algorithms is integrated to improve the convergence speed and efficiency thus minimizing several complexity issues. Moreover, the proposed CSCF approach is operated under various chaotic phases and the optimal chaotic variants containing the best chaotic mapping are selected. Then numerous chaotic benchmark functions are utilized to examine the system performance of the CSCF algorithm. Finally, the simulation results for the problems based on engineering design are demonstrated to prove the efficiency, robustness and effectiveness of the proposed algorithm.

A Modified Sparrow Search Algorithm with Application in 3d Route Planning for UAV.

Abstract: The unmanned aerial vehicle (UAV) route planning problem mainly centralizes on the process of calculating the best route between the departure point and target point as well as avoiding obstructions on route to avoid collisions within a given flight area A highly efficient route planning approach is required for this complex high dimensional optimization problem However, many algorithms are infeasible or have low efficiency, particularly in the complex three-dimensional (3d) flight environment In this paper, a modified sparrow search algorithm named CASSA has been presented to deal with this problem Firstly, the 3d task space model and the UAV route planning cost functions are established, and the problem of route planning is transformed into a multi-dimensional function optimization problem Secondly, the chaotic strategy is introduced to enhance the diversity of the population of the algorithm, and an adaptive inertia weight is used to balance the convergence rate and exploration capabilities of the algorithm Finally, the Cauchy-Gaussian mutation strategy is adopted to enhance the capability of the algorithm to get rid of stagnation The results of simulation demonstrate that the routes generated by CASSA are preferable to the sparrow search algorithm (SSA), particle swarm optimization (PSO), artificial bee colony (ABC), and whale optimization algorithm (WOA) under the identical environment, which means that CASSA is more efficient for solving UAV route planning problem when taking all kinds of constraints into consideration

Fuzzy integrated cell formation and production scheduling considering automated guided vehicles and human factors

Abstract: In today's competitive environment, it is essential to design a flexible-responsive manufacturing system with automatic material handling systems. In this study, a fuzzy Mixed Integer Linear Programming (MILP) model is designed for Cell Formation Problem (CFP) including the scheduling of parts within cells in a Cellular Manufacturing System (CMS) where several Automated Guided Vehicles (AGVs) are in charge of transferring the exceptional parts. Notably, using these AGVs in CMS can be challenging from the perspective of mathematical modeling due to consideration of AGVs’ collision as well as parts pickup/delivery. This paper tries to investigate the role of AGVs and human factors as indispensable components of automation systems in the cell formation and scheduling of parts under fuzzy processing time. The proposed objective function includes minimizing the makespan and inter-cellular movements of parts. Due to the NP-hardness of the problem, a hybrid Genetic Algorithm (GA/heuristic) and a Whale Optimization Algorithm (WOA) are developed. The experimental results reveal that our proposed algorithms have a high performance compared to CPLEX and other two well-known algorithms, i.e., Particle Swarm Optimization (PSO) and Ant Colony Optimization (ACO), in terms of computational efficiency and accuracy. Finally, WOA stands out as the best algorithm to solve the problem.

Rolling bearing fault diagnosis using optimal ensemble deep transfer network

Abstract: Rolling bearing fault diagnosis with unlabeled data is a meaningful yet challenging task. Recently, deep transfer learning methods with maximum mean discrepancy (MMD) have achieved great attention. To further enhance the performance of individual models, this paper proposes an optimal ensemble deep transfer network (OEDTN). The proposed method takes advantage of parameter transfer learning, domain adaptation and ensemble learning. Firstly, different kernel MMDs are used to construct multiple diverse deep transfer networks (DTNs) for feature adaptation. Secondly, parameter transfer learning is applied to initialize these DTNs with a good start point. Finally, ensemble learning is used to combine these DTNs to acquire the final results. Considering no labeled information available for ensemble, a novel comprehensive metric is designed to guide the particle swarm optimization to assign suitable voting weights for each DTN. By this way, the ensemble strategy of OEDTN can be adaptively constructed. Experiments on three bearing test rigs are carried out, and the results show that the proposed method is more effective than the existing methods.

Development and application of slime mould algorithm for optimal economic emission dispatch

Abstract: In this paper, an Improved version of the Slime Mould Algorithm (ISMA) is proposed and applied to efficiently solve the single-and bi-objective Economic and Emission Dispatch (EED) problems considering valve point effect. ISMA is developed to improve the performance of the conventional Slime Mould Algorithm (SMA). In ISMA, the solution positions are updated depending on two equations borrowed from the sine–cosine algorithm (SCA) to obtain the best solution. Multi-objective SMA (MOSMA) and Multi-objective ISMA (MOISMA) are developed based on the Pareto dominance concept and fuzzy decision-making. In the multi-objective EED problem, MOSMA and MOISMA are applied to minimize the total fuel costs and total emission with the valve point effect simultaneously. The proposed single-and bi-objective economic emission dispatch algorithms are validated using five test systems, 6-units, 10-units, 11-units, 40-units, and 110-units. The performance of the proposed algorithm is compared with Harris Hawk Optimizer (HHO), Jellyfish Search optimizer (JS), Tunicate Swarm Algorithm (TSA), Particle swarm optimization (PSO), and SMA algorithms. The results show that the proposed algorithms are more robust than other well-known algorithms. Feasible solutions using the proposed algorithms are also achieved, which adjust the schedule of generation without violation of the operating generation limits.

DMPPT Control of Photovoltaic Microgrid Based on Improved Sparrow Search Algorithm

Abstract: There are some problems in the photovoltaic microgrid system due to the solar irradiance-change environment, such as power fluctuation, which leads to larger power imbalance and affects the stable operation of the microgrid. Aiming at the problems of power mismatch loss under partial shading in photovoltaic microgrid systems, this paper proposed a distributed maximum power point tracking (DMPPT) approach based on an improved sparrow search algorithm (ISSA). First, used the center of gravity reverse learning mechanism to initialize the population, so that the population has a better spatial solution distribution; Secondly, the learning coefficient was introduced in the location update part of the discoverer to improve the global search ability of the algorithm; Simultaneously used the mutation operator to improve the position update of the joiner and avoid the algorithm falling into the local extreme value. The results of the model in Matlab showed that the ISSA can track the maximum power point(MPP) more accurately and quickly than the perturbation observation method (P&O) and the particle swarm optimization (PSO) algorithm, and had good steady-state performance.

A Surrogate-Assisted Multiswarm Optimization Algorithm for High-Dimensional Computationally Expensive Problems

Abstract: This article presents a surrogate-assisted multiswarm optimization (SAMSO) algorithm for high-dimensional computationally expensive problems. The proposed algorithm includes two swarms: the first one uses the learner phase of teaching-learning-based optimization (TLBO) to enhance exploration and the second one uses the particle swarm optimization (PSO) for faster convergence. These two swarms can learn from each other. A dynamic swarm size adjustment scheme is proposed to control the evolutionary progress. Two coordinate systems are used to generate promising positions for the PSO in order to further enhance its search efficiency on different function landscapes. Moreover, a novel prescreening criterion is proposed to select promising individuals for exact function evaluations. Several commonly used benchmark functions with their dimensions varying from 30 to 200 are adopted to evaluate the proposed algorithm. The experimental results demonstrate the superiority of the proposed algorithm over three state-of-the-art algorithms.

GAPSO-H: A hybrid approach towards optimizing the cluster based routing in wireless sensor network

Abstract: Wireless Sensor Networks (WSNs) have left an indelible mark on the lives of all by aiding in various sectors such as agriculture, education, manufacturing, monitoring of the environment, etc. Nevertheless, because of the wireless existence, the sensor node batteries cannot be replaced when deployed in a remote or unattended area. Several researches are therefore documented to extend the node's survival time. While cluster-based routing has contributed significantly to address this issue, there is still room for improvement in the choice of the cluster head (CH) by integrating critical parameters. Furthermore, primarily the focus had been on either the selection of CH or the data transmission among the nodes. The meta-heuristic methods are the promising approach to acquire the optimal network performance. In this paper, the ‘CH selection’ and ‘sink mobility-based data transmission’, both are optimized through a hybrid approach that consider the genetic algorithm (GA) and particle swarm optimization (PSO) algorithm respectively for each task. The robust behavior of GA helps in the optimized the CH selection, whereas, PSO helps in finding the optimized route for sink mobility. It is observed through the simulation analysis and results statistics that the proposed GAPSO-H (GA and PSO based hybrid) method outperform the state-of-art algorithms at various levels of performance metrics.

A Two-Timescale Duplex Neurodynamic Approach to Mixed-Integer Optimization

Abstract: This article presents a two-timescale duplex neurodynamic approach to mixed-integer optimization, based on a biconvex optimization problem reformulation with additional bilinear equality or inequality constraints. The proposed approach employs two recurrent neural networks operating concurrently at two timescales. In addition, particle swarm optimization is used to update the initial neuronal states iteratively to escape from local minima toward better initial states. In spite of its minimal system complexity, the approach is proven to be almost surely convergent to optimal solutions. Its superior performance is substantiated via solving five benchmark problems.

Ambulance routing in disaster response considering variable patient condition: NSGA-II and MOPSO algorithms

Abstract: The shortage of relief vehicles capacity is a common issue throughout disastrous situations due to the abundance of injured people who need urgent medical aid. Hence, ambulances fleet management is highly important to save as many injured individuals as possible. In this regard, the present paper defines different patient groups based on their needs and characteristics. In order to provide the affected people with proper and timely medical aid, changes in their health status are also considered. A Mixed-integer Linear Programming (MILP) model is proposed to find the best sequence of routes for each ambulance and minimize the latest service completion time (SCT) as well as the number of patients whose condition gets worse because of receiving untimely medical services. Non-dominated Sorting Genetic Algorithm II (NSGA-II) and Multi-Objective Particle Swarm Optimization (MOPSO) are used to find high-quality solutions over a short time. In the end, Lorestan province, Iran, is considered as a case study to assess the model's performance and analyze the sensitivity of solutions with respect to the major parameters, which results in insightful managerial suggestions.