Showing papers on "Genetic algorithm published in 2019"

Dendritic Neuron Model With Effective Learning Algorithms for Classification, Approximation, and Prediction

Abstract: An artificial neural network (ANN) that mimics the information processing mechanisms and procedures of neurons in human brains has achieved a great success in many fields, e.g., classification, prediction, and control. However, traditional ANNs suffer from many problems, such as the hard understanding problem, the slow and difficult training problems, and the difficulty to scale them up. These problems motivate us to develop a new dendritic neuron model (DNM) by considering the nonlinearity of synapses, not only for a better understanding of a biological neuronal system, but also for providing a more useful method for solving practical problems. To achieve its better performance for solving problems, six learning algorithms including biogeography-based optimization, particle swarm optimization, genetic algorithm, ant colony optimization, evolutionary strategy, and population-based incremental learning are for the first time used to train it. The best combination of its user-defined parameters has been systemically investigated by using the Taguchi’s experimental design method. The experiments on 14 different problems involving classification, approximation, and prediction are conducted by using a multilayer perceptron and the proposed DNM. The results suggest that the proposed learning algorithms are effective and promising for training DNM and thus make DNM more powerful in solving classification, approximation, and prediction problems.

NSGA-Net: neural architecture search using multi-objective genetic algorithm

Abstract: This paper introduces NSGA-Net --- an evolutionary approach for neural architecture search (NAS). NSGA-Net is designed with three goals in mind: (1) a procedure considering multiple and conflicting objectives, (2) an efficient procedure balancing exploration and exploitation of the space of potential neural network architectures, and (3) a procedure finding a diverse set of trade-off network architectures achieved in a single run. NSGA-Net is a population-based search algorithm that explores a space of potential neural network architectures in three steps, namely, a population initialization step that is based on prior-knowledge from hand-crafted architectures, an exploration step comprising crossover and mutation of architectures, and finally an exploitation step that utilizes the hidden useful knowledge stored in the entire history of evaluated neural architectures in the form of a Bayesian Network. Experimental results suggest that combining the dual objectives of minimizing an error metric and computational complexity, as measured by FLOPs, allows NSGA-Net to find competitive neural architectures. Moreover, NSGA-Net achieves error rate on the CIFAR-10 dataset on par with other state-of-the-art NAS methods while using orders of magnitude less computational resources. These results are encouraging and shows the promise to further use of EC methods in various deep-learning paradigms.

Mobile robot path planning using membrane evolutionary artificial potential field

Abstract: In this paper, a membrane evolutionary artificial potential field (memEAPF) approach for solving the mobile robot path planning problem is proposed, which combines membrane computing with a genetic algorithm (membrane-inspired evolutionary algorithm with one-level membrane structure) and the artificial potential field method to find the parameters to generate a feasible and safe path. The memEAPF proposal consists of delimited compartments where multisets of parameters evolve according to rules of biochemical inspiration to minimize the path length. The proposed approach is compared with artificial potential field based path planning methods concerning to their planning performance on a set of twelve benchmark test environments, and it exhibits a better performance regarding path length. Experiments to demonstrate the statistical significance of the improvements achieved by the proposed approach in static and dynamic environments are shown. Moreover, the implementation results using parallel architectures proved the effectiveness and practicality of the proposal to obtain solutions in considerably less time.

Choosing Mutation and Crossover Ratios for Genetic Algorithms—A Review with a New Dynamic Approach

Abstract: Genetic algorithm (GA) is an artificial intelligence search method that uses the process of evolution and natural selection theory and is under the umbrella of evolutionary computing algorithm. It is an efficient tool for solving optimization problems. Integration among (GA) parameters is vital for successful (GA) search. Such parameters include mutation and crossover rates in addition to population that are important issues in (GA). However, each operator of GA has a special and different influence. The impact of these factors is influenced by their probabilities; it is difficult to predefine specific ratios for each parameter, particularly, mutation and crossover operators. This paper reviews various methods for choosing mutation and crossover ratios in GAs. Next, we define new deterministic control approaches for crossover and mutation rates, namely Dynamic Decreasing of high mutation ratio/dynamic increasing of low crossover ratio (DHM/ILC), and Dynamic Increasing of Low Mutation/Dynamic Decreasing of High Crossover (ILM/DHC). The dynamic nature of the proposed methods allows the ratios of both crossover and mutation operators to be changed linearly during the search progress, where (DHM/ILC) starts with 100% ratio for mutations, and 0% for crossovers. Both mutation and crossover ratios start to decrease and increase, respectively. By the end of the search process, the ratios will be 0% for mutations and 100% for crossovers. (ILM/DHC) worked the same but the other way around. The proposed approach was compared with two parameters tuning methods (predefined), namely fifty-fifty crossover/mutation ratios, and the most common approach that uses static ratios such as (0.03) mutation rates and (0.9) crossover rates. The experiments were conducted on ten Traveling Salesman Problems (TSP). The experiments showed the effectiveness of the proposed (DHM/ILC) when dealing with small population size, while the proposed (ILM/DHC) was found to be more effective when using large population size. In fact, both proposed dynamic methods outperformed the predefined methods compared in most cases tested.

Improving Metaheuristic Algorithms With Information Feedback Models

Abstract: In most metaheuristic algorithms, the updating process fails to make use of information available from individuals in previous iterations. If this useful information could be exploited fully and used in the later optimization process, the quality of the succeeding solutions would be improved significantly. This paper presents our method for reusing the valuable information available from previous individuals to guide later search. In our approach, previous useful information was fed back to the updating process. We proposed six information feedback models. In these models, individuals from previous iterations were selected in either a fixed or random manner. Their useful information was incorporated into the updating process. Accordingly, an individual at the current iteration was updated based on the basic algorithm plus some selected previous individuals by using a simple fitness weighting method. By incorporating six different information feedback models into ten metaheuristic algorithms, this approach provided a number of variants of the basic algorithms. We demonstrated experimentally that the variants outperformed the basic algorithms significantly on 14 standard test functions and 10 CEC 2011 real world problems, thereby, establishing the value of the information feedback models.

Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAS

Abstract: In this paper, we compare the three most popular algorithms for hyperparameter optimization (Grid Search, Random Search, and Genetic Algorithm) and attempt to use them for neural architecture search (NAS). We use these algorithms for building a convolutional neural network (search architecture). Experimental results on CIFAR-10 dataset further demonstrate the performance difference between compared algorithms. The comparison results are based on the execution time of the above algorithms and accuracy of the proposed models.

Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design

Abstract: A novel framework is proposed for quality of experience driven deployment and dynamic movement of multiple unmanned aerial vehicles (UAVs). The problem of joint non-convex three-dimensional (3-D) deployment and dynamic movement of the UAVs is formulated for maximizing the sum mean opinion score of ground users, which is proved to be NP-hard. In the aim of solving this pertinent problem, a three-step approach is proposed for attaining 3-D deployment and dynamic movement of multiple UAVs. First, a genetic algorithm based K-means (GAK-means) algorithm is utilized for obtaining the cell partition of the users. Second, Q-learning based deployment algorithm is proposed, in which each UAV acts as an agent, making their own decision for attaining 3-D position by learning from trial and mistake. In contrast to the conventional genetic algorithm based learning algorithms, the proposed algorithm is capable of training the direction selection strategy offline. Third, Q-learning based movement algorithm is proposed in the scenario that the users are roaming. The proposed algorithm is capable of converging to an optimal state. Numerical results reveal that the proposed algorithms show a fast convergence rate after a small number of iterations. Additionally, the proposed Q-learning based deployment algorithm outperforms K-means algorithms and Iterative-GAKmean algorithms with low complexity.

Multi-objective multi-robot path planning in continuous environment using an enhanced genetic algorithm

Abstract: This paper presents a hybrid approach for path planning of multiple mobile robots in continuous environments. For this purpose, first, an innovative Artificial Potential Field (APF) algorithm is presented to find all feasible paths between the start and destination locations in a discrete gridded environment. Next, an enhanced Genetic Algorithm (EGA) is developed to improve the initial paths in continuous space and find the optimal path between start and destination locations. The proposed APF works based on a time-efficient deterministic scheme to find a set of feasible initial paths and is guaranteed to find a feasible path if one exists. The EGA utilizes five customized crossover and mutation operators to improve the initial paths. In this paper, path length, smoothness, and safety are combined to form a multi-objective path planning problem. In addition, the proposed method is extended to deal with multiple mobile robot path planning problem. For this purpose, a new term is added to the objective function which measures the distance between robots and a collision removal operator is added to the EGA to remove possible collision between paths. To assess the efficiency of the proposed algorithm, 12 planar environments with different sizes and complexities were examined. Evaluations showed that the control parameters of the proposed algorithm do not affect the performance of the EGA considerably. Moreover, a comparative study has been made between the proposed algorithm, A*, PRM, B-RRT and Particle Swarm Optimization (PSO). The comparative study showed that the proposed algorithm outperforms PSO as well as well-recognized deterministic (A*) and probabilistic (PRM and B-RRT) path planning algorithms in terms of path length, run time, and success rate. Finally, simulations proved the efficiency of the proposed algorithm for a four-robot path planning problem. In this case, not only the proposed algorithm determined collision-free paths, but also it found near optimal solution for all robots.

Fitness Dependent Optimizer: Inspired by the Bee Swarming Reproductive Process

Abstract: In this paper, a novel swarm intelligent algorithm is proposed, known as the fitness dependent optimizer (FDO). The bee swarming the reproductive process and their collective decision-making have inspired this algorithm; it has no algorithmic connection with the honey bee algorithm or the artificial bee colony algorithm. It is worth mentioning that the FDO is considered a particle swarm optimization (PSO)-based algorithm that updates the search agent position by adding velocity (pace). However, the FDO calculates velocity differently; it uses the problem fitness function value to produce weights, and these weights guide the search agents during both the exploration and exploitation phases. Throughout this paper, the FDO algorithm is presented, and the motivation behind the idea is explained. Moreover, the FDO is tested on a group of 19 classical benchmark test functions, and the results are compared with three well-known algorithms: PSO, the genetic algorithm (GA), and the dragonfly algorithm (DA); in addition, the FDO is tested on the IEEE Congress of Evolutionary Computation Benchmark Test Functions (CEC-C06, 2019 Competition) [1]. The results are compared with three modern algorithms: (DA), the whale optimization algorithm (WOA), and the salp swarm algorithm (SSA). The FDO results show better performance in most cases and comparative results in other cases. Furthermore, the results are statistically tested with the Wilcoxon rank-sum test to show the significance of the results. Likewise, the FDO stability in both the exploration and exploitation phases is verified and performance-proofed using different standard measurements. Finally, the FDO is applied to real-world applications as evidence of its feasibility.

A Survey on Cooperative Co-Evolutionary Algorithms

Abstract: The first cooperative co-evolutionary algorithm (CCEA) was proposed by Potter and De Jong in 1994 and since then many CCEAs have been proposed and successfully applied to solving various complex optimization problems. In applying CCEAs, the complex optimization problem is decomposed into multiple subproblems, and each subproblem is solved with a separate subpopulation, evolved by an individual evolutionary algorithm (EA). Through cooperative co-evolution of multiple EA subpopulations, a complete problem solution is acquired by assembling the representative members from each subpopulation. The underlying divide-and-conquer and collaboration mechanisms enable CCEAs to tackle complex optimization problems efficiently, and hence CCEAs have been attracting wide attention in the EA community. This paper presents a comprehensive survey of these CCEAs, covering problem decomposition, collaborator selection, individual fitness evaluation, subproblem resource allocation, implementations, benchmark test problems, control parameters, theoretical analyses, and applications. The unsolved challenges and potential directions for their solutions are discussed.

Modeling and Planning for Dual-Objective Selective Disassembly Using and / or Graph and Discrete Artificial Bee Colony

Abstract: Disassembly sequencing is important for remanufacturing and recycling used or discarded products. AND / OR graphs (AOGs) have been applied to describe practical disassembly problems by using “ AND ” and “ OR ” nodes. An AOG-based disassembly sequence planning problem is an NP-hard combinatorial optimization problem. Heuristic evolution methods can be adopted to handle it. While precedence and “ AND ” relationship issues can be addressed, OR (exclusive OR ) relations are not well addressed by the existing heuristic methods. Thus, an ineffective result may be obtained in practice. A conflict matrix is introduced to cope with the exclusive OR relation in an AOG graph. By using it together with precedence and succession matrices in the existing work, this work proposes an effective triple-phase adjustment method to produce feasible disassembly sequences based on an AOG graph. Energy consumption is adopted to evaluate the disassembly efficiency. Its use with the traditional economical criterion leads to a novel dual-objective optimization model such that disassembly profit is maximized and disassembly energy consumption is minimized. An improved artificial bee colony algorithm is developed to effectively generate a set of Pareto solutions for this dual-objective disassembly optimization problem. This methodology is employed to practical disassembly processes of two products to verify its feasibility and effectiveness. The results show that it is capable of rapidly generating satisfactory Pareto results and outperforms a well-known genetic algorithm.

Bio-Inspired Speed Curve Optimization and Sliding Mode Tracking Control for Subway Trains

Abstract: Operation optimization for modern subway trains usually requires the speed curve optimization and speed curve tracking simultaneously. For the speed curve optimization, a multi-objective seeking issue should be addressed by considering the requirements of energy saving, punctuality, accurate parking, and comfortableness at the same time. But most traditional searching methods lack in efficiency or tend to fall into the local optimum. For the speed curve tracking, the widely applied proportional integral differential (PID) and fuzzy controllers rely on complicated parameter tuning, whereas robust adaptive methods can hardly ensure the finite-time convergence strictly, and thus are not suitable for applications in fixed time intervals of trains. To address the above-mentioned two problems, this paper presents a novel approach for speed curve seeking and tracking control. First, we present the random reinforcement genetic algorithm (GA) algorithm to avoid the local optimum efficiently. Then, a sliding mode controller is developed for speed curve tracking with bounded disturbance. The Lyapunov theory is adopted to prove that the system can be stabilized in the finite time. Finally, using the real datasets of Yizhuang Line in Beijing Subway, the proposed approach is validated, demonstrating its effectiveness and superiorities for the operation optimization.

Extended Genetic Algorithm for solving open-shop scheduling problem

Abstract: Open-shop scheduling problem (OSSP) is a well-known topic with vast industrial applications which belongs to one of the most important issues in the field of engineering. OSSP is a kind of NP problems and has a wider solution space than other basic scheduling problems, i.e., Job-shop and flow-shop scheduling. Due to this fact, this problem has attracted many researchers over the past decades and numerous algorithms have been proposed for that. This paper investigates the effects of crossover and mutation operator selection in Genetic Algorithms (GA) for solving OSSP. The proposed algorithm, which is called EGA_OS, is evaluated and compared with other existing algorithms. Computational results show that selection of genetic operation type has a great influence on the quality of solutions, and the proposed algorithm could generate better solutions compared to other developed algorithms in terms of computational times and objective values.

A Time-Driven Data Placement Strategy for a Scientific Workflow Combining Edge Computing and Cloud Computing

Abstract: Compared to traditional distributed computing environments such as grids, cloud computing provides a more cost-effective way to deploy scientific workflows. Each task of a scientific workflow requires several large datasets that are located in different datacenters, resulting in serious data transmission delays. Edge computing reduces the data transmission delays and supports the fixed storing manner for scientific workflow private datasets, but there is a bottleneck in its storage capacity. It is a challenge to combine the advantages of both edge computing and cloud computing to rationalize the data placement of scientific workflow, and optimize the data transmission time across different datacenters. In this study, a self-adaptive discrete particle swarm optimization algorithm with genetic algorithm operators (GA-DPSO) was proposed to optimize the data transmission time when placing data for a scientific workflow. This approach considered the characteristics of data placement combining edge computing and cloud computing. In addition, it considered the factors impacting transmission delay, such as the bandwidth between datacenters, the number of edge datacenters, and the storage capacity of edge datacenters. The crossover and mutation operators of the genetic algorithm were adopted to avoid the premature convergence of traditional particle swarm optimization algorithm, which enhanced the diversity of population evolution and effectively reduced the data transmission time. The experimental results show that the data placement strategy based on GA-DPSO can effectively reduce the data transmission time during workflow execution combining edge computing and cloud computing.

An optimized feature selection based on genetic approach and support vector machine for heart disease

Abstract: Heart disease diagnosis is found to be a challenging issue which can offer a computerized estimate about the level of heart disease so that supplementary action can be made easy. Thus, heart disease diagnosis has expected massive attention worldwide among the healthcare environment. Optimization algorithms played a significant role in heart disease diagnosis with good efficiency. The objective of this paper is to propose an optimization function on the basis of support vector machine (SVM). This objective function is used in the genetic algorithm (GA) for selecting the more significant features to get heart disease. The experimental results of the GA–SVM are compared with the various existing feature selection algorithms such as Relief, CFS, Filtered subset, Info gain, Consistency subset, Chi squared, One attribute based, Filtered attribute, Gain ratio, and GA. The receiver operating characteristic analysis is performed to evaluate the good performance of SVM classifier. The proposed framework is demonstrated in the MATLAB environment with a dataset collected from Cleveland heart disease database.

Genetic Algorithm- A Literature Review

Abstract: Genetic Algorithm (GA) may be attributed as method for optimizing the search tool for difficult problems based on genetics selection principle. In additions to Optimization it also serves the purpose of machine learning and for Research and development. It is analogous to biology for chromosome generation with variables such as selection, crossover and mutation together constituting genetic operations which would be applicable on a random population initially. GA aims to yield solutions for the consecutive generations. The extent of success in individual production is directly in proportion to fitness of solution which is represented by it, thereby ensuring that quality in successive generations will be better. The process is concluded once an GA is most suitable for the issues that need optimization associated with some computable system.. John Holland may be regarded as funding father of original genetic algorithm and is attributed to year 1970’s as funding date. Additionally a random search method represented by Charles Darwin for a defined search space in order to effetely solve a problem. In this paper, what is genetic algorithm and its basic workflow is discussed how a genetic algorithm work and what are the process is included in this is also discussed. Further, the features and application of genetic algorithm are mentioned in the paper.

Genetic algorithms for computational materials discovery accelerated by machine learning

Abstract: Materials discovery is increasingly being impelled by machine learning methods that rely on pre-existing datasets. Where datasets are lacking, unbiased data generation can be achieved with genetic algorithms. Here a machine learning model is trained on-the-fly as a computationally inexpensive energy predictor before analyzing how to augment convergence in genetic algorithm-based approaches by using the model as a surrogate. This leads to a machine learning accelerated genetic algorithm combining robust qualities of the genetic algorithm with rapid machine learning. The approach is used to search for stable, compositionally variant, geometrically similar nanoparticle alloys to illustrate its capability for accelerated materials discovery, e.g., nanoalloy catalysts. The machine learning accelerated approach, in this case, yields a 50-fold reduction in the number of required energy calculations compared to a traditional “brute force” genetic algorithm. This makes searching through the space of all homotops and compositions of a binary alloy particle in a given structure feasible, using density functional theory calculations.

A Hybrid Genetic Algorithm, Simulated Annealing and Tabu Search Heuristic for Vehicle Routing Problems with Time Windows

Abstract: The Vehicle Routing Problem with Time Windows (VRPTW) involves servicing a set of customers, with earliest and latest time deadlines, with varying demands using capacitated vehicles with limited travel times. The objective of the problem is to service all customers while minimizing the number of vehicles and travel distance without violating the capacity and travel time of the vehicles and customer time constraints. In this paper we describe a λ-interchange mechanism that moves customers between routes to generate neighborhood solutions for the VRPTW. The λ-interchange neighborhood is searched using Simulated Annealing and Tabu Search strategies. The initial solutions to the VRPTW are obtained using the Push-Forward Insertion heuristic and a Genetic Algorithm based sectoring heuristic. The hybrid combination of the implemented heuristics, collectively known as the GenSAT system, were used to solve 60 problems from the literature with customer sizes varying from 100 to 417 customers. The computational results of GenSAT obtained new best solutions for 40 test problems. For the remaining 20 test problems, 11 solutions obtained by the GenSAT system equal previously known best solutions. The average performance of GenSAT is significantly better than known competing heuristics. For known optimal solutions to the VRPTW problems, the GenSAT system obtained the optimal number of vehicles.