Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

In this Chapter, we imagine a decision maker (or a group of experts) trying to establish or examine fair procedures to combine opinions about alternatives related to different points of view.

Multiple criteria decision making

Differential Evolution (DE) is arguably one of the most powerful and versatile evolutionary optimizers for the continuous parameter spaces in recent times. Almost 5 years have passed since the first comprehensive survey article was published on DE by Das and Suganthan in 2011. Several developments have been reported on various aspects of the algorithm in these 5 years and the research on and with DE have now reached an impressive state. Considering the huge progress of research with DE and its applications in diverse domains of science and technology, we find that it is a high time to provide a critical review of the latest literatures published and also to point out some important future avenues of research. The purpose of this paper is to summarize and organize the information on these current developments on DE. Beginning with a comprehensive foundation of the basic DE family of algorithms, we proceed through the recent proposals on parameter adaptation of DE, DE-based single-objective global optimizers, DE adopted for various optimization scenarios including constrained, large-scale, multi-objective, multi-modal and dynamic optimization, hybridization of DE with other optimizers, and also the multi-faceted literature on applications of DE. The paper also presents a dozen of interesting open problems and future research issues on DE.

Recent advances in differential evolution – An updated survey

In evolutionary multiobjective optimization, maintaining a good balance between convergence and diversity is particularly crucial to the performance of the evolutionary algorithms (EAs). In addition, it becomes increasingly important to incorporate user preferences because it will be less likely to achieve a representative subset of the Pareto-optimal solutions using a limited population size as the number of objectives increases. This paper proposes a reference vector-guided EA for many-objective optimization. The reference vectors can be used not only to decompose the original multiobjective optimization problem into a number of single-objective subproblems, but also to elucidate user preferences to target a preferred subset of the whole Pareto front (PF). In the proposed algorithm, a scalarization approach, termed angle-penalized distance, is adopted to balance convergence and diversity of the solutions in the high-dimensional objective space. An adaptation strategy is proposed to dynamically adjust the distribution of the reference vectors according to the scales of the objective functions. Our experimental results on a variety of benchmark test problems show that the proposed algorithm is highly competitive in comparison with five state-of-the-art EAs for many-objective optimization. In addition, we show that reference vectors are effective and cost-efficient for preference articulation, which is particularly desirable for many-objective optimization. Furthermore, a reference vector regeneration strategy is proposed for handling irregular PFs. Finally, the proposed algorithm is extended for solving constrained many-objective optimization problems.

A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization

Over the last three decades, a large number of evolutionary algorithms have been developed for solving multi-objective optimization problems. However, there lacks an upto-date and comprehensive software platform for researchers to properly benchmark existing algorithms and for practitioners to apply selected algorithms to solve their real-world problems. The demand of such a common tool becomes even more urgent, when the source code of many proposed algorithms has not been made publicly available. To address these issues, we have developed a MATLAB platform for evolutionary multi-objective optimization in this paper, called PlatEMO, which includes more than 50 multiobjective evolutionary algorithms and more than 100 multi-objective test problems, along with several widely used performance indicators. With a user-friendly graphical user interface, PlatEMO enables users to easily compare several evolutionary algorithms at one time and collect statistical results in Excel or LaTeX files. More importantly, PlatEMO is completely open source, such that users are able to develop new algorithms on the basis of it. This paper introduces the main features of PlatEMO and illustrates how to use it for performing comparative experiments, embedding new algorithms, creating new test problems, and developing performance indicators. Source code of PlatEMO is now available at: http://bimk.ahu.edu.cn/index.php?s=/Index/Software/index.html.

PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum]

A novel approach called generalized adaptive wavelet neural network based on resemblance coefficient (GAWNN-RC) is proposed to extract the most discriminatory information from radar emitter signals and to recognize different radar emitter signals with different intra-pulse modulation laws In this work. Because a weighted linear combination of dilated and translated replica of a mother wavelet can approximate a radar emitter signal in frequency domain and the weights, dilation and translation parameters can be estimated adaptively to minimize an approximation error in a least mean square sense, generalized adaptive wavelets (GAW) can be used to extract the most important features of radar emitter signals. Aiming at the characteristics of radar emitter signals, GAW is introduced to extract features for the first time. But there are three problems in GAW representation: (1) it is difficult to obtain the globally optimal solution using gradient descent algorithm (GDA) because GDA is very sensitive to initial values and drops into sub-optimum easily; (2) there are many difficulties in classifier design because the dimension of feature vector is too large; (3) multiple solutions exist in GAW representation, which is not considered in existing methods. So quantum evolutionary algorithm (QEA) and resemblance coefficient method are proposed to solve the problems effectively. Moreover, QEA and neural network (NN) are combined to design classifiers. Finally, 6 typical radar emitter signals are chosen to make the experiment of feature extraction and recognition. Experimental results show that high accurate recognition rate can be achieved and unknown radar emitter signals are also distinguished accurately, which indicates that the introduced approach is feasible and effective.

Application of generalized adaptive wavelet neural network based on resemblance coefficient to signal recognition

Radial basis probability neural network (RBPNN) was introduced to recognize radar emitter signals. The structure and training algorithm of RBPNN were first discussed. Then, a novel feature extraction approach called resemblance coefficient method and its detailed steps were presented. Finally, based on resemblance coefficient features, RBPNN was used to design classifier to identify 9 typical radar emitter signals. Because RBPNN inherits the advantages of both radial basis function neural network and probability neural network, RBPNN has the good characteristics of simple structure, fast learning speed and strong capabilities of pattern recognition and classification. Experimental results show that high accurate recognition rates are achieved and the introduced approach is effective and practical.

Application of radial basis probability neural network to signal recognition

Migration strategy in distributed adaptive optimization spiking neural P systems

Spiking neural P systems (SN P systems), inspired by biological neurons, are introduced as symbolical neural-like computing models that encode information with multisets of symbolized spikes in neurons and process information by using spike-based rewriting rules. Inspired by neuronal activities affected by enzymes, a numerical variant of SN P systems called enzymatic numerical spiking neural P systems (ENSNP systems) is proposed wherein each neuron has a set of variables with real values and a set of enzymatic activation-production spiking rules, and each synapse has an assigned weight. By using spiking rules, ENSNP systems can directly implement mathematical methods based on real numbers and continuous functions. Furthermore, ENSNP systems are used to model ENSNP membrane controllers (ENSNP-MCs) for robots implementing wall following. The trajectories, distances from the wall, and wheel speeds of robots with ENSNP-MCs for wall following are compared with those of a robot with a membrane controller for wall following. The average error values of the designed ENSNP-MCs are compared with three recently fuzzy logical controllers with optimization algorithms for wall following. The experimental results showed that the designed ENSNP-MCs can be candidates as efficient controllers to control robots implementing the task of wall following.

Enzymatic Numerical Spiking Neural Membrane Systems and their Application in Designing Membrane Controllers

The key evolutionary approaches used in the next chapters, including genetic algorithms, quantum-inspired evolutionary algorithms, ant colony optimization, particle swarm optimization and differential evolution are presented.

Gexiang Zhang

Papers

Application of generalized adaptive wavelet neural network based on resemblance coefficient to signal recognition

Application of radial basis probability neural network to signal recognition

Migration strategy in distributed adaptive optimization spiking neural P systems

Enzymatic Numerical Spiking Neural Membrane Systems and their Application in Designing Membrane Controllers

Fundamentals of Evolutionary Computation