Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this entry, we introduce ANN using familiar econometric terminology and provide an overview of ANN modeling approach and its implementation methods. † Correspondence: Chung-Ming Kuan, Institute of Economics, Academia Sinica, 128 Academia Road, Sec. 2, Taipei 115, Taiwan; ckuan@econ.sinica.edu.tw. †† I would like to express my sincere gratitude to the editor, Professor Steven Durlauf, for his patience and constructive comments on early drafts of this entry. I also thank Shih-Hsun Hsu and Yu-Lieh Huang for very helpful suggestions. The remaining errors are all mine.

Artificial neural networks

Differential Evolution (DE) is arguably one of the most powerful and versatile evolutionary optimizers for the continuous parameter spaces in recent times. Almost 5 years have passed since the first comprehensive survey article was published on DE by Das and Suganthan in 2011. Several developments have been reported on various aspects of the algorithm in these 5 years and the research on and with DE have now reached an impressive state. Considering the huge progress of research with DE and its applications in diverse domains of science and technology, we find that it is a high time to provide a critical review of the latest literatures published and also to point out some important future avenues of research. The purpose of this paper is to summarize and organize the information on these current developments on DE. Beginning with a comprehensive foundation of the basic DE family of algorithms, we proceed through the recent proposals on parameter adaptation of DE, DE-based single-objective global optimizers, DE adopted for various optimization scenarios including constrained, large-scale, multi-objective, multi-modal and dynamic optimization, hybridization of DE with other optimizers, and also the multi-faceted literature on applications of DE. The paper also presents a dozen of interesting open problems and future research issues on DE.

Recent advances in differential evolution – An updated survey

Manufacturing industry profoundly impact economic and societal progress. As being a commonly accepted term for research centers and universities, the Industry 4.0 initiative has received a splendid attention of the business and research community. Although the idea is not new and was on the agenda of academic research in many years with different perceptions, the term “Industry 4.0” is just launched and well accepted to some extend not only in academic life but also in the industrial society as well. While academic research focuses on understanding and defining the concept and trying to develop related systems, business models and respective methodologies, industry, on the other hand, focuses its attention on the change of industrial machine suits and intelligent products as well as potential customers on this progress. It is therefore important for the companies to primarily understand the features and content of the Industry 4.0 for potential transformation from machine dominant manufacturing to digital manufacturing. In order to achieve a successful transformation, they should clearly review their positions and respective potentials against basic requirements set forward for Industry 4.0 standard. This will allow them to generate a well-defined road map. There has been several approaches and discussions going on along this line, a several road maps are already proposed. Some of those are reviewed in this paper. However, the literature clearly indicates the lack of respective assessment methodologies. Since the implementation and applications of related theorems and definitions outlined for the 4th industrial revolution is not mature enough for most of the reel life implementations, a systematic approach for making respective assessments and evaluations seems to be urgently required for those who are intending to speed this transformation up. It is now main responsibility of the research community to developed technological infrastructure with physical systems, management models, business models as well as some well-defined Industry 4.0 scenarios in order to make the life for the practitioners easy. It is estimated by the experts that the Industry 4.0 and related progress along this line will have an enormous effect on social life. As outlined in the introduction, some social transformation is also expected. It is assumed that the robots will be more dominant in manufacturing, implanted technologies, cooperating and coordinating machines, self-decision-making systems, autonom problem solvers, learning machines, 3D printing etc. will dominate the production process. Wearable internet, big data analysis, sensor based life, smart city implementations or similar applications will be the main concern of the community. This social transformation will naturally trigger the manufacturing society to improve their manufacturing suits to cope with the customer requirements and sustain competitive advantage. A summary of the potential progress along this line is reviewed in introduction of the paper. It is so obvious that the future manufacturing systems will have a different vision composed of products, intelligence, communications and information network. This will bring about new business models to be dominant in industrial life. Another important issue to take into account is that the time span of this so-called revolution will be so short triggering a continues transformation process to yield some new industrial areas to emerge. This clearly puts a big pressure on manufacturers to learn, understand, design and implement the transformation process. Since the main motivation for finding the best way to follow this transformation, a comprehensive literature review will generate a remarkable support. This paper presents such a review for highlighting the progress and aims to help improve the awareness on the best experiences. It is intended to provide a clear idea for those wishing to generate a road map for digitizing the respective manufacturing suits. By presenting this review it is also intended to provide a hands-on library of Industry 4.0 to both academics as well as industrial practitioners. The top 100 headings, abstracts and key words (i.e. a total of 619 publications of any kind) for each search term were independently analyzed in order to ensure the reliability of the review process. Note that, this exhaustive literature review provides a concrete definition of Industry 4.0 and defines its six design principles such as interoperability, virtualization, local, real-time talent, service orientation and modularity. It seems that these principles have taken the attention of the scientists to carry out more variety of research on the subject and to develop implementable and appropriate scenarios. A comprehensive taxonomy of Industry 4.0 can also be developed through analyzing the results of this review.

Literature review of Industry 4.0 and related technologies

Black hole: A new heuristic optimization approach for data clustering

The traditional production scheduling problem considers performance indicators such as processing time, cost, and quality as optimization objectives in manufacturing systems; however, it does not take energy consumption or environmental impacts completely into account. Therefore, this paper proposes an energy-efficient model for flexible flow shop scheduling (FFS). First, a mathematical model for a FFS problem, which is based on an energy-efficient mechanism, is described to solve multi-objective optimization. Since FFS is well known as a NP-hard problem, an improved, genetic-simulated annealing algorithm is adopted to make a significant trade-off between the makespan and the total energy consumption to implement a feasible scheduling. Finally, a case study of a production scheduling problem for a metalworking workshop in a plant is simulated. The experimental results show that the relationship between the makespan and the energy consumption may be apparently conflicting. In addition, an energy-saving decision is performed in a feasible scheduling. Using the decision method, there could be significant potential for minimizing energy consumption.

/pdf/energy-efficient-scheduling-for-a-flexible-flow-shop-using-4wcseyzqzc.pdf

Energy-efficient scheduling for a flexible flow shop using an improved genetic-simulated annealing algorithm

In order to facilitate product design and realization processes, presently, research is actively carried out for developing methodologies and technologies of collaborative computer-aided design systems to support design teams geographically dispersed based on the quickly evolving information technologies. In this paper, the developed collaborative systems, methodologies and technologies, which are organized as a horizontal or a hierarchical manner, are reviewed. Meanwhile, a 3D streaming technology, which can effectively transmit visualization information across networks for Web applications, is highlighted and the algorithms behind it are disclosed.

Collaborative computer-aided design-research and development status

Cobot programming for collaborative industrial tasks: An overview

A job shop needs to deal with a lot of make-to-order business, in which the orders are usually diverse in types but each one is small in volume. To increase the flexibility and responsiveness of the job shop in the more competitive market, process planning and scheduling modules have been actively developed and deployed. The functions of the two modules are usually complementary. It is ideal to integrate them more tightly to achieve the global optimization of product development and manufacturing. In this paper, a unified representation model and a simulated annealing-based approach have been developed to facilitate the integration and optimization process. In the approach, three strategies, including processing flexibility, operation sequencing flexibility and scheduling flexibility, have been used for exploring the search space to support the optimization process effectively. Performance criteria, such as makespan, the balanced level of machine utilization, job tardiness and manufacturing cost, have been systematically defined to make the algorithm adaptive to meet various practical requirements. Case studies under various working conditions and the comparisons of this approach with two modern evolutionary approaches are given. The merits and characteristics of the approach are thereby highlighted.

/pdf/a-simulated-annealing-based-optimization-approach-for-i3bg9dnu2a.pdf

A simulated annealing-based optimization approach for integrated process planning and scheduling

For a CAPP system in a dynamic workshop environment, the activities of selecting machining resources, determining set-up plans and sequencing machining operations should be considered simultaneously to achieve the global lowest machining cost. Optimizing process plans for a prismatic part usually suffer from complex technological requirements and geometric relationships between features in the part. Here, process planning is modelled as a combinatorial optimization problem with constraints, and a hybrid genetic algorithm (GA) and simulated annealing (SA) approach has been developed to solve it. The evaluation criterion of machining cost comes from the combined strengths of machine costs, cutting tool costs, machine changes, tool changes and set-ups. The GA is carried out in the first stage to generate some initially good process plans. Based on a few selective plans with Hamming distances between each other, the SA algorithm is employed to search for alternative optimal or near-optimal process plans. In t...

Weidong Li

Papers

Energy-efficient scheduling for a flexible flow shop using an improved genetic-simulated annealing algorithm

Collaborative computer-aided design-research and development status

Cobot programming for collaborative industrial tasks: An overview

A simulated annealing-based optimization approach for integrated process planning and scheduling

Hybrid genetic algorithm and simulated annealing approach for the optimization of process plans for prismatic parts