Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

Data mining and analytics have played an important role in knowledge discovery and decision making/supports in the process industry over the past several decades. As a computational engine to data mining and analytics, machine learning serves as basic tools for information extraction, data pattern recognition and predictions. From the perspective of machine learning, this paper provides a review on existing data mining and analytics applications in the process industry over the past several decades. The state-of-the-art of data mining and analytics are reviewed through eight unsupervised learning and ten supervised learning algorithms, as well as the application status of semi-supervised learning algorithms. Several perspectives are highlighted and discussed for future researches on data mining and analytics in the process industry.

Data Mining and Analytics in the Process Industry: The Role of Machine Learning

Review on data-driven modeling and monitoring for plant-wide industrial processes

Data-driven soft sensors have been widely utilized in industrial processes to estimate the critical quality variables which are intractable to directly measure online through physical devices. Due to the low sampling rate of quality variables, most of the soft sensors are developed on small number of labeled samples and the large number of unlabeled process data is discarded. The loss of information greatly limits the improvement of quality prediction accuracy. One of the main issues of data-driven soft sensor is to furthest exploit the information contained in all available process data. This paper proposes a semisupervised deep learning model for soft sensor development based on the hierarchical extreme learning machine (HELM). First, the deep network structure of autoencoders is implemented for unsupervised feature extraction with all the process samples. Then, extreme learning machine is utilized for regression through appending the quality variable. Meanwhile, the manifold regularization method is introduced for semisupervised model training. The new method can not only deeply extract the information that the data contains, but learn more from the extra unlabeled samples as well. The proposed semisupervised HELM method is applied in a high–low transformer to estimate the carbon monoxide content, which shows a significant improvement of the prediction accuracy, compared to traditional methods.

Deep Learning of Semisupervised Process Data With Hierarchical Extreme Learning Machine and Soft Sensor Application

In order to deal with the modeling and monitoring issue of large-scale industrial processes with big data, a distributed and parallel designed principal component analysis approach is proposed. To handle the high-dimensional process variables, the large-scale process is first decomposed into distributed blocks with a priori process knowledge. Afterward, in order to solve the modeling issue with large-scale data chunks in each block, a distributed and parallel data processing strategy is proposed based on the framework of MapReduce and then principal components are further extracted for each distributed block. With all these steps, statistical modeling of large-scale processes with big data can be established. Finally, a systematic fault detection and isolation scheme is designed so that the whole large-scale process can be hierarchically monitored from the plant-wide level, unit block level, and variable level. The effectiveness of the proposed method is evaluated through the Tennessee Eastman benchmark process.

Distributed Parallel PCA for Modeling and Monitoring of Large-Scale Plant-Wide Processes With Big Data

Review and big data perspectives on robust data mining approaches for industrial process modeling with outliers and missing data

Large-scale plant-wide process modeling and hierarchical monitoring: A distributed Bayesian network approach

In this paper, a novel hidden Markov model (HMM)-driven robust latent variable model (LVM) is proposed for fault classification in dynamic industrial processes. A robust probabilistic model with Student's $t$ mixture output is designed for tolerating outliers. Based on the robust LVM, the probabilistic structure is further developed into a classifier form so as to incorporate various types of process information during model acquisition. After that, the robust probabilistic classifier is extended within the HMM framework so as to characterize the time-domain stochastic uncertainties. The model parameters are derived through the expectation–maximization algorithm. For performance validation, the developed model is tested on the Tennessee Eastman benchmark process.

HMM-Driven Robust Probabilistic Principal Component Analyzer for Dynamic Process Fault Classification

In this article, a robust modeling strategy for mixture probabilistic principal component analysis (PPCA) is proposed. Different from the traditional Gaussian distribution driven model such as PPCA, the multivariate student t-distribution is adopted for probabilistic modeling to reduce the negative effect of outliers, which is very common in the process industry. Furthermore, for handling the missing data problem, a partially updating algorithm is developed for parameter learning in the robust mixture PPCA model. Therefore, the new robust model can simultaneously deal with outliers and missing data. For process monitoring, a Bayesian soft decision fusion strategy is developed which is combined with the robust local monitoring models under different operating conditions. Two case studies demonstrate that the new robust model shows enhanced modeling and monitoring performance in both outlier and missing data cases, compared to the mixture probabilistic principal analysis model. © 2014 American Institute of Chemical Engineers AIChE J, 60: 2143–2157, 2014

Jinlin Zhu

Papers

Distributed Parallel PCA for Modeling and Monitoring of Large-Scale Plant-Wide Processes With Big Data

Review and big data perspectives on robust data mining approaches for industrial process modeling with outliers and missing data

Large-scale plant-wide process modeling and hierarchical monitoring: A distributed Bayesian network approach

HMM-Driven Robust Probabilistic Principal Component Analyzer for Dynamic Process Fault Classification

Robust modeling of mixture probabilistic principal component analysis and process monitoring application