Pak Kin Wong

Bio: Pak Kin Wong is an academic researcher from University of Macau. The author has contributed to research in topics: Extreme learning machine & Control theory. The author has an hindex of 30, co-authored 194 publications receiving 3278 citations.

Sparse Bayesian Extreme Learning Machine for Multi-classification

Abstract: Extreme learning machine (ELM) has become a popular topic in machine learning in recent years. ELM is a new kind of single-hidden layer feedforward neural network with an extremely low computational cost. ELM, however, has two evident drawbacks: 1) the output weights solved by Moore-Penrose generalized inverse is a least squares minimization issue, which easily suffers from overfitting and 2) the accuracy of ELM is drastically sensitive to the number of hidden neurons so that a large model is usually generated. This brief presents a sparse Bayesian approach for learning the output weights of ELM in classification. The new model, called Sparse Bayesian ELM (SBELM), can resolve these two drawbacks by estimating the marginal likelihood of network outputs and automatically pruning most of the redundant hidden neurons during learning phase, which results in an accurate and compact model. The proposed SBELM is evaluated on wide types of benchmark classification problems, which verifies that the accuracy of SBELM model is relatively insensitive to the number of hidden neurons; and hence a much more compact model is always produced as compared with other state-of-the-art neural network classifiers.

Kernel-Based Multilayer Extreme Learning Machines for Representation Learning

Abstract: Recently, multilayer extreme learning machine (ML-ELM) was applied to stacked autoencoder (SAE) for representation learning. In contrast to traditional SAE, the training time of ML-ELM is significantly reduced from hours to seconds with high accuracy. However, ML-ELM suffers from several drawbacks: 1) manual tuning on the number of hidden nodes in every layer is an uncertain factor to training time and generalization; 2) random projection of input weights and bias in every layer of ML-ELM leads to suboptimal model generalization; 3) the pseudoinverse solution for output weights in every layer incurs relatively large reconstruction error; and 4) the storage and execution time for transformation matrices in representation learning are proportional to the number of hidden layers. Inspired by kernel learning, a kernel version of ML-ELM is developed, namely, multilayer kernel ELM (ML-KELM), whose contributions are: 1) elimination of manual tuning on the number of hidden nodes in every layer; 2) no random projection mechanism so as to obtain optimal model generalization; 3) exact inverse solution for output weights is guaranteed under invertible kernel matrix, resulting to smaller reconstruction error; and 4) all transformation matrices are unified into two matrices only, so that storage can be reduced and may shorten model execution time. Benchmark data sets of different sizes have been employed for the evaluation of ML-KELM. Experimental results have verified the contributions of the proposed ML-KELM. The improvement in accuracy over benchmark data sets is up to 7%.

Rate-Dependent Hysteresis Modeling and Control of a Piezostage Using Online Support Vector Machine and Relevance Vector Machine

Abstract: Hysteresis nonlinearity degrades the positioning accuracy of a piezostage and requires a suppression for precision micro-/nanopositioning applications. This paper proposes two new approaches to modeling and compensating the rate-dependent hysteresis of a piezostage driven by piezoelectric stack actuators. By formulating the hysteresis modeling as an online nonlinear regression problem, online least squares support vector machine (SVM) (LS-SVM) and online relevance vector machine (RVM) models are proposed to capture the hysteretic behavior. Both hysteresis models are capable of updating continually with subsequent samples. After a comparative study on modeling performances, an inverse model-based feedforward combined with proportional-integral-derivative feedback control is presented to alleviate the hysteresis effect. Experimental results show that the LS-SVM model-based control scheme is over 86% more accurate than the RVM model-based one in the motion tracking task, whereas the latter is 14 times faster than the former in terms of updating time. Moreover, both LS-SVM and RVM model-based control schemes can suppress the rate-dependent hysteresis to a negligible level, which validates the feasibility and effectiveness of the proposed approaches.

Chassis Integrated Control for Active Suspension, Active Front Steering and Direct Yaw Moment Systems Using Hierarchical Strategy

Abstract: This paper proposes a novel integrated controller with three-layer hierarchical structure to coordinate the interactions among active suspension system (ASS), active front steering (AFS) and direct yaw moment control (DYC). First of all, a 14-degree-of-freedom nonlinear vehicle dynamic model is constructed. Then, an upper layer is designed to calculate the total corrected moment for ASS and intermediate layer based on linear moment distribution. By considering the working regions of the AFS and DYC, the intermediate layer is functionalised to determine the trigger signal for the lower layer with corresponding weights. The lower layer is utilised to separately trace the desired value of each local controller and achieve the local control objectives of each subsystem. Simulation results show that the proposed three-layer hierarchical structure is effective in handling the working region of the AFS and DYC, while the quasi-experimental result shows that the proposed integrated controller is able to improve the lateral and vertical dynamics of the vehicle effectively as compared with a conventional electronic stability controller.

Engineering Applications of Intelligent Monitoring and Control 2014

Abstract: 1 Department of Electromechanical Engineering, Faculty of Science and Technology, University of Macau, Avenida Padre Tomas Pereira Taipa, Macao, China 2 School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, China 3Department of Mechanical Engineering, The University of Auckland, 20 Symonds Street, Auckland, New Zealand 4Department of Bio-Industrial Mechatronics Engineering, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan

Pattern Recognition and Machine Learning

Abstract: Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Patterns of Somatic Mutation in Human Cancer Genomes

Abstract: AACR Centennial Conference: Translational Cancer Medicine-- Nov 4-8, 2007; Singapore PL02-05 All cancers are due to abnormalities in DNA. The availability of the human genome sequence has led to the proposal that resequencing of cancer genomes will reveal the full complement of somatic mutations and hence all the cancer genes. To explore the nature of the information that will be derived from cancer genome sequencing we have sequenced the coding exons of the family of 518 protein kinases, ~1.3Mb DNA per cancer sample, in 210 cancers of diverse histological types. Despite the screen being directed toward the coding regions of a gene family that has previously been strongly implicated in oncogenesis, the results indicate that the majority of somatic mutations detected are “passengers”. There is considerable variation in the number and pattern of these mutations between individual cancers, indicating substantial diversity of processes of molecular evolution between cancers. The imprints of exogenous mutagenic exposures, mutagenic treatment regimes and DNA repair defects can all be seen in the distinctive mutational signatures of individual cancers. This systematic mutation screen and others have previously yielded a number of cancer genes that are frequently mutated in one or more cancer types and which are now anticancer drug targets (for example BRAF , PIK3CA , and EGFR ). However, detailed analyses of the data from our screen additionally suggest that there exist a large number of additional “driver” mutations which are distributed across a substantial number of genes. It therefore appears that cells may be able to utilise mutations in a large repertoire of potential cancer genes to acquire the neoplastic phenotype. However, many of these genes are employed only infrequently. These findings may have implications for future anticancer drug development.

Learning from class-imbalanced data

Abstract: 527 articles related to imbalanced data and rare events are reviewed.Viewing reviewed papers from both technical and practical perspectives.Summarizing existing methods and corresponding statistics by a new taxonomy idea.Categorizing 162 application papers into 13 domains and giving introduction.Some opening questions are discussed at the end of this manuscript. Rare events, especially those that could potentially negatively impact society, often require humans decision-making responses. Detecting rare events can be viewed as a prediction task in data mining and machine learning communities. As these events are rarely observed in daily life, the prediction task suffers from a lack of balanced data. In this paper, we provide an in depth review of rare event detection from an imbalanced learning perspective. Five hundred and seventeen related papers that have been published in the past decade were collected for the study. The initial statistics suggested that rare events detection and imbalanced learning are concerned across a wide range of research areas from management science to engineering. We reviewed all collected papers from both a technical and a practical point of view. Modeling methods discussed include techniques such as data preprocessing, classification algorithms and model evaluation. For applications, we first provide a comprehensive taxonomy of the existing application domains of imbalanced learning, and then we detail the applications for each category. Finally, some suggestions from the reviewed papers are incorporated with our experiences and judgments to offer further research directions for the imbalanced learning and rare event detection fields.