Open AccessJournal Article
A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models
Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.Abstract:
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.read more
Citations
More filters
Proceedings ArticleDOI
A Learning-Based Framework for Robot Peg-Hole-Insertion
TL;DR: A framework for teaching robot peg-hole-insertion from human demonstration is introduced and a Dimension Reduction and Recovery method is proposed to simplify control policy learning.
Journal ArticleDOI
Improving short utterance speaker recognition by modeling speech unit classes
TL;DR: A novel solution that distributes speech signals into a multitude of acoustic subregion that are defined by speech units, and models speakers within the subregions, and can be greatly improved in scenarios where no enrollment data is available for some speech unit classes.
Dissertation
Vision-based terrain classification and classifier fusion for planetary exploration rovers
Journal ArticleDOI
Gaussian Mixture Model Using Semisupervised Learning for Probabilistic Fault Diagnosis Under New Data Categories
TL;DR: A novel probabilistic diagnosis framework is proposed in this paper, which is able to first detect whether new types of faults occur and further categorize them in detail via the GMM update, and achieve an average diagnosis accuracy of 97.9% without new data categories.
Journal ArticleDOI
Extending the Functionality of Behavioural Change-Point Analysis with k-Means Clustering: A Case Study with the Little Penguin (Eudyptula minor)
TL;DR: Addition of k-means clustering extends the utility of behavioural change point analysis, by providing a simple means through which the behaviours inferred for the location observations comprising individual movement trajectories can be objectively classified.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
The Fractal Geometry of Nature
TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.