Open AccessJournal Article
A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models
Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.Abstract:
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.read more
Citations
More filters
Journal ArticleDOI
Robust Bayesian Classification with Incomplete Data
Xunan Zhang,Shiji Song,Cheng Wu +2 more
TL;DR: The expectation maximization algorithm for learning a multivariate Gaussian mixture model and a multiple kernel density estimator based on the propensity scores are proposed to avoid listwise deletion or mean imputation for solving classification tasks with incomplete data.
Proceedings ArticleDOI
Speaker Identification using a Microphone Array and a Joint HMM with Speech Spectrum and Angle of Arrival
TL;DR: A speaker identification algorithm for a microphone array based on a first-order joint hidden Markov model where the observations correspond to the angle of arrival of the speech and the speech spectrum is presented.
Journal ArticleDOI
Pulse discrimination with a Gaussian mixture model on an FPGA
TL;DR: The results show that the FPGA-based GMM classifier outperforms the standard PSD techniques in terms of classification accuracy at low particle energy and executes more quickly than its CPU-based counterpart.
Journal ArticleDOI
Real-time GPU color-based segmentation of football players
Miguel Angel Montañés Laborda,Enrique F. Torres Moreno,Jesus Martinez del Rincon,José Elías Herrero Jaraba +3 more
TL;DR: A multi-camera application capable of processing high resolution images and extracting features based on colors patterns over graphic processing units (GPU) using a Gaussian Mixture Models (GMM) in order to analyze sport live images and video.
Journal ArticleDOI
Temporal graphical models for cross-species gene regulatory network discovery
TL;DR: This paper presents hidden Markov random field regression with L(1) penalty to uncover the regulatory network structure for different species and provides a framework for sharing information across species via hidden component graphs and is able to incorporate domain knowledge across species easily.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
The Fractal Geometry of Nature
TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.