Open AccessJournal Article
A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models
Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.Abstract:
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.read more
Citations
More filters
Journal ArticleDOI
Robust Lane-Change Recognition Based on An Adaptive Hidden Markov Model Using Measurement Uncertainty
TL;DR: A method for using observation uncertainty through an adaptive HMM for LCR through modified HMM models modified in real time based on data covariance to filter data with high uncertainty is proposed.
Journal Article
Blind Blur Estimation Using Low Rank Approximation of Cepstrum
Adeel A. Bhutta,Hassan Foroosh +1 more
TL;DR: A blind blur estimation technique based on the low rank approximation of cepstrum of degraded images is proposed and shown that the proposed technique can correctly estimate commonly used blur types both in noiseless and noisy cases.
Journal ArticleDOI
Target differentiation with simple infrared sensors using statistical pattern recognition techniques
TL;DR: The results indicate that the geometrical properties of the targets are more distinctive than their surface properties, and surface recognition is the limiting factor in differentiation.
Data Mining of Web Access Logs
TL;DR: The significance of the patterns discovered during this thesis work suggests that data mining techniques with suitable feature sets can produce very interesting patterns.
Proceedings Article
Fault detection for systems with multiple unknown modes and similar units - Part I
TL;DR: This paper considers fault detection for largescale practical systems with many nearly identical units operating in a shared environment with high levels of confidence.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
The Fractal Geometry of Nature
TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.