Open AccessJournal Article
A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models
Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.Abstract:
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.read more
Citations
More filters
Journal ArticleDOI
A mixture of HMM, GA, and Elman network for load prediction in cloud-oriented data centers
TL;DR: A novel approach to forecast the future load for cloud-oriented data centers using a hidden Markov model (HMM) based data clustering method and a genetic algorithm optimized Elman network is used to forecast future load.
Journal ArticleDOI
Image processing techniques for metallic object detection with millimetre-wave images
TL;DR: In this paper a single detector, for metallic objects, is presented which utilises a statistical model developed in this paper, and results indicate an excellent rate of success for threat identification.
Proceedings ArticleDOI
Soft assignment of visual words as Linear Coordinate Coding and optimisation of its reconstruction error
TL;DR: This work shows that one can take two views on Soft Assignment: an approach derived from Gaussian Mixture Model or special case of Linear Coordinate Coding, and proposes how to optimise smoothing factor of Soft Assignment in a way that minimises descriptor reconstruction error and maximises classification performance.
Proceedings ArticleDOI
Range unfolding for Time-of-Flight depth cameras
TL;DR: The proposed method accurately determines the number of mods in range unfolding and the maximum range is practically extended at least twice of that specified by the modulation frequency.
Journal ArticleDOI
A Distributed Classification/Estimation Algorithm for Sensor Networks
TL;DR: In this article, the problem of simultaneous classification and estimation of hidden parameters in a sensor network with communication constraints is addressed, and a cooperative iterative algorithm which copes with the communication constraints imposed by the network is proposed.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
The Fractal Geometry of Nature
TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.