scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Prediction of Progressive Damage State at the Hot Spots using Statistical Estimation

TL;DR: This article is not limited to estimating the damage growth but extended to generate an ‘early alarm system’ by using Gaussian mixture model (GMM) to estimate and quantify the progressive damage.
Journal ArticleDOI

Coherent heat patterns revealed by unsupervised classification of Argo temperature profiles in the North Atlantic Ocean

TL;DR: In this paper, a Gaussian Mixture Model (GMM) was used to decompose the Probability Density Function (PDF) of a dataset into a weighted sum of Gaussian modes.
Book ChapterDOI

Multimodal Laughter Detection in Natural Discourses

TL;DR: This work focuses on the detection of laughter in natural multiparty discourses using Echo State Networks (ESN) to enable the robot to react appropriately in a timely fashion towards human communication, since laughter is an important communication utility.
Journal ArticleDOI

Review of person re-identification techniques

TL;DR: This study summarises several developments in recent literature and discusses the various available methods used in person re-identification to achieve a higher-accuracy rate and lowercomputational costs.
Journal ArticleDOI

Hidden Markov model for municipal waste generation forecasting under uncertainties

TL;DR: A probability model-driven statistical learning approach is proposed which hybridizes a wavelet de-noising, a Gaussian mixture model, and a hidden Markov model to reveal the trend of waste generation in megacities which face significant influences of social and economic changes to achieve urban sustainable development.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.