scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters

Practical structured learning techniques for natural language processing

TL;DR: This thesis presents Searn (for “search-learn”), an approach to learning for structured outputs that is applicable to the wide variety of problems encountered in natural language (and, hopefully, to problems in other domains, such as vision and biology).
Journal ArticleDOI

Predicting travel time reliability using mobile phone GPS data

TL;DR: TRIP is the first method to provide accurate predictions of travel time reliability for complete, large-scale road networks, using GPS data from mobile phones or other probe vehicles.
Journal ArticleDOI

Clustering performance comparison using K-means and expectation maximization algorithms

TL;DR: The logistic regression analysis is applied to EM clusters and the K-means clustering method for quality assessment of red wine, and a method is proposed for ensuring the accuracy of the classification results.
Book ChapterDOI

Aerial Shepherds: Coordination among UAVs and Swarms of Robots

TL;DR: A probabilistic approach using the EM algorithm for the initial assignment of shepherds to groups is shown and behaviors that allow an efficient hierarchical decomposition are presented.
Journal ArticleDOI

Atherosclerotic risk stratification strategy for carotid arteries using texture-based features.

TL;DR: This work presents a computer aided diagnostic (CAD) based ultrasound characterization methodology (a class of Atheromatic systems) that classifies the patient into symptomatic and asymptomatic classes using two kinds of datasets: plaque regions in ultrasound carotids segmented semi-automatically and far wall gray-scale intima-media thickness regions along the common carotid artery segmented automatically.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.