scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Keyboard acoustic emanations revisited

TL;DR: A novel attack taking as input a 10-minute sound recording of a user typing English text using a keyboard and recovering up to 96p of typed characters is presented, using the statistical constraints of the underlying content, English language, to reconstruct text from sound recordings without knowing the corresponding clear text.
Journal ArticleDOI

Job security and job protection

TL;DR: This article found that perceived job security in both permanent private and temporary jobs is positively correlated with UIB generosity, while the relationship with EPL strictness is negative: workers feel less secure in countries where jobs are more protected.
Proceedings ArticleDOI

Recognizing falls from silhouettes.

TL;DR: Preliminary results are presented that demonstrate the usefulness of the segmentation approach for distinguishing between a few common activities, specifically with fall detection in mind.
Journal ArticleDOI

MR to ultrasound registration for image-guided prostate interventions

TL;DR: A deformable registration method is described that enables automatic alignment of magnetic resonance (MR) and 3D transrectal ultrasound (TRUS) images of the prostate gland by maximising the likelihood of a particular model shape given a voxel-intensity-based feature.
Journal ArticleDOI

Automatic detection of epileptic EEG signals using higher order cumulant features.

TL;DR: The methodology employed to extract HOS features from normal, interictal, and epileptic EEG segments and to use significant features in classifiers for the detection of these three classes is presented, establishing the possibility of effective EEG segment classification using the proposed technique.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.