scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Hidden Markov models for the activity profile of terrorist groups

TL;DR: A HMM that captures the latent states underlying the dynamics of the group and thus its activity profile is developed and is shown to track even nonpersistent changes that last only for a short duration at the cost of learning the underlying model.
Journal ArticleDOI

Acoustic cues from the floor

TL;DR: The proposed approach has a considerable advantage over aerial solutions since it is able to achieve higher fall classification performance using a simpler algorithmic pipeline and hardware setup.
Journal ArticleDOI

Method of predicting splice sites based on signal interactions.

TL;DR: The new Bayesian SS sensor based on oligonucleotide counting, implemented in the new tool SpliceScan, has been shown to outperform the SpliceView, GeneSplicer, NNSplice, Genio and NetUTR tools for the test set of human genes.
Journal ArticleDOI

Data mining technique for breast cancer detection in thermograms using hybrid feature extraction strategy

TL;DR: The proposed computer-aided diagnostic system can be used for an automatic classification of normal and abnormal breast thermograms which can aid the radiologists in their diagnosis.
Journal ArticleDOI

Diffusion-based EM algorithm for distributed estimation of Gaussian mixtures in wireless sensor networks.

TL;DR: A diffusion strategy is introduced for acquiring the global statistics in EM algorithm in which each sensor node only needs to communicate its local statistics to its neighboring nodes at each iteration to improve the existing consensus-based distributed EM algorithm.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.