scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

HMM-Based Gain Modeling for Enhancement of Speech in Noise

TL;DR: A hidden Markov model (HMM)-based speech enhancement method using explicit gain modeling through the introduction of stochastic gain variables, energy variation in both speech and noise is explicitly modeled in a unified framework.
Journal ArticleDOI

Data mining framework for fatty liver disease classification in ultrasound: a hybrid feature extraction paradigm.

TL;DR: A novel combination of significant features based on the texture, wavelet transform, and higher order spectra of the liver ultrasound images in various supervised learning-based classifiers are used to determine parameters that classify normal and FLD-affected abnormal livers.
Patent

Command input by hand gestures captured from camera

TL;DR: In this paper, a method and system for invoking an operation of a communication terminal in response to registering and interpreting a predetermined motion or pattern of an object is presented, an input is received, the image data of the object is captured and the object in image data is identified.
Journal ArticleDOI

A Model-Based Sequence Similarity with Application to Handwritten Word Spotting

TL;DR: The proposed similarity outperforms the traditional DTW between the original sequences, and the model-based approach which uses ordinary continuous HMMs, and it is shown that this increase in accuracy can be traded against a significant reduction of the computational cost.
Journal ArticleDOI

Robust Rooftop Extraction From Visible Band Images Using Higher Order CRF

TL;DR: The proposed higher order CRF model outperforms the state-of-the-art methods both at pixel and object levels on rooftops with complex structures and sizes in challenging environments.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.