scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Improving the Consistency of Multitemporal Land Cover Maps Using a Hidden Markov Model

TL;DR: A novel framework that uses a hidden Markov model (HMM) to help distinguish real land cover change from spurious land cover changes in classification time series is presented and provides label sequences that are more accurate and that exhibit less year-to-year variability.
Journal ArticleDOI

A review of statistical methods for protein identification using tandem mass spectrometry.

TL;DR: The similarities between these methods are discussed and directions for the field are suggested that would help unify these similar assumptions in a more rigorous manner and help enable efficient and reliable protein inference.
Journal ArticleDOI

Exploring DCT Coefficient Quantization Effects for Local Tampering Detection

TL;DR: This paper proposes the specialized approach, which employs the quantization noise of high-frequency DCT coefficient, to improve the tampering localization performance and designs three kinds of features that can distinguish truly tampered regions from the false ones to reduce false alarm.
Patent

System and method for segmenting the left ventricle in a cardiac mr image

TL;DR: In this article, a method for segmenting a magnetic resonance image of interest of a left ventricle was proposed, based on a histogram of pixel intensity in the image.
Dissertation

Prediction of financial time series with hidden markov models

TL;DR: An extension of the Hidden Markov Model is developed that addresses two of the most important challenges of financial time series modeling: non-stationary and non-linearity and includes a novel exponentially weighted Expectation-Maximization (EM) algorithm to handle these two challenges.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.