scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Exploring the forecasting approach for road accidents: Analytical measures with hybrid machine learning

TL;DR: A novel framework is proposed that combines the descriptive strength of the Gaussian Mixture Model with the high-performance classification capabilities of the Support Vector Classifier and shows that the approach compares very favorably with baseline statistical methods.
Patent

Learning weights of fonts for typed samples in handwritten keyword spotting

TL;DR: In this article, the authors proposed a method to synthesize a word image based on a keyword and a set of typographical fonts, with the weights indicating the relative relevance of each font for modeling a subset of handwritten word images.
Journal ArticleDOI

Modelling and analysing the dynamics of disease progression from cross-sectional studies

TL;DR: The aim of this paper is to explore an extension of the temporal bootstrap to identify intermediate stages in a disease process and sub-categories of the disease exhibiting subtly different symptoms using biomedical data from three diseases: Glaucoma, Breast Cancer and Parkinson's disease.
Proceedings ArticleDOI

Vegetation detection for outdoor automobile guidance

TL;DR: A 2D-3D combination approach which can utilize the complement of three-dimensional point distribution and color descriptor and show the out-performance of this approach in comparison with more conventional approaches is proposed.
Proceedings ArticleDOI

Segmental Hidden Markov Models for View-based Sport Video Analysis

TL;DR: A generative model approach to explore intrinsic semantic structures in sport videos, e.g., the camera view in American football games, will invoke the concept of semantic space to explicitly define the semantic structure in the video in terms of latent states.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.