scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

A spatial downscaling of soil moisture from rainfall, temperature, and AMSR2 using a Gaussian-mixture nonstationary hidden Markov model

TL;DR: In this article, a Gaussian-mixture nonstationary hidden Markov model (GM-NHMM) is proposed to spatially disaggregate the AMSR2 SM data for multiple locations in the Yongdam dam watershed in South Korea.
Book ChapterDOI

Comparison Between Genetic Algorithms and the Baum-Welch Algorithm in Learning HMMs for Human Activity Classification

TL;DR: A Hidden Markov Model is used as an efficient and robust technique for human activities classification and the Gaussian parameters are optimized considering as a fitness function the results of the classification application.
Proceedings ArticleDOI

Mimesis from partial observations

TL;DR: A new mimesis scheme is proposed that enables for a humanoid to imitate human's motion even though the humanoid cannot see human's whole-body motion and the humanoid has not seen the exactly same motion so far.
Book ChapterDOI

Image Segmentation in the Presence of Shadows and Highlights

TL;DR: Qualitative results illustrate the ability of the segmentation method to obtain excellent results in the presence of shadow and highlight edges and show that it outperforms state-of-the-art segmentation methods at low computational cost.
Journal ArticleDOI

A Bayesian approach for pervasive estimation of breaststroke velocity using a wearable IMU

TL;DR: A probabilistic framework for the data-driven estimation of the swimming velocity at every cycle using a low-cost wearable inertial measurement unit (IMU) and a simple tool to analyze the influence of sacrum kinematics on the performance is provided.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.