scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

A two-stage mechanism for registration and classification of ECG using Gaussian mixture model

TL;DR: An automatic classifier for electrocardiogram (ECG) based cardiac abnormality detection using Gaussian mixture model (GMM) is presented here and it is verified that Chernoff bound and Bhattacharya bounds lead to minimum error for GMM based classifier.
Proceedings ArticleDOI

SECRET: a scalable linear regression tree algorithm

TL;DR: A novel regression tree construction algorithm (SECRET) that produces trees of high quality and scales to very large datasets that has accuracy comparable to other linear regression tree algorithms but takes orders of magnitude less computation time for large datasets.
Proceedings ArticleDOI

Behavior classification algorithms at intersections and validation using naturalistic data

TL;DR: In this paper, two machine learning approaches, Support Vector Machines (SVM) and Hidden Markov Models (HMM), are used to classify drivers as compliant or violating at road intersections.
Journal ArticleDOI

Depression diagnosis support system based on eeg signal entropies

TL;DR: The proposed decision support system can be used to diagnose, and monitor the treatment of patients suffering from depression, and perform better than the rest of classifiers in discriminating between normal and depression EEG signals.
Journal ArticleDOI

Data-Driven Stochastic Models and Policies for Energy Harvesting Sensor Communications

TL;DR: In this paper, a data-driven approach of finding optimal transmission policies for a solar-powered sensor node that attempts to maximize net bit rates by adapting its transmission parameters, power levels and modulation types, to the changes of channel fading and battery recharge is presented.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.