scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

A new data-driven transferable remaining useful life prediction approach for bearing under different working conditions

TL;DR: Wang et al. as discussed by the authors proposed a transfer learning method based on multiple layer perceptron (MLP) to solve distribution discrepancy problem, which can detect FOT adaptively, at the same time provide reliable transferable prognostics performance under different working conditions.
Patent

Prediction and monitoring of clinical episodes

TL;DR: In this article, a method for treating a clinical episode is described, which comprises sensing at least one parameter of a subject without contacting or viewing the subject or clothes the subject is wearing, analyzing the parameter, detecting the clinical episode at least in part responsively to the analysis, and treating the clinical episodes using a device implanted in the subject.
Proceedings Article

Topic models over text streams: A study of batch arid online unsupervised learning

TL;DR: This paper analyzes three batch topic models that have been recently proposed in the machine learning and data mining community – Latent Dirichlet Allocation (LDA),Dirichlet Compound Multinomial (DCM) mixtures and von-Mises Fisher (vMF) mixture models and proposes a practical heuristic for hybrid topic modeling.
Patent

Method, Apparatus and System for Food Intake and Physical Activity Assessment

TL;DR: In this paper, a device is provided to be placed on a subject which records video as well as other physiological and/or environmental data, along with other data obtained by the device to determine food consumption and physical activity of the subject.
Book

Social Sensing: Building Reliable Systems on Unreliable Data

TL;DR: Social Sensing: Building Reliable Systems on Unreliable Data looks at recent advances in the emerging field of social sensing, emphasizing the key problem faced by application designers: how to extract reliable information from data collected from largely unknown and possibly unreliable sources.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.