scispace - formally typeset
Open AccessJournal Article

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.
Abstract
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.

read more

Content maybe subject to copyright    Report

Citations
More filters
Proceedings ArticleDOI

Analysis and Comparison of Interaction Patterns in Online Social Network and Social Media

TL;DR: Renren, the largest online social network in China, and Sina Weibo, the most popular microblog service in China are measured to demonstrate that although users in the two platforms share some common interaction patterns, users in Sina weibo are more popular and diverse.
Journal ArticleDOI

Learning object, grasping and manipulation activities using hierarchical HMMs

TL;DR: A probabilistic algorithm for representing and learning complex manipulation activities performed by humans in everyday life and the ability to represent behaviours at multiple levels of abstraction for enhanced task generalisation is presented.

Real-Time Feedback-Controlled Robotic Fish for Behavioral Experiments With Fish Schools Use of cyber-physical robotic fish to study fish-school behavior is proposed in this paper; each robotic fish gets video feedback from the fish group and its environment.

TL;DR: In this article, the authors introduce a new cyber-physical implementation that enables robotic fish to use real-time feedback to control their motion in response to live fish and other environmental features.
Proceedings ArticleDOI

Clustering wireless channel impulse responses in angular-delay domain

TL;DR: This work introduces a novel wireless MIMO channel clustering technique implemented in angular and delay domains and is 'factorized' algorithmically by first identifying clusters in the delay domain and then finding angular clusters 'conditioned' on the corresponding delay cluster.
Journal ArticleDOI

A Fully-Pipelined Hardware Design for Gaussian Mixture Models

TL;DR: The design provides a practical solution to applications for training and explores better parameters for GMMs with hundreds of millions of high dimensional input instances, for low-latency and high-performance applications.
References
More filters
Book

The Nature of Statistical Learning Theory

TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Book

Matrix computations

Gene H. Golub

Statistical learning theory

TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book

The Fractal Geometry of Nature

TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.