Open AccessJournal Article
A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models
Reads0
Chats0
TLDR
In this paper, the authors describe the EM algorithm for finding the parameters of a mixture of Gaussian densities and a hidden Markov model (HMM) for both discrete and Gaussian mixture observation models.Abstract:
We describe the maximum-likelihood parameter estimation problem and how the ExpectationMaximization (EM) algorithm can be used for its solution. We first describe the abstract form of the EM algorithm as it is often given in the literature. We then develop the EM parameter estimation procedure for two applications: 1) finding the parameters of a mixture of Gaussian densities, and 2) finding the parameters of a hidden Markov model (HMM) (i.e., the Baum-Welch algorithm) for both discrete and Gaussian mixture observation models. We derive the update equations in fairly explicit detail but we do not prove any convergence properties. We try to emphasize intuition rather than mathematical rigor.read more
Citations
More filters
Proceedings ArticleDOI
Statistical change detection for multi-dimensional data
TL;DR: This paper defines a statistical test for deciding if the observed data points are sampled from the underlying distribution that produced the baseline data set and defines a test statistic that is strictly distribution-free under the null hypothesis.
Journal ArticleDOI
General C-means clustering model
TL;DR: According to a novel definition of the mean, a unifying generative framework for partitional clustering algorithms, called a general c-means clustering model (GCM), is presented and studied, and the connection between Occam's razor and partitionally clustering is established for the first time.
Journal ArticleDOI
A risk haplotype in the Solute Carrier Family 22A4/22A5 gene cluster influences phenotypic expression of Crohn's disease.
Bill Newman,Bill Newman,Bill Newman,Xiangjun Gu,Richard F. Wintle,David W. Cescon,David W. Cescon,Mehrdad Yazdanpanah,Mehrdad Yazdanpanah,Xiangdong Liu,Xiangdong Liu,Vanya Peltekova,Vanya Peltekova,Mark Van Oene,Christopher I. Amos,Katherine A. Siminovitch,Katherine A. Siminovitch +16 more
TL;DR: The association of the SLC22A -TC haplotype and CARD15 alleles with ileal disease suggests that these variants have biologically intertwined effects in the pathogenesis of CD.
Journal ArticleDOI
Application of Higher Order Spectra to Identify Epileptic EEG
TL;DR: A comparative study of the performance of Gaussian mixture model (GMM) and Support Vector Machine (SVM) classifiers using the features derived from HOS and from the power spectrum, showing that the selected HOS based features achieve 93.11% classification accuracy.
Book
Network Anomaly Detection: A Machine Learning Perspective
TL;DR: Examining numerous attacks in detail, the authors look at the tools that intruders use and show how to use this knowledge to protect networks.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Book
The Nature of Statistical Learning Theory
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Statistical learning theory
TL;DR: Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Book
The Fractal Geometry of Nature
TL;DR: This book is a blend of erudition, popularization, and exposition, and the illustrations include many superb examples of computer graphics that are works of art in their own right.