Margins of discrete Bayesian networks
Reads0
Chats0
TLDR
This paper provides a complete algebraic characterization of Bayesian network models with latent variables when the observed variables are discrete and no assumption is made about the state-space of the latent variables.Abstract:
Bayesian network models with latent variables are widely used in statistics and machine learning. In this paper we provide a complete algebraic characterization of Bayesian network models with latent variables when the observed variables are discrete and no assumption is made about the state-space of the latent variables. We show that it is algebraically equivalent to the so-called nested Markov model, meaning that the two are the same up to inequality constraints on the joint probabilities. In particular these two models have the same dimension. The nested Markov model is therefore the best possible description of the latent variable model that avoids consideration of inequalities, which are extremely complicated in general. A consequence of this is that the constraint finding algorithm of Tian and Pearl (UAI 2002, pp519-527) is complete for finding equality constraints.
Latent variable models suffer from difficulties of unidentifiable parameters and non-regular asymptotics; in contrast the nested Markov model is fully identifiable, represents a curved exponential family of known dimension, and can easily be fitted using an explicit parameterization.read more
Citations
More filters
Pattern Recognition and Machine Learning
TL;DR: Probability distributions of linear models for regression and classification are given in this article, along with a discussion of combining models and combining models in the context of machine learning and classification.
Journal ArticleDOI
Causality-based Feature Selection: Methods and Evaluations
TL;DR: This article develops the first open-source package, called CausalFS, which consists of most of the representative causality-based feature selection algorithms, and conducts extensive experiments to compare the representative algorithms with both synthetic and real-world datasets.
Posted ContentDOI
Foundations of Structural Causal Models with Cycles and Latent Variables
TL;DR: The foundations for a general theory of statistical causal modeling with SCMs are provided, allowing for the presence of both latent confounders and cycles, and a class of simple SCMs is introduced that extends the class of acyclic SCMs to the cyclic setting, while preserving many of the convenient properties.
Posted Content
Markov Properties for Graphical Models with Cycles and Latent Variables
Patrick Forré,Joris M. Mooij +1 more
TL;DR: This work defines and analyse several different Markov properties that relate the graphical structure of a HEDG with a probability distribution on a corresponding product space over the set of nodes, for example factorization properties, structural equations properties, ordered/local/global Markov Properties, and marginal versions of these.
Journal ArticleDOI
Causal compatibility inequalities admitting quantum violations in the triangle structure
TL;DR: In this article, the authors derived causal compatibility inequalities for the triangle structure which do admit quantum violation, and further conjectured that the correlations admitted by the classical triangle structure is equivalent to the set of correlations admitted for its quantum generalization whenever the three observable variables are binary.
References
More filters
Book
Pattern Recognition and Machine Learning
TL;DR: Probability Distributions, linear models for Regression, Linear Models for Classification, Neural Networks, Graphical Models, Mixture Models and EM, Sampling Methods, Continuous Latent Variables, Sequential Data are studied.
MonographDOI
Causality: models, reasoning, and inference
TL;DR: The art and science of cause and effect have been studied in the social sciences for a long time as mentioned in this paper, see, e.g., the theory of inferred causation, causal diagrams and the identification of causal effects.
Pattern Recognition and Machine Learning
TL;DR: Probability distributions of linear models for regression and classification are given in this article, along with a discussion of combining models and combining models in the context of machine learning and classification.
Journal ArticleDOI
Estimating causal effects of treatments in randomized and nonrandomized studies.
TL;DR: A discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation is presented in this paper, where the objective is to specify the benefits of randomization in estimating causal effects of treatments.
Book
Causation, prediction, and search
TL;DR: The authors axiomatize the connection between causal structure and probabilistic independence, explore several varieties of causal indistinguishability, formulate a theory of manipulation, and develop asymptotically reliable procedures for searching over equivalence classes of causal models.