A comparative review of dimension reduction methods in approximate Bayesian computation
Reads0
Chats0
TLDR
This article provides a comprehensive review and comparison of the performance of the principal methods of dimension reduction proposed in the ABC literature, split into three nonmutually exclusive classes consisting of best subset selection methods, projection techniques and regularization.Abstract:
Approximate Bayesian computation (ABC) methods make use of comparisons between simulated and observed summary statistics to overcome the problem of computationally intractable likelihood functions. As the practical implementation of ABC requires computations based on vectors of summary statistics, rather than full data sets, a central question is how to derive low-dimensional summary statistics from the observed data with minimal loss of information. In this article we provide a comprehensive review and comparison of the performance of the principal methods of dimension reduction proposed in the ABC literature. The methods are split into three nonmutually exclusive classes consisting of best subset selection methods, projection techniques and regularization. In addition, we introduce two new methods of dimension reduction. The first is a best subset selection method based on Akaike and Bayesian information criteria, and the second uses ridge regression as a regularization procedure. We illustrate the performance of these dimension reduction techniques through the analysis of three challenging models and data sets.read more
Citations
More filters
Journal ArticleDOI
ABC inference of multi‐population divergence with admixture from unphased population genomic data
John D. Robinson,Lynsey Bunnefeld,Jack Hearn,Graham N. Stone,Michael J. Hickerson,Michael J. Hickerson,Michael J. Hickerson +6 more
TL;DR: The promise of ABC is demonstrated for analysis of the large data sets that are now attainable from nonmodel taxa through current genomic sequencing technologies, and inferences improved substantially with increases in the number and/or length of sequenced loci.
Journal ArticleDOI
Identification of Bouc-Wen type models using the Transitional Markov Chain Monte Carlo method
TL;DR: The TMCMC method is a Bayesian model updating technique which not only finds the most plausible model parameters but also estimates the probability distribution of those parameters given the data measured at the laboratory.
Journal ArticleDOI
Approximate Bayesian Computation and Bayes’ Linear Analysis: Toward High-Dimensional ABC
TL;DR: This article demonstrates that regression-adjustment ABC algorithms produce samples for which first- and second-order moment summaries approximate adjusted expectation and variance for a Bayes’ linear analysis, and proposes a new method for combining high-dimensional, regression- adjustment ABC with lower-dimensional approaches (such as using Markov chain Monte Carlo for ABC).
Journal ArticleDOI
Approximate Bayesian Computation for Forward Modeling in Cosmology
TL;DR: Approximate Bayesian Computation (ABC) is found to provide reliable parameter constraints for this problem and is therefore a promising technique for other applications in cosmology and astrophysics.
Journal ArticleDOI
Generalized likelihood uncertainty estimation (GLUE) and approximate Bayesian computation: What's the connection?
Abstract: [1] There has been a recent debate in the hydrological community about the relative merits of the informal generalized likelihood uncertainty estimation (GLUE) approach to uncertainty assessment in hydrological modeling versus formal probabilistic approaches Some recent literature has suggested that the methods can give similar results in practice when properly applied In this note, we show that the connection between formal Bayes and GLUE is not merely operational but goes deeper, with GLUE corresponding to a certain approximate Bayesian procedure even when the “generalized likelihood” is not a true likelihood The connection we describe relates to recent approximate Bayesian computation (ABC) methods originating in genetics ABC algorithms involve the use of a kernel function, and the generalized likelihood in GLUE can be thought of as relating to this kernel function rather than to the model likelihood Two interpretations of GLUE emerge, one as a computational approximation to a Bayes procedure for a certain “error-free” model and the second as an exact Bayes procedure for a perturbation of that model in which the truncation of the generalized likelihood in GLUE plays a role The intent of this study is to encourage cross-fertilization of ideas regarding GLUE and ABC in hydrologic applications The connection we outline suggests the possibility of combining a formal likelihood with a kernel based on a generalized likelihood within the ABC framework and also allows advanced ABC computational methods to be used in GLUE applications The model-based interpretation of GLUE may also be helpful in partially illuminating the implicit assumptions in different choices of generalized likelihood
References
More filters
Journal ArticleDOI
A mathematical theory of communication
TL;DR: This final installment of the paper considers the case where the signals or the messages or both are continuously variable, in contrast with the discrete nature assumed until now.
Journal ArticleDOI
A new look at the statistical model identification
TL;DR: In this article, a new estimate minimum information theoretical criterion estimate (MAICE) is introduced for the purpose of statistical identification, which is free from the ambiguities inherent in the application of conventional hypothesis testing procedure.
Journal ArticleDOI
Estimating the Dimension of a Model
TL;DR: In this paper, the problem of selecting one of a number of models of different dimensions is treated by finding its Bayes solution, and evaluating the leading terms of its asymptotic expansion.
Estimating the dimension of a model
TL;DR: In this paper, the problem of selecting one of a number of models of different dimensions is treated by finding its Bayes solution, and evaluating the leading terms of its asymptotic expansion.
Journal ArticleDOI
Ridge regression: biased estimation for nonorthogonal problems
TL;DR: In this paper, an estimation procedure based on adding small positive quantities to the diagonal of X′X was proposed, which is a method for showing in two dimensions the effects of nonorthogonality.