scispace - formally typeset
Search or ask a question
Posted Content

Large Sample Asymptotics of the Pseudo-Marginal Method

TL;DR: In this paper, it was shown that, as the number of data points tends to infinity, a space-rescaled version of the pseudo-marginal chain converges weakly towards another pseudo-margin chain for which this assumption indeed holds.
Abstract: The pseudo-marginal algorithm is a variant of the Metropolis--Hastings algorithm which samples asymptotically from a probability distribution when it is only possible to estimate unbiasedly an unnormalized version of its density. Practically, one has to trade-off the computational resources used to obtain this estimator against the asymptotic variances of the ergodic averages obtained by the pseudo-marginal algorithm. Recent works optimizing this trade-off rely on some strong assumptions which can cast doubts over their practical relevance. In particular, they all assume that the distribution of the difference between the log-density and its estimate is independent of the parameter value at which it is evaluated. Under regularity conditions we show here that, as the number of data points tends to infinity, a space-rescaled version of the pseudo-marginal chain converges weakly towards another pseudo-marginal chain for which this assumption indeed holds. A study of this limiting chain allows us to provide parameter dimension-dependent guidelines on how to optimally scale a normal random walk proposal and the number of Monte Carlo samples for the pseudo-marginal method in the large-sample regime. This complements and validates currently available results.
Citations
More filters
Book ChapterDOI
01 Jan 2011
TL;DR: Weakconvergence methods in metric spaces were studied in this article, with applications sufficient to show their power and utility, and the results of the first three chapters are used in Chapter 4 to derive a variety of limit theorems for dependent sequences of random variables.
Abstract: The author's preface gives an outline: "This book is about weakconvergence methods in metric spaces, with applications sufficient to show their power and utility. The Introduction motivates the definitions and indicates how the theory will yield solutions to problems arising outside it. Chapter 1 sets out the basic general theorems, which are then specialized in Chapter 2 to the space C[0, l ] of continuous functions on the unit interval and in Chapter 3 to the space D [0, 1 ] of functions with discontinuities of the first kind. The results of the first three chapters are used in Chapter 4 to derive a variety of limit theorems for dependent sequences of random variables. " The book develops and expands on Donsker's 1951 and 1952 papers on the invariance principle and empirical distributions. The basic random variables remain real-valued although, of course, measures on C[0, l ] and D[0, l ] are vitally used. Within this framework, there are various possibilities for a different and apparently better treatment of the material. More of the general theory of weak convergence of probabilities on separable metric spaces would be useful. Metrizability of the convergence is not brought up until late in the Appendix. The close relation of the Prokhorov metric and a metric for convergence in probability is (hence) not mentioned (see V. Strassen, Ann. Math. Statist. 36 (1965), 423-439; the reviewer, ibid. 39 (1968), 1563-1572). This relation would illuminate and organize such results as Theorems 4.1, 4.2 and 4.4 which give isolated, ad hoc connections between weak convergence of measures and nearness in probability. In the middle of p. 16, it should be noted that C*(S) consists of signed measures which need only be finitely additive if 5 is not compact. On p. 239, where the author twice speaks of separable subsets having nonmeasurable cardinal, he means "discrete" rather than "separable." Theorem 1.4 is Ulam's theorem that a Borel probability on a complete separable metric space is tight. Theorem 1 of Appendix 3 weakens completeness to topological completeness. After mentioning that probabilities on the rationals are tight, the author says it is an

3,554 citations

References
More filters
Journal ArticleDOI
TL;DR: In this article, a simulation algorithm for the stochastic formulation of chemical kinetics is proposed, which uses a rigorously derived Monte Carlo procedure to numerically simulate the time evolution of a given chemical system.
Abstract: There are two formalisms for mathematically describing the time behavior of a spatially homogeneous chemical system: The deterministic approach regards the time evolution as a continuous, wholly predictable process which is governed by a set of coupled, ordinary differential equations (the “reaction-rate equations”); the stochastic approach regards the time evolution as a kind of random-walk process which is governed by a single differential-difference equation (the “master equation”). Fairly simple kinetic theory arguments show that the stochastic formulation of chemical kinetics has a firmer physical basis than the deterministic formulation, but unfortunately the stochastic master equation is often mathematically intractable. There is, however, a way to make exact numerical calculations within the framework of the stochastic formulation without having to deal with the master equation directly. It is a relatively simple digital computer algorithm which uses a rigorously derived Monte Carlo procedure to numerically simulate the time evolution of the given chemical system. Like the master equation, this “stochastic simulation algorithm” correctly accounts for the inherent fluctuations and correlations that are necessarily ignored in the deterministic formulation. In addition, unlike most procedures for numerically solving the deterministic reaction-rate equations, this algorithm never approximates infinitesimal time increments df by finite time steps At. The feasibility and utility of the simulation algorithm are demonstrated by applying it to several well-known model chemical systems, including the Lotka model, the Brusselator, and the Oregonator.

10,275 citations

Book
01 Jan 1997
TL;DR: In this article, the authors discuss the relationship between Markov Processes and Ergodic properties of Markov processes and their relation with PDEs and potential theory. But their main focus is on the convergence of random processes, measures, and sets.
Abstract: * Measure Theory-Basic Notions * Measure Theory-Key Results * Processes, Distributions, and Independence * Random Sequences, Series, and Averages * Characteristic Functions and Classical Limit Theorems * Conditioning and Disintegration * Martingales and Optional Times * Markov Processes and Discrete-Time Chains * Random Walks and Renewal Theory * Stationary Processes and Ergodic Theory * Special Notions of Symmetry and Invariance * Poisson and Pure Jump-Type Markov Processes * Gaussian Processes and Brownian Motion * Skorohod Embedding and Invariance Principles * Independent Increments and Infinite Divisibility * Convergence of Random Processes, Measures, and Sets * Stochastic Integrals and Quadratic Variation * Continuous Martingales and Brownian Motion * Feller Processes and Semigroups * Ergodic Properties of Markov Processes * Stochastic Differential Equations and Martingale Problems * Local Time, Excursions, and Additive Functionals * One-Dimensional SDEs and Diffusions * Connections with PDEs and Potential Theory * Predictability, Compensation, and Excessive Functions * Semimartingales and General Stochastic Integration * Large Deviations * Appendix 1: Advanced Measure Theory * Appendix 2: Some Special Spaces * Historical and Bibliographical Notes * Bibliography * Indices

4,562 citations

Book
12 Aug 2008
TL;DR: Convergence Theorems are applied to the interpretation of Brownian Motion and the law of the Iterated Logarithm as well as to Martingales and Exchangeability.
Abstract: Basic Measure Theory.- Independence.- Generating Functions.- The Integral.- Moments and Laws of Large Numbers.- Convergence Theorems.- Lp-Spaces and Radon-Nikodym Theorem.- Conditional Expectations.- Martingales.- Optional Sampling Theorems.- Martingale Convergence Theorems and their Applications.- Backwards Martingales and Exchangeability.- Convergence of Measures.- Probability Measures on Product Spaces.- Characteristics Functions and Central Limit Theorem.- Infinitely Divisible Distributions.- Markov Chains.- Convergence of Markov Chains.- Markov Chains and Electrical Networks.- Ergodic Theory.- Brownian Motion.- Law of the Iterated Logarithm.- Large Deviations.- The Poisson Point Process.- The Ito Integral.- Stochastic Differential Equations.- References.- Notation Index.- Name Index.- Subject Index.

736 citations