Showing papers in "arXiv: Probability in 2013"

On the rate of convergence in Wasserstein distance of the empirical measure

Abstract: Let $\mu_N$ be the empirical measure associated to a $N$-sample of a given probability distribution $\mu$ on $\mathbb{R}^d$. We are interested in the rate of convergence of $\mu_N$ to $\mu$, when measured in the Wasserstein distance of order $p>0$. We provide some satisfying non-asymptotic $L^p$-bounds and concentration inequalities, for any values of $p>0$ and $d\geq 1$. We extend also the non asymptotic $L^p$-bounds to stationary $\rho$-mixing sequences, Markov chains, and to some interacting particle systems.

A Proof Of The Block Model Threshold Conjecture

Abstract: We study a random graph model named the "block model" in statistics and the "planted partition model" in theoretical computer science. In its simplest form, this is a random graph with two equal-sized clusters, with a between-class edge probability of $q$ and a within-class edge probability of $p$. A striking conjecture of Decelle, Krzkala, Moore and Zdeborova based on deep, non-rigorous ideas from statistical physics, gave a precise prediction for the algorithmic threshold of clustering in the sparse planted partition model. In particular, if $p = a/n$ and $q = b/n$, $s=(a-b)/2$ and $p=(a+b)/2$ then Decelle et al.\ conjectured that it is possible to efficiently cluster in a way correlated with the true partition if $s^2 > p$ and impossible if $s^2 C p \ln p$ for some sufficiently large $C$. In a previous work, we proved that indeed it is information theoretically impossible to to cluster if $s^2 p$. A different independent proof of the same result was recently obtained by Laurent Massoulie.

Non-stationary Stochastic Optimization

Abstract: We consider a non-stationary variant of a sequential stochastic optimization problem, in which the underlying cost functions may change along the horizon. We propose a measure, termed variation budget, that controls the extent of said change, and study how restrictions on this budget impact achievable performance. We identify sharp conditions under which it is possible to achieve long-run-average optimality and more refined performance measures such as rate optimality that fully characterize the complexity of such problems. In doing so, we also establish a strong connection between two rather disparate strands of literature: adversarial online convex optimization; and the more traditional stochastic approximation paradigm (couched in a non-stationary setting). This connection is the key to deriving well performing policies in the latter, by leveraging structure of optimal policies in the former. Finally, tight bounds on the minimax regret allow us to quantify the "price of non-stationarity," which mathematically captures the added complexity embedded in a temporally changing environment versus a stationary one.

Introduction to Queueing Theory and Stochastic Teletraffic Models

Abstract: The aim of this textbook is to provide students with basic knowledge of stochastic models that may apply to telecommunications research areas, such as traffic modelling, resource provisioning and traffic management. These study areas are often collectively called teletraffic. This book assumes prior knowledge of a programming language, mathematics, probability and stochastic processes normally taught in an electrical engineering course. For students who have some but not sufficiently strong background in probability and stochastic processes, we provide, in the first few chapters, background on the relevant concepts in these areas.

A probabilistic weak formulation of mean field games and applications

Abstract: Mean field games are studied by means of the weak formulation of stochastic optimal control. This approach allows the mean field interactions to enter through both state and control processes and take a form which is general enough to include rank and nearest-neighbor effects. Moreover, the data may depend discontinuously on the state variable, and more generally its entire history. Existence and uniqueness results are proven, along with a procedure for identifying and constructing distributed strategies which provide approximate Nash equlibria for finite-player games. Our results are applied to a new class of multi-agent price impact models and a class of flocking models for which we prove existence of equilibria.

Imaginary geometry IV: interior rays, whole-plane reversibility, and space-filling trees

Abstract: We establish existence and uniqueness for Gaussian free field flow lines started at {\em interior} points of a planar domain We interpret these as rays of a random geometry with imaginary curvature and describe the way distinct rays intersect each other and the boundary Previous works in this series treat rays started at {\em boundary} points and use Gaussian free field machinery to determine which chordal \SLE_\kappa(\rho_1; \rho_2) processes are time-reversible when \kappa < 8 Here we extend these results to whole-plane \SLE_\kappa(\rho) and establish continuity and transience of these paths In particular, we extend ordinary whole-plane SLE reversibility (established by Zhan for \kappa \in [0,4]) to all \kappa \in [0,8] We also show that the rays of a given angle (with variable starting point) form a space-filling planar tree Each branch is a form of SLE_\kappa for some \kappa \in (0, 4), and the curve that traces the tree in the natural order (hitting x before y if the branch from x is left of the branch from y) is a space-filling form of \SLE_{\kappa'} where \kappa':= 16/\kappa \in (4, \infty) By varying the boundary data we obtain, for each \kappa'>4, a family of space-filling variants of \SLE_{\kappa'}(\rho) whose time reversals belong to the same family When \kappa' \geq 8, ordinary \SLE_{\kappa'} belongs to this family, and our result shows that its time-reversal is \SLE_{\kappa'}(\kappa'/2 - 4; \kappa'/2 - 4) As applications of this theory, we obtain the local finiteness of \CLE_{\kappa'}, for \kappa' \in (4,8), and describe the laws of the boundaries of \SLE_{\kappa'} processes stopped at stopping times

Reflection couplings and contraction rates for diffusions

Abstract: We consider contractivity for diffusion semigroups w.r.t. Kantorovich ($L^1$ Wasserstein) distances based on appropriately chosen concave functions. These distances are inbetween total variation and usual Wasserstein distances. It is shown that by appropriate explicit choices of the underlying distance, contractivity with rates of close to optimal order can be obtained in several fundamental classes of examples where contractivity w.r.t. standard Wasserstein distances fails. Applications include overdamped Langevin diffusions with locally non-convex potentials, products of these processes, and systems of weakly interacting diffusions, both of mean-field and nearest neighbour type.

Quantum Loewner Evolution

Abstract: What is the scaling limit of diffusion limited aggregation (DLA) in the plane? This is an old and famously difficult question. One can generalize the question in two ways: first, one may consider the {\em dielectric breakdown model} $\eta$-DBM, a generalization of DLA in which particle locations are sampled from the $\eta$-th power of harmonic measure, instead of harmonic measure itself. Second, instead of restricting attention to deterministic lattices, one may consider $\eta$-DBM on random graphs known or believed to converge in law to a Liouville quantum gravity (LQG) surface with parameter $\gamma \in [0,2]$. In this generality, we propose a scaling limit candidate called quantum Loewner evolution, QLE$(\gamma^2, \eta)$. QLE is defined in terms of the radial Loewner equation like radial SLE, except that it is driven by a measure valued diffusion $ u_t$ derived from LQG rather than a multiple of a standard Brownian motion. We formalize the dynamics of $ u_t$ using an SPDE. For each $\gamma \in (0,2]$, there are two or three special values of $\eta$ for which we establish the existence of a solution to these dynamics and explicitly describe the stationary law of $ u_t$. We also explain discrete versions of our construction that relate DLA to loop-erased random walk and the Eden model to percolation. A certain "reshuffling" trick (in which concentric annular regions are rotated randomly, like slot machine reels) facilitates explicit calculation. We propose QLE$(2,1)$ as a scaling limit for DLA on a random spanning-tree-decorated planar map, and QLE$(8/3,0)$ as a scaling limit for the Eden model on a random triangulation. We propose using QLE$(8/3,0)$ to endow pure LQG with a distance function, by interpreting the region explored by a branching variant of QLE$(8/3,0)$, up to a fixed time, as a metric ball in a random metric space.

Euler approximations with varying coefficients: the case of superlinearly growing diffusion coefficients

Abstract: A new class of explicit Euler schemes, which approximate stochastic differential equations (SDEs) with superlinearly growing drift and diffusion coefficients, is proposed in this article. It is shown, under very mild conditions, that these explicit schemes converge in probability and in $\mathcal{L}^p$ to the solution of the corresponding SDEs. Moreover, rate of convergence estimates are provided for $\mathcal{L}^p$ and almost sure convergence. In particular, the strong order $1/2$ is recovered in the case of uniform $\mathcal{L}^p$-convergence.

Exponential ergodicity for Markov processes with random switching

Abstract: We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second component is discrete and its jump rates may depend on the position of the whole process. Under regularity assumptions on the jump rates and Wasserstein contraction conditions for the underlying dynamics, we provide a concrete criterion for the convergence to equilibrium in terms of Wasserstein distance. The proof is based on a coupling argument and a weak form of the Harris theorem. In particular, we obtain exponential ergodicity in situations which do not verify any hypoellipticity assumption, but are not uniformly contracting either. We also obtain a bound in total variation distance under a suitable regularising assumption. Some examples are given to illustrate our result, including a class of piecewise deterministic Markov processes.

Optimal transportation under controlled stochastic dynamics

Abstract: We consider an extension of the Monge-Kantorovitch optimal transportation problem. The mass is transported along a continuous semimartingale, and the cost of transportation depends on the drift and the diffusion coefficients of the continuous semimartingale. The optimal transportation problem minimizes the cost among all continuous semimartingales with given initial and terminal distributions. Our first main result is an extension of the Kantorovitch duality to this context. We also suggest a finite-difference scheme combined with the gradient projection algorithm to approximate the dual value. We prove the convergence of the scheme, and we derive a rate of convergence. We finally provide an application in the context of financial mathematics, which originally motivated our extension of the Monge-Kantorovitch problem. Namely, we implement our scheme to approximate no-arbitrage bounds on the prices of exotic options given the implied volatility curve of some maturity.

The Eigenvector Moment Flow and local Quantum Unique Ergodicity

Abstract: We prove that the distribution of eigenvectors of generalized Wigner matrices is universal both in the bulk and at the edge. This includes a probabilistic version of local quantum unique ergodicity and asymptotic normality of the eigenvector entries. The proof relies on analyzing the eigenvector flow under the Dyson Brownian motion. The key new ideas are: (1) the introduction of the eigenvector moment flow, a multi-particle random walk in a random environment, (2) an effective estimate on the regularity of this flow based on maximum principle and (3) optimal finite speed of propagation holds for the eigenvector moment flow with very high probability.

The lower tail of random quadratic forms, with applications to ordinary least squares and restricted eigenvalue properties.

Abstract: Finite sample properties of random covariance-type matrices have been the subject of much research. In this paper we focus on the "lower tail" of such a matrix, and prove that it is subgaussian under a simple fourth moment assumption on the one-dimensional marginals of the random vectors. A similar result holds for more general sums of random positive semidefinite matrices, and the (relatively simple) proof uses a variant of the so-called PAC-Bayesian method for bounding empirical processes. We give two applications of the main result. In the first one we obtain a new finite-sample bound for ordinary least squares estimator in linear regression with random design. Our result is model-free, requires fairly weak moment assumptions and is almost optimal. Our second application is to bounding restricted eigenvalue constants of certain random ensembles with "heavy tails". These constants are important in the analysis of problems in Compressed Sensing and High Dimensional Statistics, where one recovers a sparse vector from a small umber of linear measurements. Our result implies that heavy tails still allow for the fast recovery rates found in efficient methods such as the LASSO and the Dantzig selector. Along the way we strengthen, with a fairly short argument, a recent result of Rudelson and Zhou on the restricted eigenvalue property.

Connectivity of soft random geometric graphs

Abstract: Consider a graph on $n$ uniform random points in the unit square, each pair being connected by an edge with probability $p$ if the inter-point distance is at most $r$. We show that as $n\to\infty$ the probability of full connectivity is governed by that of having no isolated vertices, itself governed by a Poisson approximation for the number of isolated vertices, uniformly over all choices of $p,r$. We determine the asymptotic probability of connectivity for all $(p_n,r_n)$ subject to $r_n=O(n^{-\varepsilon})$, some $\varepsilon >0$. We generalize the first result to higher dimensions and to a larger class of connection probability functions.

Extreme local extrema of two-dimensional discrete Gaussian free field

Abstract: We consider the discrete Gaussian Free Field in a square box in $\mathbb Z^2$ of side length $N$ with zero boundary conditions and study the joint law of its properly-centered extreme values ($h$) and their scaled spatial positions ($x$) in the limit as $N\to\infty$. Restricting attention to extreme local maxima, i.e., the extreme points that are maximal in an $r_N$-neighborhood thereof, we prove that the associated process tends, whenever $r_N\to\infty$ and $r_N/N\to0$, to a Poisson point process with intensity measure $Z(dx)e^{-\alpha h}dh$, where $\alpha:= 2/\sqrt{g}$ with $g:=2/\pi$ and where $Z(dx)$ is a random Borel measure on $[0,1]^2$. In particular, this yields an integral representation of the law of the absolute maximum, similar to that found in the context of Branching Brownian Motion. We give evidence that the random measure $Z$ is a version of the derivative martingale associated with the continuum Gaussian Free Field.

Degree and clustering coefficient in sparse random intersection graphs

Abstract: We establish asymptotic vertex degree distribution and examine its relation to the clustering coefficient in two popular random intersection graph models of Godehardt and Jaworski [Electron. Notes Discrete Math. 10 (2001) 129-132]. For sparse graphs with a positive clustering coefficient, we examine statistical dependence between the (local) clustering coefficient and the degree. Our results are mathematically rigorous. They are consistent with the empirical observation of Foudalis et al. [In Algorithms and Models for Web Graph (2011) Springer] that, "clustering correlates negatively with degree." Moreover, they explain empirical results on $k^{-1}$ scaling of the local clustering coefficient of a vertex of degree k reported in Ravasz and Barabasi [Phys. Rev. E 67 (2003) 026112].

Robust Sensitivity Analysis for Stochastic Systems

Abstract: We study a worst-case approach to measure the sensitivity to model misspecification in the performance analysis of stochastic systems. The situation of interest is when only minimal parametric information is available on the form of the true model. Under this setting, we post optimization programs that compute the worst-case performance measures, subject to constraints on the amount of model misspecification measured by Kullback-Leibler (KL) divergence. Our main contribution is the development of infinitesimal approximations for these programs, resulting in asymptotic expansions of their optimal values in terms of the divergence. The coefficients of these expansions can be computed via simulation, and are mathematically derived from the representation of the worst-case models as changes of measure that satisfy a well-defined class of functional fixed point equations.

On Distribution of Zeros of Random Polynomials in Complex Plane

Abstract: Let \(G_{n}(z) = \xi _{0} + \xi _{1}z + \cdots + \xi _{n}{z}^{n}\) be a random polynomial with i.i.d. coefficients (real or complex). We show that the arguments of the roots of G n (z) are uniformly distributed in [0, 2π] asymptotically as \(n\,\rightarrow \,\infty \). We also prove that the condition \(\mathbf{E}\,\ln (1 + \vert \xi _{0}\vert )\,<\,\infty \) is necessary and sufficient for the roots to asymptotically concentrate near the unit circumference.

General beta Jacobi corners process and the Gaussian Free Field

Abstract: We prove that the two-dimensional Gaussian Free Field describes the asymptotics of global fluctuations of a multilevel extension of the general beta Jacobi random matrix ensembles. Our approach is based on the connection of the Jacobi ensembles to a degeneration of the Macdonald processes that parallels the degeneration of the Macdonald polynomials to to the Heckman-Opdam hypergeometric functions (of type A). We also discuss the beta goes to infinity limit.

Well-Posedness And Accuracy Of The Ensemble Kalman Filter In Discrete And Continuous Time

Abstract: The ensemble Kalman filter (EnKF) is a method for combining a dynamical model with data in a sequential fashion Despite its widespread use, there has been little analysis of its theoretical properties Many of the algorithmic innovations associated with the filter, which are required to make a useable algorithm in practice, are derived in an ad hoc fashion The aim of this paper is to initiate the development of a systematic analysis of the EnKF, in particular to do so in the small ensemble size limit The perspective is to view the method as a state estimator, and not as an algorithm which approximates the true filtering distribution The perturbed observation version of the algorithm is studied, without and with variance inflation Without variance inflation well-posedness of the filter is established; with variance inflation accuracy of the filter, with resepct to the true signal underlying the data, is established The algorithm is considered in discrete time, and also for a continuous time limit arising when observations are frequent and subject to large noise The underlying dynamical model, and assumptions about it, is sufficiently general to include the Lorenz '63 and '96 models, together with the incompressible Navier-Stokes equation on a two-dimensional torus The analysis is limited to the case of complete observation of the signal with additive white noise Numerical results are presented for the Navier-Stokes equation on a two-dimensional torus for both complete and partial observations of the signal with additive white noise

Liouville Brownian motion

Abstract: We construct a stochastic process, called the Liouville Brownian motion, which is the Brownian motion associated to the metric $e^{\gamma X(z)}\,dz^2$, $\gamma<\gamma_c=2$ and $X$ is a Gaussian Free Field. Such a process is conjectured to be related to the scaling limit of random walks on large planar maps eventually weighted by a model of statistical physics which are embedded in the Euclidean plane or in the sphere in a conformal manner. The construction amounts to changing the speed of a standard two-dimensional Brownian motion $B_t$ depending on the local behavior of the Liouville measure "$M_{\gamma}(dz)=e^{\gamma X(z)}\,dz$". We prove that the associated Markov process is a Feller diffusion for all $\gamma<\gamma_c=2$ and that for all $\gamma<\gamma_c$, the Liouville measure $M_{\gamma}$ is invariant under $P_{\mathbf{t}}$. This Liouville Brownian motion enables us to introduce a whole set of tools of stochastic analysis in Liouville quantum gravity, which will be hopefully useful in analyzing the geometry of Liouville quantum gravity.

The maximum on a random time interval of a random walk with long-tailed increments and negative drift

Abstract: We study the asymptotics for the maximum on a random time interval of a random walk with a long-tailed distribution of its increments and negative drift. We extend to a general stopping time a result by Asmussen (1998), simplify its proof, and give some converses.

Isotropic Gaussian random fields on the sphere: regularity, fast simulation, and stochastic partial differential equations

Abstract: Isotropic Gaussian random fields on the sphere are characterized by Karhunen-Lo\`{e}ve expansions with respect to the spherical harmonic functions and the angular power spectrum The smoothness of the covariance is connected to the decay of the angular power spectrum and the relation to sample H\"{o}lder continuity and sample differentiability of the random fields is discussed Rates of convergence of their finitely truncated Karhunen-Lo\`{e}ve expansions in terms of the covariance spectrum are established, and algorithmic aspects of fast sample generation via fast Fourier transforms on the sphere are indicated The relevance of the results on sample regularity for isotropic Gaussian random fields and the corresponding lognormal random fields on the sphere for several models from environmental sciences is indicated Finally, the stochastic heat equation on the sphere driven by additive, isotropic Wiener noise is considered, and strong convergence rates for spectral discretizations based on the spherical harmonic functions are proven

Hypergeometric tail inequalities: ending the insanity

Abstract: The hypergeometric distribution is briefly and informally surveyed, including popular notation, symmetries, and the tail inequalities $Pr[i \ge E[i]+tn] \le e^{-2t^2n}$ and $Pr[i \le E[i]-tn] \le e^{-2t^2n}$.

First order global asymptotics for confined particles with singular pair repulsion

Abstract: We study a physical system of $N$ interacting particles in $\mathbb{R}^d$, $d\geq1$, subject to pair repulsion and confined by an external field. We establish a large deviations principle for their empirical distribution as $N$ tends to infinity. In the case of Riesz interaction, including Coulomb interaction in arbitrary dimension $d>2$, the rate function is strictly convex and admits a unique minimum, the equilibrium measure, characterized via its potential. It follows that almost surely, the empirical distribution of the particles tends to this equilibrium measure as $N$ tends to infinity. In the more specific case of Coulomb interaction in dimension $d>2$, and when the external field is a convex or increasing function of the radius, then the equilibrium measure is supported in a ring. With a quadratic external field, the equilibrium measure is uniform on a ball.

Local Lipschitz continuity in the initial value and strong completeness for nonlinear stochastic differential equations

Abstract: Recently, Hairer et. al [14] showed that there exist SDEs with infinitely often differentiable and globally bounded coefficient functions whose solutions fail to be locally Lipschitz continuous in the strong L p -sense with respect to the initial value for every p ∈ [1,∞]. In this article we provide sufficient conditions on the coefficien t functions of the SDE and on p ∈ (0,∞] which ensure local Lipschitz continuity in the strong L p -sense with respect to the initial value and we establish explicit estimates for the local Lipschitz continuity constants. In particular, we prove local Lipschitz continuity in the initial value for several nonlinear SDEs from the literature such as the stochastic van der Pol oscillator, Brownian dynamics, the Cox-Ingersoll-Ross processes and the Cahn-Hilliard-Cook equation. As an application of our estimates, we obtain strong completeness for several nonlinear SDEs.

Nonlinear Hawkes Processes

Abstract: The Hawkes process is a simple point process that has long memory, clustering effect, self-exciting property and is in general non-Markovian. The future evolution of a self-exciting point process is influenced by the timing of the past events. There are applications in finance, neuroscience, genome analysis, seismology, sociology, criminology and many other fields. We first survey the known results about the theory and applications of both linear and nonlinear Hawkes processes. Then, we obtain the central limit theorem and process-level, i.e. level-3 large deviations for nonlinear Hawkes processes. The level-1 large deviation principle holds as a result of the contraction principle. We also provide an alternative variational formula for the rate function of the level-1 large deviations in the Markovian case. Next, we drop the usual assumptions on the nonlinear Hawkes process and categorize it into different regimes, i.e. sublinear, sub-critical, critical, super-critical and explosive regimes. We show the different time asymptotics in different regimes and obtain other properties as well. Finally, we study the limit theorems of linear Hawkes processes with random marks.

Polynomial chaos and scaling limits of disordered systems

Abstract: Inspired by recent work of Alberts, Khanin and Quastel, we formulate general conditions ensuring that a sequence of multi-linear polynomials of independent random variables (called polynomial chaos expansions) converges to a limiting random variable, given by a Wiener chaos expansion over the d-dimensional white noise. A key ingredient in our approach is a Lindeberg principle for polynomial chaos expansions, which extends earlier work of Mossel, O'Donnell and Oleszkiewicz. These results provide a unified framework to study the continuum and weak disorder scaling limits of statistical mechanics systems that are disorder relevant, including the disordered pinning model, the (long-range) directed polymer model in dimension 1+1, and the two-dimensional random field Ising model. This gives a new perspective in the study of disorder relevance, and leads to interesting new continuum models that warrant further studies.

Annealed estimates on the Green function

Abstract: We consider a random, uniformly elliptic coefficient field $a(x)$ on the $d$-dimensional integer lattice $\mathbb{Z}^d$. We are interested in the spatial decay of the quenched elliptic Green function $G(a;x,y)$. Next to stationarity, we assume that the spatial correlation of the coefficient field decays sufficiently fast to the effect that a logarithmic Sobolev inequality holds for the ensemble $\langle\cdot\rangle$. We prove that all stochastic moments of the first and second mixed derivatives of the Green function, that is, $\langle| abla_x G(x,y)|^p\rangle$ and $\langle| abla_x abla_y G(x,y)|^p\rangle$, have the same decay rates in $|x-y|\gg 1$ as for the constant coefficient Green function, respectively. This result relies on and substantially extends the one by Delmotte and Deuschel \cite{DeuschelDelmotte}, which optimally controls second moments for the first derivatives and first moments of the second mixed derivatives of $G$, that is, $\langle| abla_x G(x,y)|^2\rangle$ and $\langle| abla_x abla_y G(x,y)|\rangle$. As an application, we are able to obtain optimal estimates on the random part of the homogenization error even for large ellipticity contrast.

Concentration inequalities for non-Lipschitz functions with bounded derivatives of higher order

Abstract: Building on the inequalities for homogeneous tetrahedral polynomials in independent Gaussian variables due to R. Latala we provide a concentration inequality for non-necessarily Lipschitz functions $f\colon \R^n \to \R$ with bounded derivatives of higher orders, which hold when the underlying measure satisfies a family of Sobolev type inequalities $\|g- \E g\|_p \le C(p)\| abla g\|_p.$ Such Sobolev type inequalities hold, e.g., if the underlying measure satisfies the log-Sobolev inequality (in which case $C(p) \le C\sqrt{p}$) or the Poincare inequality (then $C(p) \le Cp$). Our concentration estimates are expressed in terms of tensor-product norms of the derivatives of $f$. When the underlying measure is Gaussian and $f$ is a polynomial (non-necessarily tetrahedral or homogeneous), our estimates can be reversed (up to a constant depending only on the degree of the polynomial). We also show that for polynomial functions, analogous estimates hold for arbitrary random vectors with independent sub-Gaussian coordinates. We apply our inequalities to general additive functionals of random vectors (in particular linear eigenvalue statistics of random matrices) and the problem of counting cycles of fixed length in Erdős-R{e}nyi random graphs, obtaining new estimates, optimal in a certain range of parameters.