Showing papers in "arXiv: Probability in 2004"

Phase transition of the largest eigenvalue for non-null complex sample covariance matrices

Abstract: We compute the limiting distributions of the largest eigenvalue of a complex Gaussian sample covariance matrix when both the number of samples and the number of variables in each sample become large. When all but finitely many, say $r$, eigenvalues of the covariance matrix are the same, the dependence of the limiting distribution of the largest eigenvalue of the sample covariance matrix on those distinguished $r$ eigenvalues of the covariance matrix is completely characterized in terms of an infinite sequence of new distribution functions that generalize the Tracy-Widom distributions of the random matrix theory. Especially a phase transition phenomena is observed. Our results also apply to a last passage percolation model and a queuing model.

A Dynamic Model of Social Network Formation

Abstract: We consider a dynamic social network model in which agents play repeated games in pairings determined by a stochastically evolving social network. Individual agents begin to interact at random, with the interactions modeled as games. The game payoffs determine which interactions are reinforced, and the network structure emerges as a consequence of the dynamics of the agents' learning behavior. We study this in a variety of game-theoretic conditions and show that the behavior is complex and sometimes dissimilar to behavior in the absence of structural dynamics. We argue that modeling network structure as dynamic increases realism without rendering the problem of analysis intractable.

Empirical margin distributions and bounding the generalization error of combined classifiers

Abstract: We prove new probabilistic upper bounds on generalization error of complex classifiers that are combinations of simple classifiers. Such combinations could be implemented by neural networks or by voting methods of combining the classifiers, such as boosting and bagging. The bounds are in terms of the empirical distribution of the margin of the combined classifier. They are based on the methods of the theory of Gaussian and empirical processes (comparison inequalities, symmetrization method, concentration inequalities) and they improve previous results of Bartlett (1998) on bounding the generalization error of neural networks in terms of l_1-norms of the weights of neurons and of Schapire, Freund, Bartlett and Lee (1998) on bounding the generalization error of boosting. We also obtain rates of convergence in Levy distance of empirical margin distribution to the true margin distribution uniformly over the classes of classifiers and prove the optimality of these rates.

Ergodicity of the 2D Navier-Stokes Equations with Degenerate Stochastic Forcing

Abstract: The stochastic 2D Navier-Stokes equations on the torus driven by degenerate noise are studied. We characterize the smallest closed invariant subspace for this model and show that the dynamics restricted to that subspace is ergodic. In particular, our results yield a purely geometric characterization of a class of noises for which the equation is ergodic in $Ł^2_0(\TT^2)$. Unlike previous works, this class is independent of the viscosity and the strength of the noise. The two main tools of our analysis are the \textit{asymptotic strong Feller} property, introduced in this work, and an approximate integration by parts formula. The first, when combined with a weak type of irreducibility, is shown to ensure that the dynamics is ergodic. The second is used to show that the first holds under a H{o}rmander-type condition. This requires some interesting nonadapted stochastic analysis.

On the Markov chain central limit theorem

Abstract: The goal of this expository paper is to describe conditions which guarantee a central limit theorem for functionals of general state space Markov chains. This is done with a view towards Markov chain Monte Carlo settings and hence the focus is on the connections between drift and mixing conditions and their implications. In particular, we consider three commonly cited central limit theorems and discuss their relationship to classical results for mixing processes. Several motivating examples are given which range from toy one-dimensional settings to complicated settings encountered in Markov chain Monte Carlo.

Dynamic monetary risk measures for bounded discrete-time processes

Abstract: We study time-consistency questions for processes of monetary risk measures that depend on bounded discrete-time processes describing the evolution of financial values. The time horizon can be finite or infinite. We call a process of monetary risk measures time-consistent if it assigns to a process of financial values the same risk irrespective of whether it is calculated directly or in two steps backwards in time, and we show how this property manifests itself in the corresponding process of acceptance sets. For processes of coherent and convex monetary risk measures admitting a robust representation with sigma-additive linear functionals, we give necessary and sufficient conditions for time-consistency in terms of the representing functionals.

Choosing a Spanning Tree for the Integer Lattice Uniformly

Abstract: Consider the nearest neighbor graph for the integer lattice Z^d in d dimensions. For a large finite piece of it, consider choosing a spanning tree for that piece uniformly among all possible subgraphs that are spanning trees. As the piece gets larger, this approaches a limiting measure on the set of spanning graphs for Z^d. This is shown to be a tree if and only if d= =5 the spanning forest has infinitely many components almost surely, with each component having one or two topological ends.

A survey of max-type recursive distributional equations

Abstract: In certain problems in a variety of applied probability settings (from probabilistic analysis of algorithms to statistical physics), the central requirement is to solve a recursive distributional equation of the form X =^d g((\xi_i,X_i),i\geq 1). Here (\xi_i) and g(\cdot) are given and the X_i are independent copies of the unknown distribution X. We survey this area, emphasizing examples where the function g(\cdot) is essentially a ``maximum'' or ``minimum'' function. We draw attention to the theoretical question of endogeny: in the associated recursive tree process X_i, are the X_i measurable functions of the innovations process (\xi_i)?

Exchangeable Gibbs partitions and Stirling triangles

Abstract: For two collections of nonnegative and suitably normalised weights $\W=(\W_j)$ and $\V=(\V_{n,k})$, a probability distribution on the set of partitions of the set $\{1,...,n\}$ is defined by assigning to a generic partition $\{A_j, j\leq k\}$ the probability $\V_{n,k} \W_{|A_1|}... \W_{|A_k|}$, where $|A_j|$ is the number of elements of $A_j$. We impose constraints on the weights by assuming that the resulting random partitions $\Pi_n$ of $[n]$ are consistent as $n$ varies, meaning that they define an exchangeable partition of the set of all natural numbers. This implies that the weights $\W$ must be of a very special form depending on a single parameter $\alpha\in [-\infty,1]$. The case $\alpha=1$ is trivial, and for each value of $\alpha eq 1$ the set of possible $\V$-weights is an infinite-dimensional simplex. We identify the extreme points of the simplex by solving the boundary problem for a generalised Stirling triangle. In particular, we show that the boundary is discrete for $-\infty\leq\alpha<0$ and continuous for $0\leq\alpha<1$. For $\alpha\leq 0$ the extremes correspond to the members of the Ewens-Pitman family of random partitions indexed by $(\alpha,\theta)$, while for $0<\alpha<1$ the extremes are obtained by conditioning an $(\alpha,\theta)$-partition on the asymptotics of the number of blocks of $\Pi_n$ as $n$ tends to infinity.

Practical drift conditions for subgeometric rates of convergence

Abstract: We present a new drift condition which implies rates of convergence to the stationary distribution of the iterates of a \psi-irreducible aperiodic and positive recurrent transition kernel. This condition, extending a condition introduced by Jarner and Roberts [Ann. Appl. Probab. 12 (2002) 224-247] for polynomial convergence rates, turns out to be very convenient to prove subgeometric rates of convergence. Several applications are presented including nonlinear autoregressive models, stochastic unit root models and multidimensional random walk Hastings-Metropolis algorithms.

The largest eigenvalue of small rank perturbations of Hermitian random matrices

Abstract: We compute the limiting eigenvalue statistics at the edge of the spectrum of large Hermitian random matrices perturbed by the addition of small rank deterministic matrices. To be more precise, we consider random Hermitian matrices with independent Gaussian entries $M_{ij}, i\leq j$ with various expectations. We prove that the largest eigenvalue of such random matrices exhibits, in the large $N$ limit, various limiting distributions depending on both the eigenvalues of the matrix $(\mathbb{E}M_{ij})_{i,j=1}^N$ and its rank.

Gaussian fluctuations of eigenvalues in the GUE

Abstract: Under certain conditions on k we calculate the limit distribution of the k:th largest eigenvalue, x_k, of the Gaussian Unitary Ensemble (GUE). More specifically, if n is the dimension of a random matrix from the GUE and k is such that both k and n-k tends to infinity as n tends to infinity then x_k is normally distributed in the limit. We also consider the joint limit distribution of x_k_1 < ... < x_k_m where we require that k_1, k_{i+1}-k_i and n-k_m, i=1..m-1, tends to infinity with n. The result is an m-dimensional Normal Distribution.

Commutation relations for SLE

Abstract: Schramm-Loewner Evolutions (SLEs) describe a one-parameter family of growth processes in the plane that have particular conformal invariance properties. For instance, SLE can define simple random curves in a simply connected domain. In this paper we are interested in questions pertaining to the definition of several SLEs in a domain (i.e. several random curves). In particular, one derives infinitesimal commutation conditions, discuss some elementary solutions, study integrability conditions following from commutation and show how to lift these infinitesimal relations to global relations in simple cases. The situation in multiply-connected domains is also discussed.

General state space Markov chains and MCMC algorithms

Abstract: This paper surveys various results about Markov chains on general (non-countable) state spaces. It begins with an introduction to Markov chain Monte Carlo (MCMC) algorithms, which provide the motivation and context for the theory which follows. Then, sufficient conditions for geometric and uniform ergodicity are presented, along with quantitative bounds on the rate of convergence to stationarity. Many of these results are proved using direct coupling constructions based on minorisation and drift conditions. Necessary and sufficient conditions for Central Limit Theorems (CLTs) are also presented, in some cases proved via the Poisson Equation or direct regeneration constructions. Finally, optimal scaling and weak convergence results for Metropolis-Hastings algorithms are discussed. None of the results presented is new, though many of the proofs are. We also describe some Open Problems.

Normal Approximation in Geometric Probability

Abstract: We use Stein’s method to obtain bounds on the rate of convergence for a class of statistics in geometric probability obtained as a sum of contributions from Poisson points which are exponentially stabilizing, i.e. locally determined in a certain sense. Examples include statistics such as total edge length and total number of edges of graphs in computational geometry and the total number of particles accepted in random sequential packing models. These rates also apply to the 1-dimensional marginals of the random measures associated with these statistics.

Directed Polymers in Random Environment are Diffusive at Weak Disorder

Abstract: In this paper, we consider directed polymers in random environment with discrete space and time. For transverse dimension at least equal to 3, we prove that diffusivity holds for the path in the full weak disorder region, i.e., where the partition function differs from its annealed value only by a non-vanishing factor. Deep inside this region, we also show that the quenched averaged energy has fluctuations of order 1. In complete generality (arbitrary dimension and temperature), we prove monotonicity of the phase diagram in the temperature.

Monte Carlo Algorithms for Optimal Stopping and Statistical Learning

Abstract: We extend the Longstaff-Schwartz algorithm for approximately solving optimal stopping problems on high-dimensional state spaces. We reformulate the optimal stopping problem for Markov processes in discrete time as a generalized statistical learning problem. Within this setup we apply deviation inequalities for suprema of empirical processes to derive consistency criteria, and to estimate the convergence rate and sample complexity. Our results strengthen and extend earlier results.

A new maximal inequality and invariance principle for stationary sequences

Abstract: We derive a new maximal inequality for stationary sequences under a martingale-type condition introduced by Maxwell and Woodroofe [Ann. Probab. 28 (2000) 713-724]. Then, we apply it to establish the Donsker invariance principle for this class of stationary sequences. A Markov chain example is given in order to show the optimality of the conditions imposed.

Improving Asymptotic Variance of MCMC Estimators: Non-reversible Chains are Better

Abstract: I show how any reversible Markov chain on a finite state space that is irreducible, and hence suitable for estimating expectations with respect to its invariant distribution, can be used to construct a non-reversible Markov chain on a related state space that can also be used to estimate these expectations, with asymptotic variance at least as small as that using the reversible chain (typically smaller). The non-reversible chain achieves this improvement by avoiding (to the extent possible) transitions that backtrack to the state from which the chain just came. The proof that this modification cannot increase the asymptotic variance of an MCMC estimator uses a new technique that can also be used to prove Peskun's (1973) theorem that modifying a reversible chain to reduce the probability of staying in the same state cannot increase asymptotic variance. A non-reversible chain that avoids backtracking will often take little or no more computation time per transition than the original reversible chain, and can sometime produce a large reduction in asymptotic variance, though for other chains the improvement is slight. In addition to being of some practical interest, this construction demonstrates that non-reversible chains have a fundamental advantage over reversible chains for MCMC estimation. Research into better MCMC methods may therefore best be focused on non-reversible chains.

Convergence rate of linear two-time-scale stochastic approximation

Abstract: We study the rate of convergence of linear two-time-scale stochastic approximation methods. We consider two-time-scale linear iterations driven by i.i.d. noise, prove some results on their asymptotic covariance and establish asymptotic normality. The well-known result [Polyak, B. T. (1990). Automat. Remote Contr. 51 937-946; Ruppert, D. (1988). Technical Report 781, Cornell Univ.] on the optimality of Polyak-Ruppert averaging techniques specialized to linear stochastic approximation is established as a consequence of the general results in this paper.

The Skorokhod embedding problem and its offspring

Abstract: This is a survey about the Skorokhod embedding problem. It presents all known solutions together with their properties and some applications. Some of the solutions are just described, while others are studied in detail and their proofs are presented. A certain unification of proofs, based on one-dimensional potential theory, is made. Some new facts which appeared in a natural way when different solutions were cross-examined, are reported. Az\'ema and Yor's and Root's solutions are studied extensively. A possible use of the latter is suggested together with a conjecture.

A critical branching process model for biodiversity

Abstract: Motivated as a null model for comparison with data, we study the following model for a phylogenetic tree on $n$ extant species. The origin of the clade is a random time in the past, whose (improper) distribution is uniform on $(0,\infty)$. After that origin, the process of extinctions and speciations is a continuous-time critical branching process of constant rate, conditioned on having the prescribed number $n$ of species at the present time. We study various mathematical properties of this model as $n \to \infty$ limits: time of origin and of most recent common ancestor; pattern of divergence times within lineage trees; time series of numbers of species; number of extinct species in total, or ancestral to extant species; and "local" structure of the tree itself. We emphasize several mathematical techniques: associating walks with trees, a point process representation of lineage trees, and Brownian limits.

Distances in random graphs with finite variance degrees

Abstract: In this paper we study a random graph with $N$ nodes, where node $j$ has degree $D_j$ and $\{D_j\}_{j=1}^N$ are i.i.d. with $\prob(D_j\leq x)=F(x)$. We assume that $1-F(x)\leq c x^{-\tau+1}$ for some $\tau>3$ and some constant $c>0$. This graph model is a variant of the so-called configuration model, and includes heavy tail degrees with finite variance. The minimal number of edges between two arbitrary connected nodes, also known as the graph distance or the hopcount, is investigated when $N\to \infty$. We prove that the graph distance grows like $\log_{ u}N$, when the base of the logarithm equals $ u=\expec[D_j(D_j -1)]/\expec[D_j]>1$. This confirms the heuristic argument of Newman, Strogatz and Watts \cite{NSW00}. In addition, the random fluctuations around this asymptotic mean $\log_{ u}{N}$ are characterized and shown to be uniformly bounded. In particular, we show convergence in distribution of the centered graph distance along exponentially growing subsequences.

Young integrals and SPDEs

Abstract: In this note, we study the non-linear evolution problem $dY_t = -A Y_t dt + B(Y_t) dX_t$, where $X$ is a $\gamma$-H\"older continuous function of the time parameter, with values in a distribution space, and $-A$ the generator of an analytical semigroup. Then, we will give some sharp conditions on $X$ in order to solve the above equation in a function space, first in the linear case (for any value of $\gamma$ in $(0,1)$), and then when $B$ satisfies some Lipschitz type conditions (for $\gamma>1/2$). The solution of the evolution problem will be understood in the mild sense, and the integrals involved in that definition will be of Young type.

Vertex-Reinforced Random Walk

Abstract: This paper considers a class of non-Markovian discrete-time random processes on a finite state space {1,...,d}. The transition probabilities at each time are influenced by the number of times each state has been visited and by a fixed a priori likelihood matrix, R, which is real, symmetric and nonnegative. Let S_i(n) keep track of the number of visits to state i up to time n, and form the fractional occupation vector, V(n), where v_i(n)=S_i(n)/(sum_{j=1}^d S_j(n)). It is shown that V(n) converges to a set of critical points for the quadratic form H with matrix R, and that under nondegeneracy conditions on R, there is a finite set of points such that with probability one, V(n)->p for some p in the set. There may be more than one p in this set for which P(V(n)->p)>0. On the other hand P(V(n)->p)=0 whenever p fails in a strong enough sense to be maximum for H.

Orthogonal polynomial ensembles in probability theory

Abstract: We survey a number of models from physics, statistical mechanics, probability theory and combinatorics, which are each described in terms of an orthogonal polynomial ensemble. The most prominent example is apparently the Hermite ensemble, the eigenvalue distribution of the Gaussian Unitary Ensemble (GUE), and other well-known ensembles known in random matrix theory like the Laguerre ensemble for the spectrum of Wishart matrices. In recent years, a number of further interesting models were found to lead to orthogonal polynomial ensembles, among which the corner growth model, directed last passage percolation, the PNG droplet, non-colliding random processes, the length of the longest increasing subsequence of a random permutation, and others. Much attention has been paid to universal classes of asymptotic behaviors of these models in the limit of large particle numbers, in particular the spacings between the particles and the fluctuation behavior of the largest particle. Computer simulations suggest that the connections go even farther and also comprise the zeros of the Riemann zeta function. The existing proofs require a substantial technical machinery and heavy tools from various parts of mathematics, in particular complex analysis, combinatorics and variational analysis. Particularly in the last decade, a number of fine results have been achieved, but it is obvious that a comprehensive and thorough understanding of the matter is still lacking. Hence, it seems an appropriate time to provide a surveying text on this research area.

A coalescent model for the effect of advantageous mutations on the genealogy of a population

Abstract: When an advantageous mutation occurs in a population, the favorable allele may spread to the entire population in a short time, an event known as a selective sweep. As a result, when we sample $n$ individuals from a population and trace their ancestral lines backwards in time, many lineages may coalesce almost instantaneously at the time of a selective sweep. We show that as the population size goes to infinity, this process converges to a coalescent process called a coalescent with multiple collisions. A better approximation for finite populations can be obtained using a coalescent with simultaneous multiple collisions. We also show how these coalescent approximations can be used to get insight into how beneficial mutations affect the behavior of statistics that have been used to detect departures from the usual Kingman's coalescent.

Random subgraphs of finite graphs: II. The lace expansion and the triangle condition

Abstract: In a previous paper, we defined a version of the percolation triangle condition that is suitable for the analysis of bond percolation on a finite connected transitive graph, and showed that this triangle condition implies that the percolation phase transition has many features in common with the phase transition on the complete graph. In this paper, we use a new and simplified approach to the lace expansion to prove quite generally that for finite graphs that are tori the triangle condition for percolation is implied by a certain triangle condition for simple random walks on the graph. The latter is readily verified for several graphs with vertex set $\{0,1,..., r-1\}^n$, including the Hamming cube on an alphabet of $r$ letters (the $n$-cube, for $r=2$), the $n$-dimensional torus with nearest-neighbor bonds and $n$ sufficiently large, and the $n$-dimensional torus with $n>6$ and sufficiently spread-out (long range) bonds. The conclusions of our previous paper thus apply to the percolation phase transition for each of the above examples.

Exchangeable pairs and Poisson approximation

Abstract: This is a survey paper on Poisson approximation using Stein's method of exchangeable pairs. We illustrate using Poisson-binomial trials and many variations on three classical problems of combinatorial probability: the matching problem, the coupon collector's problem, and the birthday problem. While many details are new, the results are closely related to a body of work developed by Andrew Barbour, Louis Chen, Richard Arratia, Lou Gordon, Larry Goldstein, and their collaborators. Some comparison with these other approaches is offered.

Chernoff's Theorem and Discrete Time Approximations of Brownian Motion on Manifolds

Abstract: Let (S(t)) be a one-parameter family S = (S(t)) of positive integral operators on a locally compact space L. For a possibly non-uniform partition of [0,1] define a measure on the path space C([0,1],L) by using a) S(dt) for the transition between cosecutive partition times of distance dt, and b) a suitable continuous interpolation scheme (e.g. Brownian bridges or geodesics). If necessary normalize to get a probability measure. We prove a version of Chernoff's theorem of semigroup theory and tighness results which together yield convergence in law of such measures as the partition gets finer. In particular let L be a closed smooth submanifold of a Riemannian manifold M. We prove convergence of Brownian motion on M, conditioned to visit L at all partition times, to a process on L whose law has a Radon-Nikodym density with repect to Brownian motion on L which contains scalar, mean and sectional curvature terms. Various approximation schemes for Brownian motion are also given. These results substantially extend earlier work by the authors and by Andersson and Driver.