Showing papers in "arXiv: Probability in 2018"

Stochastic integration in quasi-Banach spaces

Abstract: In this paper we develop a stochastic integration theory for processes with values in a quasi-Banach space. The integrator is a cylindrical Brownian motion. The main results give sufficient conditions for stochastic integrability. They are natural extensions of known results in the Banach space setting. We apply our main results to the stochastic heat equation where the forcing terms are assumed to have Besov regularity in the space variable with integrability exponent $p\in (0,1]$. The latter is natural to consider for its potential application to adaptive wavelet methods for stochastic partial differential equations.

The directed landscape

Abstract: The conjectured limit of last passage percolation is a scale-invariant, independent, stationary increment process with respect to metric composition. We prove this for Brownian last passage percolation. We construct the Airy sheet and characterize it in terms of the Airy line ensemble. We also show that last passage geodesics converge to random functions with Holder-2/3- continuous paths. This work completes the construction of the central object in the Kardar-Parisi-Zhang universality class, the directed landscape.

On sampling from a log-concave density using kinetic Langevin diffusions

Abstract: Langevin diffusion processes and their discretizations are often used for sampling from a target density. The most convenient framework for assessing the quality of such a sampling scheme corresponds to smooth and strongly log-concave densities defined on $\mathbb R^p$. The present work focuses on this framework and studies the behavior of Monte Carlo algorithms based on discretizations of the kinetic Langevin diffusion. We first prove the geometric mixing property of the kinetic Langevin diffusion with a mixing rate that is, in the overdamped regime, optimal in terms of its dependence on the condition number. We then use this result for obtaining improved guarantees of sampling using the kinetic Langevin Monte Carlo method, when the quality of sampling is measured by the Wasserstein distance. We also consider the situation where the Hessian of the log-density of the target distribution is Lipschitz-continuous. In this case, we introduce a new discretization of the kinetic Langevin diffusion and prove that this leads to a substantial improvement of the upper bound on the sampling error measured in Wasserstein distance.

Mean Field Analysis of Neural Networks: A Central Limit Theorem

Abstract: We rigorously prove a central limit theorem for neural network models with a single hidden layer. The central limit theorem is proven in the asymptotic regime of simultaneously (A) large numbers of hidden units and (B) large numbers of stochastic gradient descent training iterations. Our result describes the neural network's fluctuations around its mean-field limit. The fluctuations have a Gaussian distribution and satisfy a stochastic partial differential equation. The proof relies upon weak convergence methods from stochastic analysis. In particular, we prove relative compactness for the sequence of processes and uniqueness of the limiting process in a suitable Sobolev space.

Convergence of the Deep BSDE Method for Coupled FBSDEs

Abstract: The recently proposed numerical algorithm, deep BSDE method, has shown remarkable performance in solving high-dimensional forward-backward stochastic differential equations (FBSDEs) and parabolic partial differential equations (PDEs). This article lays a theoretical foundation for the deep BSDE method in the general case of coupled FBSDEs. In particular, a posteriori error estimation of the solution is provided and it is proved that the error converges to zero given the universal approximation capability of neural networks. Numerical results are presented to demonstrate the accuracy of the analyzed algorithm in solving high-dimensional coupled FBSDEs.

Deep neural networks algorithms for stochastic control problems on finite horizon: convergence analysis

Abstract: This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of neural networks in the spirit of deep reinforcement learning, and then the value function by Monte Carlo regression. This is achieved in the dynamic programming recursion by performance or hybrid iteration, and regress now methods from numerical probabilities. We provide a theoretical justification of these algorithms. Consistency and rate of convergence for the control and value function estimates are analyzed and expressed in terms of the universal approximation error of the neural networks, and of the statistical error when estimating network function, leaving aside the optimization error. Numerical results on various applications are presented in a companion paper (arxiv.org/abs/1812.05916) and illustrate the performance of the proposed algorithms.

Mean Field Analysis of Neural Networks: A Law of Large Numbers

Abstract: Machine learning, and in particular neural network models, have revolutionized fields such as image, text, and speech recognition. Today, many important real-world applications in these areas are driven by neural networks. There are also growing applications in engineering, robotics, medicine, and finance. Despite their immense success in practice, there is limited mathematical understanding of neural networks. This paper illustrates how neural networks can be studied via stochastic analysis, and develops approaches for addressing some of the technical challenges which arise. We analyze one-layer neural networks in the asymptotic regime of simultaneously (A) large network sizes and (B) large numbers of stochastic gradient descent training iterations. We rigorously prove that the empirical distribution of the neural network parameters converges to the solution of a nonlinear partial differential equation. This result can be considered a law of large numbers for neural networks. In addition, a consequence of our analysis is that the trained parameters of the neural network asymptotically become independent, a property which is commonly called "propagation of chaos".

Lectures on Integrable Probability: stochastic vertex models and symmetric functions

Abstract: We consider a homogeneous stochastic higher spin six vertex model in a quadrant. For this model we derive concise integral representations for multi-point q-moments of the height function and for the q-correlation functions. At least in the case of the step initial condition, our formulas degenerate in appropriate limits to many known formulas of such type for integrable probabilistic systems in the (1+1)d KPZ universality class, including the stochastic six vertex model, ASEP, various q-TASEPs, and associated zero range processes. Our arguments are largely based on properties of a family of symmetric rational functions (introduced in arXiv:1410.0976) that can be defined as partition functions of the higher spin six vertex model for suitable domains; they generalize classical Hall-Littlewood and Schur polynomials. A key role is played by Cauchy-like summation identities for these functions, which are obtained as a direct corollary of the Yang-Baxter equation for the higher spin six vertex model. These are lecture notes for a course given by A.B. at the Ecole de Physique des Houches in July of 2015. All the results and proofs presented here generalize to the setting of the fully inhomogeneous higher spin six vertex model, see arXiv:1601.05770 for a detailed exposition of the inhomogeneous case.

Coloured stochastic vertex models and their spectral theory

Abstract: This work is dedicated to $\mathfrak{sl}_{n+1}$-related integrable stochastic vertex models; we call such models coloured. We prove several results about these models, which include the following: (1) We construct the basis of (rational) eigenfunctions of the coloured transfer-matrices as partition functions of our lattice models with certain boundary conditions. Similarly, we construct a dual basis and prove the corresponding orthogonality relations and Plancherel formulae; (2) We derive a variety of combinatorial properties of those eigenfunctions, such as branching rules, exchange relations under Hecke divided-difference operators, (skew) Cauchy identities of different types, and monomial expansions; (3) We show that our eigenfunctions are certain (non-obvious) reductions of the nested Bethe Ansatz eigenfunctions; (4) For models in a quadrant with domain-wall (or half-Bernoulli) boundary conditions, we prove a matching relation that identifies the distribution of the coloured height function at a point with the distribution of the height function along a line in an associated colour-blind ($\mathfrak{sl}_2$-related) stochastic vertex model. Thanks to a variety of known results about asymptotics of height functions of the colour-blind models, this implies a similar variety of limit theorems for the coloured height function of our models; (5) We demonstrate how the coloured-uncoloured match degenerates to the coloured (or multi-species) versions of the ASEP, $q$-PushTASEP, and the $q$-boson model; (6) We show how our eigenfunctions relate to non-symmetric Cherednik-Macdonald theory, and we make use of this connection to prove a probabilistic matching result by applying Cherednik-Dunkl operators to the corresponding non-symmetric Cauchy identity.

Well-posedness of distribution dependent SDEs with singular drifts

Abstract: Consider the following distribution dependent SDE: $$ {\mathrm d} X_t=\sigma_t(X_t,\mu_{X_t}){\mathrm d} W_t+b_t(X_t,\mu_{X_t}){\mathrm d} t, $$ where $\mu_{X_t}$ stands for the distribution of $X_t$ In this paper for non-degenerate $\sigma$, we show the strong well-posedness of the above SDE under some integrability assumptions in the spatial variable and Lipschitz continuity in $\mu$ about $b$ and $\sigma$ In particular, we extend the results of Krylov-Rockner \cite{Kr-Ro} to the distribution dependent case

Time-uniform Chernoff bounds via nonnegative supermartingales

Abstract: We develop a class of exponential bounds for the probability that a martingale sequence crosses a time-dependent linear threshold. Our key insight is that it is both natural and fruitful to formulate exponential concentration inequalities in this way. We illustrate this point by presenting a single assumption and theorem that together unify and strengthen many tail bounds for martingales, including classical inequalities (1960-80) by Bernstein, Bennett, Hoeffding, and Freedman; contemporary inequalities (1980-2000) by Shorack and Wellner, Pinelis, Blackwell, van de Geer, and de la Pe\~na; and several modern inequalities (post-2000) by Khan, Tropp, Bercu and Touati, Delyon, and others. In each of these cases, we give the strongest and most general statements to date, quantifying the time-uniform concentration of scalar, matrix, and Banach-space-valued martingales, under a variety of nonparametric assumptions in discrete and continuous time. In doing so, we bridge the gap between existing line-crossing inequalities, the sequential probability ratio test, the Cram\'er-Chernoff method, self-normalized processes, and other parts of the literature.

Overcoming the curse of dimensionality in the numerical approximation of semilinear parabolic partial differential equations

Abstract: For a long time it is well-known that high-dimensional linear parabolic partial differential equations (PDEs) can be approximated by Monte Carlo methods with a computational effort which grows polynomially both in the dimension and in the reciprocal of the prescribed accuracy. In other words, linear PDEs do not suffer from the curse of dimensionality. For general semilinear PDEs with Lipschitz coefficients, however, it remained an open question whether these suffer from the curse of dimensionality. In this paper we partially solve this open problem. More precisely, we prove in the case of semilinear heat equations with gradient-independent and globally Lipschitz continuous nonlinearities that the computational effort of a variant of the recently introduced multilevel Picard approximations grows polynomially both in the dimension and in the reciprocal of the required accuracy.

Scalable load balancing in networked systems: A survey of recent advances.

Abstract: The basic load balancing scenario involves a single dispatcher where tasks arrive that must immediately be forwarded to one of $N$ single-server queues. We discuss recent advances on scalable load balancing schemes which provide favorable delay performance when $N$ grows large, and yet only require minimal implementation overhead. Join-the-Shortest-Queue (JSQ) yields vanishing delays as $N$ grows large, as in a centralized queueing arrangement, but involves a prohibitive communication burden. In contrast, power-of-$d$ or JSQ($d$) schemes that assign an incoming task to a server with the shortest queue among $d$ servers selected uniformly at random require little communication, but lead to constant delays. In order to examine this fundamental trade-off between delay performance and implementation overhead, we consider JSQ($d(N)$) schemes where the diversity parameter $d(N)$ depends on $N$ and investigate what growth rate of $d(N)$ is required to asymptotically match the optimal JSQ performance on fluid and diffusion scale. Stochastic coupling techniques and stochastic-process limits play an instrumental role in establishing the asymptotic optimality. We demonstrate how this methodology carries over to infinite-server settings, finite buffers, multiple dispatchers, servers arranged on graph topologies, and token-based load balancing including the popular Join-the-Idle-Queue (JIQ) scheme. In this way we provide a broad overview of the many recent advances in the field. This survey extends the short review presented at ICM 2018 (arXiv:1712.08555).

Strong convergence rates of semi-discrete splitting approximations for stochastic Allen--Cahn equation

Abstract: This article analyzes an explicit temporal splitting numerical scheme for the stochastic Allen-Cahn equation driven by additive noise, in a bounded spatial domain with smooth boundary in dimension $d\le 3$. The splitting strategy is combined with an exponential Euler scheme of an auxiliary problem. When $d=1$ and the driving noise is a space-time white noise, we first show some a priori estimates of this splitting scheme. Using the monotonicity of the drift nonlinearity, we then prove that under very mild assumptions on the initial data, this scheme achieves the optimal strong convergence rate $\OO(\delta t^{\frac 14})$. When $d\le 3$ and the driving noise possesses some regularity in space, we study exponential integrability properties of the exact and numerical solutions. Finally, in dimension $d=1$, these properties are used to prove that the splitting scheme has a strong convergence rate $\OO(\delta t)$.

The distribution of overlaps between eigenvectors of Ginibre matrices

Abstract: We study the overlaps between eigenvectors of nonnormal matrices. They quantify the stability of the spectrum, and characterize the joint eigenvalues increments under Dyson-type dynamics. Well known work by Chalker and Mehlig calculated the expectation of these overlaps for complex Ginibre matrices. For the same model, we extend their results by deriving the distribution of diagonal overlaps (the condition numbers), and their correlations. We prove: (i) convergence of condition numbers for bulk eigenvalues to an inverse Gamma distribution; more generally, we decompose the quenched overlap (i.e. conditioned on eigenvalues) as a product of independent random variables; (ii) asymptotic expectation of off-diagonal overlaps, both for microscopic or mesoscopic separation of the corresponding eigenvalues; (iii) decorrelation of condition numbers associated to eigenvalues at mesoscopic distance, at polynomial speed in the dimension; (iv) second moment asymptotics to identify the fluctuations order for off-diagonal overlaps, when the related eigenvalues are separated by any mesoscopic scale; (v) a new formula for the correlation between overlaps for eigenvalues at microscopic distance, both diagonal and off-diagonal. These results imply estimates on the extreme condition numbers, the volume of the pseudospectrum and the diffusive evolution of eigenvalues under Dyson-type dynamics, at equilibrium.

Stochastic epidemics in a homogeneous community

Abstract: These notes describe stochastic epidemics in a homogenous community. Our main concern is stochastic compartmental models (i.e. models where each individual belongs to a compartment, which stands for its status regarding the epidemic under study : S for susceptible, E for exposed, I for infectious, R for recovered) for the spread of an infectious disease. In the present notes we restrict ourselves to homogeneously mixed communities. We present our general model and study the early stage of the epidemic in chapter 1. Chapter 2 studies the particular case of Markov models, especially in the asymptotic of a large population, which leads to a law of large numbers and a central limit theorem. Chapter 3 considers the case of a closed population, and describes the final size of the epidemic (i.e. the total number of individuals who ever get infected). Chapter 4 considers models with a constant influx of susceptibles (either by birth, immigration of loss of immunity of recovered individuals), and exploits the CLT and Large Deviations to study how long it takes for the stochastic disturbances to stop an endemic situation which is stable for the deterministic epidemic model. The document ends with an Appendix which presents several mathematical notions which are used in these notes, as well as solutions to many of the exercises which are proposed in the various chapters.

McKean-Vlasov SDEs under Measure Dependent Lyapunov Conditions

Abstract: We prove the existence of weak solutions to McKean-Vlasov SDEs defined on a domain $D \subseteq \mathbb{R}^d$ with continuous and unbounded coefficients that satisfy Lyapunov type conditions, where the Lyapunov function may depend on measure. We propose a new type of {\em integrated} Lyapunov condition, where the inequality is only required to hold when integrated against the measure on which the Lyapunov function depends , and we show that this is sufficient for the existence of weak solutions to McKean-Vlasov SDEs defined on $D$. The main tool used in the proofs is the concept of a measure derivative due to Lions. We prove results on uniqueness under weaker assumptions than that of global Lipschitz continuity of the coefficients.

Exact lower tail large deviations of the KPZ equation

Abstract: Consider the Hopf--Cole solution $ h(t,x) $ of the KPZ equation with narrow wedge initial condition. Regarding $ t\to\infty $ as a scaling parameter, we provide the first rigorous proof of the Large Deviation Principle (LDP) for the lower tail of $ h(2t,0)+\frac{t}{12} $, with speed $ t^2 $ and an explicit rate function $ \Phi_-(z) $. This result confirms existing physic predictions [Sasorov, Meerson, Prolhac 17], [Corwin, Ghosal, Krajenbrink, Le Doussal, Tsai 18], and [Krajenbrink, Le Doussal, Prolhac 18]. Our analysis utilizes the formula from [Borodin, Gorin 16] to convert LDP of the KPZ equation to calculating an exponential moment of the Airy point process. To estimate this exponential moment, we invoke the stochastic Airy operator, and use the Riccati transform, comparison techniques, and certain variational characterizations of the relevant functional.

The two-dimensional KPZ equation in the entire subcritical regime

Abstract: We consider the KPZ equation in space dimension 2 driven by space-time white noise. We showed in previous work that if the noise is mollified in space on scale $\epsilon$ and its strength is scaled as $\hat\beta / \sqrt{|\log \epsilon|}$, then a transition occurs with explicit critical point $\hat\beta_c = \sqrt{2\pi}$. Recently Chatterjee and Dunlap showed that the solution admits subsequential scaling limits as $\epsilon \downarrow 0$, for sufficiently small $\hat\beta$. We prove here that the limit exists in the entire subcritical regime $\hat\beta \in (0, \hat\beta_c)$ and we identify it as the solution of an additive Stochastic Heat Equation, establishing so-called Edwards-Wilkinson fluctuations. The same result holds for the directed polymer model in random environment in space dimension 2.

Nonexistence of Bigeodesics in Integrable Models of Last Passage Percolation

Abstract: Bi-infinite geodesics are fundamental objects of interest in planar first passage percolation. A longstanding conjecture states that under mild conditions there are almost surely no bigeodesics, however the result has not been proved in any case. For the exactly solvable model of directed last passage percolation on $\mathbb{Z}^2$ with i.i.d. exponential passage times, we study the corresponding question and show that almost surely the only bigeodesics are the trivial ones, i.e., the horizontal and vertical lines. The proof makes use of estimates for last passage time available from the integrable probability literature to study coalescence structure of finite geodesics, thereby making rigorous a heuristic argument due to Newman.

Non-asymptotic bounds for sampling algorithms without log-concavity

Abstract: Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the $L^2$ Wasserstein distance of sampling algorithms based on Euler discretisations of SDEs has been recently developed by several authors for log-concave probability distributions. In this work we replace the log-concavity assumption with a log-concavity at infinity condition. We provide novel $L^2$ convergence rates for Euler schemes, expressed explicitly in terms of problem parameters. From there we derive non-asymptotic bounds on the distance between the laws induced by Euler schemes and the invariant laws of SDEs, both for schemes with standard and with randomised (inaccurate) drifts. We also obtain bounds for the hierarchy of discretisation, which enables us to deploy a multi-level Monte Carlo estimator. Our proof relies on a novel construction of a coupling for the Markov chains that can be used to control both the $L^1$ and $L^2$ Wasserstein distances simultaneously. Finally, we provide a weak convergence analysis that covers both the standard and the randomised (inaccurate) drift case. In particular, we reveal that the variance of the randomised drift does not influence the rate of weak convergence of the Euler scheme to the SDE.

Bulk properties of the Airy line ensemble

Abstract: The Airy line ensemble is a central object in random matrix theory and last passage percolation defined by a determinantal formula. The goal of this paper is to provide a set of tools which allow for precise probabilistic analysis of the Airy line ensemble. The two main theorems are a representation in terms of independent Brownian bridges connecting a fine grid of points, and a modulus of continuity result for all lines. Along the way, we give tail bounds and moduli of continuity for nonintersecting Brownian ensembles, and a quick proof of tightness for Dyson's Brownian motion converging to the Airy line ensemble.

Random band matrices in the delocalized phase, I: Quantum unique ergodicity and universality

Abstract: Consider $N\times N$ symmetric one-dimensional random band matrices with general distribution of the entries and band width $W \geq N^{3/4+\varepsilon}$ for any $\varepsilon>0$. In the bulk of the spectrum and in the large $N$ limit, we obtain the following results. (i) The semicircle law holds up to the scale $N^{-1+\varepsilon}$ for any $\varepsilon>0$. (ii) The eigenvalues locally converge to the point process given by the Gaussian orthogonal ensemble at any fixed energy. (iii) All eigenvectors are delocalized, meaning their ${\rm L}^\infty$ norms are all simultaneously bounded by $N^{-\frac{1}{2}+\varepsilon}$ (after normalization in ${\rm L}^2$) with overwhelming probability, for any $\varepsilon>0$. (iv )Quantum unique ergodicity holds, in the sense that the local ${\rm L}^2$ mass of eigenvectors becomes equidistributed with overwhelming probability. We extend the mean-field reduction method \cite{BouErdYauYin2017}, which required $W=\Omega(N)$, to the current setting $W \ge N^{3/4+\varepsilon}$. Two new ideas are: (1) A new estimate on the "generalized resolvent" of band matrices when $W \geq N^{3/4+\varepsilon}$. Its proof, along with an improved fluctuation average estimate, will be presented in parts 2 and 3 of this series \cite {BouYanYauYin2018,YanYin2018}. (2) A strong (high probability) version of the quantum unique ergodicity property of random matrices. For its proof, we construct perfect matching observables of eigenvector overlaps and show they satisfying the eigenvector moment flow equation \cite{BouYau2017} under the matrix Brownian motions.

From nonlinear Fokker-Planck equations to solutions of distribution dependent SDE

Abstract: We construct weak solutions to a class of distribution dependent SDE, of type $dX(t)=b\left( X(t), \displaystyle\frac{d\mathcal{L}_{X(t)}}{dx}(X(t))\right) dt+\sigma\left( X(t),\displaystyle\frac{d\mathcal{L}_{X(t)}}{dt}(X(t))\right) dW(t)$ for possibly degenerate diffusion matrices $\sigma$ with $X(0)$ having a given law, which has a density with respect to Lebesgue measure, $dx$. Here ${\mathcal{L}}_{X(t)}$ denotes the law of $X(t)$. Our approach is to first solve the corresponding nonlinear Fokker-Planck equations and then use the well known superposition principle to obtain weak solutions of the above SDE.

Extreme gaps between eigenvalues of Wigner matrices

Abstract: This paper proves universality of the distribution of the smallest and largest gaps between eigenvalues of generalized Wigner matrices, under some smoothness assumption for the density of the entries. The proof relies on the Erd{\H o}s-Schlein-Yau dynamic approach. We exhibit a new observable that satisfies a stochastic advection equation and reduces local relaxation of the Dyson Brownian motion to a maximum principle. This observable also provides a simple and unified proof of universality in the bulk and at the edge, which is quantitative. To illustrate this, we give the first explicit rate of convergence to the Tracy-Widom distribution for generalized Wigner matrices.

Distribution Dependent SDEs with Singular Coefficients

Abstract: In this paper, existence and uniqueness are proved for path-dependent McKean-Vlasov type SDEs with integrability conditions. Gradient estimates and Harnack type inequalities are derived in the case that the coefficients are Dini continuous in the space variable. These generalize the corresponding results derived for classical functional SDEs with singular coefficients.

Following the ground-states of full-RSB spherical spin glasses

Abstract: We focus on spherical spin glasses whose Parisi distribution has support of the form $[0,q]$. For such models we construct paths from the origin to the sphere which consistently remain close to the ground-state energy on the sphere of corresponding radius. The construction uses a greedy strategy, which always follows a direction corresponding to the most negative eigenvalues of the Hessian of the Hamiltonian. For finite mixtures $ u(x)$ it provides an algorithm of time complexity $O(N^{{\rm deg}( u)})$ to find w.h.p. points with the ground-state energy, up to a small error. For the pure spherical models, the same algorithm reaches the energy $-E_{\infty}$, the conjectural terminal energy for gradient descent. Using the TAP formula for the free energy, for full-RSB models with support $[0,q]$, we are able to prove the correct lower bound on the free energy (namely, prove the lower bound from Parisi's formula), assuming the correctness of the Parisi formula only in the replica symmetric case.

Steady-state analysis of the Join the Shortest Queue model in the Halfin-Whitt regime

Abstract: This paper studies the steady-state properties of the Join the Shortest Queue model in the Halfin-Whitt regime. We focus on the process tracking the number of idle servers, and the number of servers with non-empty buffers. Recently, Eschenfeldt & Gamarnik (2015) proved that a scaled version of this process converges, over finite time intervals, to a two-dimensional diffusion limit as the number of servers goes to infinity. In this paper we prove that the diffusion limit is exponentially ergodic, and that the diffusion scaled sequence of the steady-state number of idle servers and non-empty buffers is tight. Our results mean that the process-level convergence proved in Eschenfeldt & Gamarnik (2015) implies convergence of steady-state distributions. The methodology used is the generator expansion framework based on Stein's method, also referred to as the drift-based fluid limit Lyapunov function approach in Stolyar (2015). One technical contribution to the framework is to show that it can be used as a general tool to establish exponential ergodicity.

Free energy landscapes in spherical spin glasses

Abstract: We introduce and analyze free energy landscapes defined by associating to any point inside the sphere a free energy calculated on a thin spherical band around it, using many orthogonal replicas. This allows us to reinterpret, rigorously prove and extend for general spherical models the main ideas of the Thouless-Anderson-Palmer (TAP) approach originally introduced in the 70s for the Sherrington-Kirkpatrick model. In particular, we establish a TAP representation for the free energy, valid for any overlap value which can be sampled as many times as we wish in an appropriate sense. We call such overlaps multi-samplable. The correction to the Hamiltonian in the TAP representation arises in our analysis as the free energy of a certain model on an overlap dependent band. For the largest multi-samplable overlap it coincides with the Onsager reaction term from physics. For smaller multi-samplable overlaps the formula we obtain is new. We also derive the corresponding TAP equation for critical points. We prove all the above without appealing to the celebrated Parisi formula or the ultrametricity property. We prove that any overlap value in the support of the Parisi measure is multi-samplable. For generic models, we further show that the set of multi-samplable overlaps coincides with a certain set that arises in the characterization for the Parisi measure by Talagrand. The ultrametric tree of pure states can be embedded in the interior of the sphere in a natural way. For this embedding, we show that the points on the tree uniformly maximize the free energies we define. From this we conclude that the Hamiltonian at each point on the tree is approximately maximal over the sphere of same radius, and that points on the tree approximately solve the TAP equations for critical points.

Stochastic Block Model for Hypergraphs: Statistical limits and a semidefinite programming approach.

Abstract: We study the problem of community detection in a random hypergraph model which we call the stochastic block model for $k$-uniform hypergraphs ($k$-SBM). We investigate the exact recovery problem in $k$-SBM and show that a sharp phase transition occurs around a threshold: below the threshold it is impossible to recover the communities with non-vanishing probability, yet above the threshold there is an estimator which recovers the communities almost asymptotically surely. We also consider a simple, efficient algorithm for the exact recovery problem which is based on a semidefinite relaxation technique.