scispace - formally typeset
Proceedings ArticleDOI

Sampling and integration of near log-concave functions

David Applegate, +1 more
- pp 156-163
Reads0
Chats0
TLDR
This work provides the first polynomial time algorithm to generate samples from a given log-concave distribution and proves a general isoperimetric inequality for convex sets and uses this together with recent developments in the theory of rapidly mixing Markov chains.
Abstract
Sampling and Integration of Near Log-Concave Functions David Applegate* Ravi Kannan* An important class of functions that arise in statistics and other areas are the log-concave functions. Here we provide the first polynomial time algorithm to generate samples from a given log-concave distribution. The algorithm is fairly simple and natural; it is the proof of its fast convergence that is new. To this end, we prove a general isoperimetric inequality for convex sets and use this together with recent developments in the theory of rapidly mixing Markov chains. We use our sampling algorithm to develop an algorithm for integrating log-concave functions. As one application, we are able to develop an algorithm for approximating the volume of convex bodies given by an oracle; we do so by enclosing the given body in a cube, defining a log-concave function that is 1 on the body and exponentially falls off outside, and integrating this function. This a.llo ws us to avoid one of the complications in prior algorithms for computing volumes – dealing with sharp corners – and results in an algorithm which is faster than previous algorithms.

read more

Citations
More filters
Journal ArticleDOI

An introduction to MCMC for machine learning

TL;DR: This purpose of this introductory paper is to introduce the Monte Carlo method with emphasis on probabilistic machine learning and review the main building blocks of modern Markov chain Monte Carlo simulation.

Random Walks on Graphs: A Survey

TL;DR: Estimates on the important parameters of access time, commute time, cover time and mixing time are discussed and recent algorithmic applications of random walks are sketched, in particular to the problem of sampling.
Proceedings Article

Bayesian inverse reinforcement learning

TL;DR: This paper shows how to combine prior knowledge and evidence from the expert's actions to derive a probability distribution over the space of reward functions and presents efficient algorithms that find solutions for the reward learning and apprenticeship learning tasks that generalize well over these distributions.
Proceedings ArticleDOI

Private Empirical Risk Minimization: Efficient Algorithms and Tight Error Bounds

TL;DR: In this article, the authors provide new algorithms and matching lower bounds for differentially private convex empirical risk minimization assuming only that each data point's contribution to the loss function is Lipschitz and that the domain of optimization is bounded.
Book

The Markov chain Monte Carlo method: an approach to approximate counting and integration

TL;DR: The introduction of analytical tools with the aim of permitting the analysis of Monte Carlo algorithms for classical problems in statistical physics has spurred the development of new approximation algorithms for a wider class of problems in combinatorial enumeration and optimization.
References
More filters
Book ChapterDOI

Probability Inequalities for sums of Bounded Random Variables

TL;DR: In this article, upper bounds for the probability that the sum S of n independent random variables exceeds its mean ES by a positive number nt are derived for certain sums of dependent random variables such as U statistics.
Book

Geometric Algorithms and Combinatorial Optimization

TL;DR: In this article, the Fulkerson Prize was won by the Mathematical Programming Society and the American Mathematical Society for proving polynomial time solvability of problems in convexity theory, geometry, and combinatorial optimization.
Journal ArticleDOI

Integer Programming with a Fixed Number of Variables

TL;DR: It is shown that the integer linear programming problem with a fixed number of variables is polynomially solvable.
BookDOI

Theorie der Konvexen Körper

T. Bonnesen, +1 more
TL;DR: In this article, Minkowski et al. den engen Zusammenhang dieser Begriffbildungen und Satze mit der Frage nach der bestimmung konvexer Flachen durch ihre GAusssche Krtim mung aufgedeckt und tiefliegende diesbeztigliche Satze bewiesen.
Journal ArticleDOI

Approximate counting, uniform generation and rapidly mixing Markov chains

TL;DR: In this article, it was shown that for self-reducible structures, almost uniform generation is possible in polynomial time provided only that randomised approximate counting to within some arbitrary polynomial factor is possible.
Related Papers (5)