Convergence of Probability Measures. By P. Billingsley. Chichester, Sussex, Wiley, 1968. xii, 253 p. 9 1/4“. 117s.

Convergence of Probability Measures

The Bayesian approach to statistical problems, though fruitful in many ways, has been rather unsuccessful in treating nonparametric problems. This is due primarily to the difficulty in finding workable prior distributions on the parameter space, which in nonparametric ploblems is taken to be a set of probability distributions on a given sample space. There are two desirable properties of a prior distribution for nonparametric problems. (I) The support of the prior distribution should be large--with respect to some suitable topology on the space of probability distributions on the sample space. (II) Posterior distributions given a sample of observations from the true probability distribution should be manageable analytically. These properties are antagonistic in the sense that one may be obtained at the expense of the other. This paper presents a class of prior distributions, called Dirichlet process priors, broad in the sense of (I), for which (II) is realized, and for which treatment of many nonparametric statistical problems may be carried out, yielding results that are comparable to the classical theory. In Section 2, we review the properties of the Dirichlet distribution needed for the description of the Dirichlet process given in Section 3. Briefly, this process may be described as follows. Let $\mathscr{X}$ be a space and $\mathscr{A}$ a $\sigma$-field of subsets, and let $\alpha$ be a finite non-null measure on $(\mathscr{X}, \mathscr{A})$. Then a stochastic process $P$ indexed by elements $A$ of $\mathscr{A}$, is said to be a Dirichlet process on $(\mathscr{X}, \mathscr{A})$ with parameter $\alpha$ if for any measurable partition $(A_1, \cdots, A_k)$ of $\mathscr{X}$, the random vector $(P(A_1), \cdots, P(A_k))$ has a Dirichlet distribution with parameter $(\alpha(A_1), \cdots, \alpha(A_k)). P$ may be considered a random probability measure on $(\mathscr{X}, \mathscr{A})$, The main theorem states that if $P$ is a Dirichlet process on $(\mathscr{X}, \mathscr{A})$ with parameter $\alpha$, and if $X_1, \cdots, X_n$ is a sample from $P$, then the posterior distribution of $P$ given $X_1, \cdots, X_n$ is also a Dirichlet process on $(\mathscr{X}, \mathscr{A})$ with a parameter $\alpha + \sum^n_1 \delta_{x_i}$, where $\delta_x$ denotes the measure giving mass one to the point $x$. In Section 4, an alternative definition of the Dirichlet process is given. This definition exhibits a version of the Dirichlet process that gives probability one to the set of discrete probability measures on $(\mathscr{X}, \mathscr{A})$. This is in contrast to Dubins and Freedman [2], whose methods for choosing a distribution function on the interval [0, 1] lead with probability one to singular continuous distributions. Methods of choosing a distribution function on [0, 1] that with probability one is absolutely continuous have been described by Kraft [7]. The general method of choosing a distribution function on [0, 1], described in Section 2 of Kraft and van Eeden [10], can of course be used to define the Dirichlet process on [0, 1]. Special mention must be made of the papers of Freedman and Fabius. Freedman [5] defines a notion of tailfree for a distribution on the set of all probability measures on a countable space $\mathscr{X}$. For a tailfree prior, posterior distribution given a sample from the true probability measure may be fairly easily computed. Fabius [3] extends the notion of tailfree to the case where $\mathscr{X}$ is the unit interval [0, 1], but it is clear his extension may be made to cover quite general $\mathscr{X}$. With such an extension, the Dirichlet process would be a special case of a tailfree distribution for which the posterior distribution has a particularly simple form. There are disadvantages to the fact that $P$ chosen by a Dirichlet process is discrete with probability one. These appear mainly because in sampling from a $P$ chosen by a Dirichlet process, we expect eventually to see one observation exactly equal to another. For example, consider the goodness-of-fit problem of testing the hypothesis $H_0$ that a distribution on the interval [0, 1] is uniform. If on the alternative hypothesis we place a Dirichlet process prior with parameter $\alpha$ itself a uniform measure on [0, 1], and if we are given a sample of size $n \geqq 2$, the only nontrivial nonrandomized Bayes rule is to reject $H_0$ if and only if two or more of the observations are exactly equal. This is really a test of the hypothesis that a distribution is continuous against the hypothesis that it is discrete. Thus, there is still a need for a prior that chooses a continuous distribution with probability one and yet satisfies properties (I) and (II). Some applications in which the possible doubling up of the values of the observations plays no essential role are presented in Section 5. These include the estimation of a distribution function, of a mean, of quantiles, of a variance and of a covariance. A two-sample problem is considered in which the Mann-Whitney statistic, equivalent to the rank-sum statistic, appears naturally. A decision theoretic upper tolerance limit for a quantile is also treated. Finally, a hypothesis testing problem concerning a quantile is shown to yield the sign test. In each of these problems, useful ways of combining prior information with the statistical observations appear. Other applications exist. In his Ph. D. dissertation [1], Charles Antoniak finds a need to consider mixtures of Dirichlet processes. He treats several problems, including the estimation of a mixing distribution, bio-assay, empirical Bayes problems, and discrimination problems.

/pdf/a-bayesian-analysis-of-some-nonparametric-problems-siibmg5pnf.pdf

A Bayesian Analysis of Some Nonparametric Problems

This book is intended as an introduction to optimal stochastic control for continuous time Markov processes and to the theory of viscosity solutions. The authors approach stochastic control problems by the method of dynamic programming. The text provides an introduction to dynamic programming for deterministic optimal control problems, as well as to the corresponding theory of viscosity solutions. A new Chapter X gives an introduction to the role of stochastic optimal control in portfolio optimization and in pricing derivatives in incomplete markets. Chapter VI of the First Edition has been completely rewritten, to emphasize the relationships between logarithmic transformations and risk sensitivity. A new Chapter XI gives a concise introduction to two-controller, zero-sum differential games. Also covered are controlled Markov diffusions and viscosity solutions of Hamilton-Jacobi-Bellman equations. The authors have tried, through illustrative examples and selective material, to connect stochastic control theory with other mathematical areas (e.g. large deviations theory) and with applications to engineering, physics, management, and finance. In this Second Edition, new material on applications to mathematical finance has been added. Concise introductions to risk-sensitive control theory, nonlinear H-infinity control and differential games are also included.

/pdf/controlled-markov-processes-and-viscosity-solutions-4n8p6ywj5v.pdf

Controlled Markov processes and viscosity solutions

(2002). Modelling Extremal Events for Insurance and Finance. Journal of the American Statistical Association: Vol. 97, No. 457, pp. 360-360.

Modelling Extremal Events for Insurance and Finance

Non-Gaussian processes of Ornstein–Uhlenbeck (OU) type offer the possibility of capturing important distributional deviations from Gaussianity and for flexible modelling of dependence structures. This paper develops this potential, drawing on and extending powerful results from probability theory for applications in statistical analysis. Their power is illustrated by a sustained application of OU processes within the context of finance and econometrics. We construct continuous time stochastic volatility models for financial assets where the volatility processes are superpositions of positive OU processes, and we study these models in relation to financial data and theory.

Non-Gaussian Ornstein–Uhlenbeck-based models and some of their uses in financial economics

/pdf/a-representation-of-independent-increment-processes-without-2wygqpubnd.pdf

A Representation of Independent Increment Processes without Gaussian Components

We consider a financial market model with two assets. One has deterministic rate of growth, while the rate of growth of the second asset is governed by a Brownian motion with drift. We can shift money from one asset to another; however, there are losses of money brokerage fees involved in shifting money from the risky to the nonrisky asset. We want to maximize the expected rate of growth of funds.

It is proved that an optimal policy keeps the ratio of funds in risky and nonrisky assets within a certain interval with minimal effort.

A Diffusion Model for Optimal Portfolio Selection in the Presence of Brokerage Fees

Toward a universal law of the iterated logarithm

Let S, be a sequence of partial sums of mean zero purely d-dimensional i.i.d. random vectors. Necessary and sufficient conditions are given for the existence of matrices An such that the transform of Sn by An is asymptotically multivariate normal with identity covariance matrix. This is more general than previous d-dimensional results. Examples are given to illustrate the need for the present approach. The matrices An take a particularly simple form because of a degree of uncorrelatedness between certain pairs of 1-dimensional random variables obtained by projection. 0. Introduction. For a sequence of independent and identically distributed (iLi.d.) 1-dimensional random variables Zi, not assumed to possess finite second moments, Levy and Feller obtained necessary and sufficient conditions for the existence of constants an such that i7 Zi/an converges weakly to the standard normal random variable. We are interested in the central limiting behavior of

/pdf/matrix-normalization-of-sums-of-random-vectors-in-the-domain-x6m9aja2hk.pdf

Matrix normalization of sums of random vectors in the domain of attraction of the multivariate normal

One-sided iterated logarithm laws of the form $\lim \sup (1/b_n) \sum^n_1 X_i = 1$, a.s. and $\lim \sup (1/b_n) \sum^n_1 X_i = -1$, a.s. are obtained for asymmetric independent and identically distributed random variables, the first when these have a vanishing but barely finite mean, the second when $E|X|$ is barely infinite. In both cases, $\lim \inf (1/b_n) \sum^n_1 X_i = -\infty$, a.s. The constants $b_n/n$ are slowly varying, decreasing to zero in the first case and increasing to infinity in the second. Although defined via the distribution of $|X|, b_n$ represents the order of magnitude of $E|\sum^n_1 X_i|$ when this is finite. Corresponding weak laws of large numbers are established and related to Feller's notion of "unfavorable fair games" and in the process a theorem playing the same role for the weak law as Feller's generalization of the strong law is proved.

/pdf/iterated-logarithm-laws-for-asymmetric-random-variables-4wd3x3mrqe.pdf

Michael J. Klass

Papers

A Representation of Independent Increment Processes without Gaussian Components

A Diffusion Model for Optimal Portfolio Selection in the Presence of Brokerage Fees

Toward a universal law of the iterated logarithm

Matrix normalization of sums of random vectors in the domain of attraction of the multivariate normal

Iterated Logarithm Laws for Asymmetric Random Variables Barely with or Without Finite Mean