scispace - formally typeset
Search or ask a question
Journal ArticleDOI

A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations

01 Dec 1952-Annals of Mathematical Statistics (Institute of Mathematical Statistics)-Vol. 23, Iss: 4, pp 493-507
TL;DR: In this paper, it was shown that the likelihood ratio test for fixed sample size can be reduced to this form, and that for large samples, a sample of size $n$ with the first test will give about the same probabilities of error as a sample with the second test.
Abstract: In many cases an optimum or computationally convenient test of a simple hypothesis $H_0$ against a simple alternative $H_1$ may be given in the following form. Reject $H_0$ if $S_n = \sum^n_{j=1} X_j \leqq k,$ where $X_1, X_2, \cdots, X_n$ are $n$ independent observations of a chance variable $X$ whose distribution depends on the true hypothesis and where $k$ is some appropriate number. In particular the likelihood ratio test for fixed sample size can be reduced to this form. It is shown that with each test of the above form there is associated an index $\rho$. If $\rho_1$ and $\rho_2$ are the indices corresponding to two alternative tests $e = \log \rho_1/\log \rho_2$ measures the relative efficiency of these tests in the following sense. For large samples, a sample of size $n$ with the first test will give about the same probabilities of error as a sample of size $en$ with the second test. To obtain the above result, use is made of the fact that $P(S_n \leqq na)$ behaves roughly like $m^n$ where $m$ is the minimum value assumed by the moment generating function of $X - a$. It is shown that if $H_0$ and $H_1$ specify probability distributions of $X$ which are very close to each other, one may approximate $\rho$ by assuming that $X$ is normally distributed.
Citations
More filters
Journal ArticleDOI
TL;DR: The analytical definitions of the Chernoff, Bhattacharyya and Jeffreys-Matusita probabilistic distances between two Dirichlet distributions and two Beta distributions are given and their inappropriateness is shown in the analytical case.

50 citations

Journal ArticleDOI
TL;DR: A simple greedy algorithm very frequently finds the Dodgson winners in such a way that it “knows” that it has found them, and furthermore the algorithm never incorrectly declares a nonwinner to be a winner.
Abstract: In the year 1876 the mathematician Charles Dodgson, who wrote fiction under the now more famous name of Lewis Carroll, devised a beautiful voting system that has long fascinated political scientists. However, determining the winner of a Dodgson election is known to be complete for the Θ2 p level of the polynomial hierarchy. This implies that unless P=NP no polynomial-time solution to this problem exists, and unless the polynomial hierarchy collapses to NP the problem is not even in NP. Nonetheless, we prove that when the number of voters is much greater than the number of candidates—although the number of voters may still be polynomial in the number of candidates—a simple greedy algorithm very frequently finds the Dodgson winners in such a way that it “knows” that it has found them, and furthermore the algorithm never incorrectly declares a nonwinner to be a winner.

50 citations

Journal ArticleDOI
TL;DR: The results demonstrate that the proposed extended canonical correlation analysis, E-CCA, already outperforms both CCA and its quasi-discriminative counterpart constrained CCA, for all values of their free parameters.
Abstract: In this paper we address the problem of matching sets of vectors embedded in the same input space. We propose an approach which is motivated by canonical correlation analysis (CCA), a statistical technique which has proven successful in a wide variety of pattern recognition problems. Like CCA when applied to the matching of sets, our extended canonical correlation analysis (E-CCA) aims to extract the most similar modes of variability within two sets. Our first major contribution is the formulation of a principled framework for robust inference of such modes from data in the presence of uncertainty associated with noise and sampling randomness. E-CCA retains the efficiency and closed form computability of CCA, but unlike it, does not possess free parameters which cannot be inferred directly from data (inherent data dimensionality, and the number of canonical correlations used for set similarity computation). Our second major contribution is to show that in contrast to CCA, E-CCA is readily adapted to match sets in a discriminative learning scheme which we call discriminative extended canonical correlation analysis (DE-CCA). Theoretical contributions of this paper are followed by an empirical evaluation of its premises on the task of face recognition from sets of rasterized appearance images. The results demonstrate that our approach, E-CCA, already outperforms both CCA and its quasi-discriminative counterpart constrained CCA (C-CCA), for all values of their free parameters. An even greater improvement is achieved with the discriminative variant, DE-CCA.

50 citations

Journal ArticleDOI
Yehuda Afek1
TL;DR: This work addresses the problem of electing a leader in an anonymous, asynchronous network of arbitrary topology with algorithms considerably simpler than known algorithms and have equal or improved communication complexity.
Abstract: We address the problem of electing a leader in an anonymous, asynchronous network of arbitrary topology Our algorithms are considerably simpler than known algorithms and have equal or improved communication complexity

50 citations

Journal ArticleDOI
TL;DR: In this paper, it was shown that both divergent high moments and dimension of the carrier occur in a simple example, which has been crafted for this purpose, and the effect is to allow either f or both f and α to be negative and the apparent anomalies are made into sources of new important information.
Abstract: “Divergence of high moments and dimension of the carrier” is the subtitle of Mandelbrot's 1974 seed paper on random multifractals. The key words “divergence” and “dimension” met very different fates. “Dimension” expanded into a multifractal formalism based on an exponent α and a function f(α). An excellent exposition in Halsey et al. 1986 helped this formalism flourish. But it does not allow divergent high moments and the related inequalities f(α)<0 and α<0. As a result, those possibilities did not flourish. Now their time has come for diverse reasons. The broad 1974 definitions of α and f allow α<0 and f(α)<0, but the original presentation demanded to be both developed and simplified. This paper shows that both multifractal anomalies occur in a very simple example, which has been crafted for this purpose. This example predicts the power law distribution. It generalizes α and f(α) beyond their usual roles of being a Holder exponent and a Hausdorff dimension. The effect is to allow either f or both f and α to be negative, and the apparent anomalies are made into sources of new important information. In addition, this paper substantially clarifies the subtle way in which randomness manifests itself in multifractals.

50 citations

References
More filters