scispace - formally typeset
Search or ask a question
Journal ArticleDOI

A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations

01 Dec 1952-Annals of Mathematical Statistics (Institute of Mathematical Statistics)-Vol. 23, Iss: 4, pp 493-507
TL;DR: In this paper, it was shown that the likelihood ratio test for fixed sample size can be reduced to this form, and that for large samples, a sample of size $n$ with the first test will give about the same probabilities of error as a sample with the second test.
Abstract: In many cases an optimum or computationally convenient test of a simple hypothesis $H_0$ against a simple alternative $H_1$ may be given in the following form. Reject $H_0$ if $S_n = \sum^n_{j=1} X_j \leqq k,$ where $X_1, X_2, \cdots, X_n$ are $n$ independent observations of a chance variable $X$ whose distribution depends on the true hypothesis and where $k$ is some appropriate number. In particular the likelihood ratio test for fixed sample size can be reduced to this form. It is shown that with each test of the above form there is associated an index $\rho$. If $\rho_1$ and $\rho_2$ are the indices corresponding to two alternative tests $e = \log \rho_1/\log \rho_2$ measures the relative efficiency of these tests in the following sense. For large samples, a sample of size $n$ with the first test will give about the same probabilities of error as a sample of size $en$ with the second test. To obtain the above result, use is made of the fact that $P(S_n \leqq na)$ behaves roughly like $m^n$ where $m$ is the minimum value assumed by the moment generating function of $X - a$. It is shown that if $H_0$ and $H_1$ specify probability distributions of $X$ which are very close to each other, one may approximate $\rho$ by assuming that $X$ is normally distributed.
Citations
More filters
Journal ArticleDOI
TL;DR: In this paper, the use of quantum resources at the receiver of a soft-aperture homodyne-detection LAser Detection And Ranging (LADAR) system is shown to afford significant improvement in the receiver's spatial resolution.
Abstract: The use of quantum resources—squeezed-vacuum injection (SVI) and noise-free phase-sensitive amplification (PSA)—at the receiver of a soft-aperture homodyne-detection LAser Detection And Ranging (LADAR) system is shown to afford significant improvement in the receiver's spatial resolution. This improvement originates from the potential for SVI to ameliorate the loss of high-spatial-frequency information about a target or target complex that is due to soft-aperture attenuation in the LADAR's entrance pupil, and the value of PSA in realizing that potential despite inefficiency in the LADAR's homodyne detection system. We show this improvement quantitatively by calculating lower error rates—in comparison with those of a standard homodyne detection system—for a one-target versus two-target hypothesis test. We also exhibit the effective signal-to-noise ratio (SNR) improvement provided by SVI and PSA in simulated imagery.

38 citations


Cites methods from "A Measure of Asymptotic Efficiency ..."

  • ...We also computed the Chernoff bound [20] on PE, but we found that this upper bound was not sufficiently tight in the PE regime of interest....

    [...]

Posted Content
TL;DR: In this paper, the authors introduce a probabilistic robustness measure for Bayesian Neural Networks (BNNs), defined as the probability that, given a test point, there exists a point within a bounded set such that the BNN prediction differs between the two.
Abstract: We introduce a probabilistic robustness measure for Bayesian Neural Networks (BNNs), defined as the probability that, given a test point, there exists a point within a bounded set such that the BNN prediction differs between the two. Such a measure can be used, for instance, to quantify the probability of the existence of adversarial examples. Building on statistical verification techniques for probabilistic models, we develop a framework that allows us to estimate probabilistic robustness for a BNN with statistical guarantees, i.e., with a priori error and confidence bounds. We provide experimental comparison for several approximate BNN inference techniques on image classification tasks associated to MNIST and a two-class subset of the GTSRB dataset. Our results enable quantification of uncertainty of BNN predictions in adversarial settings.

38 citations

Posted Content
TL;DR: In this article, the authors generalize Gittins indices to our non-bandit learning problem, and characterize when contrarian behavior arises: (i) while herds are still constrained efficient, they arise for a strictly smaller belief set, and (ii) individuals should lean more against their myopic preference for an action the more popular it becomes.
Abstract: We show that far from capturing a formally new phenomenon, informational herding is really a special case of single-person experimentation — and ‘bad herds’ the typical failure of complete learning. We then analyze the analogous team equilibrium, where individuals maximize the present discounted welfare of posterity. To do so, we generalize Gittins indices to our non-bandit learning problem, and thereby characterize when contrarian behaviour arises: (i) While herds are still constrained efficient, they arise for a strictly smaller belief set. () A log-concave log-likelihood ratio density robustly ensures that individuals should lean more against their myopic preference for an action the more popular it becomes.

37 citations


Cites background from "A Measure of Asymptotic Efficiency ..."

  • ...Chernoff (1952) interprets hypothesis acceptance or rejection as a bi-partition of the available information, and he studies the optimal such partition....

    [...]

Book ChapterDOI
03 Jan 2013
TL;DR: The Max-LPA algorithm proposed in this article is an instance of a class of community detection algorithms called label propagation algorithms (LPA), and it can correctly and quickly identify communities on clustered Erdos-Renyi graphs even when the clusters are much sparser.
Abstract: This paper initiates formal analysis of a simple, distributed algorithm for community detection on networks. We analyze an algorithm that we call Max-LPA, both in terms of its convergence time and in terms of the “quality” of the communities detected. Max-LPA is an instance of a class of community detection algorithms called label propagation algorithms. As far as we know, most analysis of label propagation algorithms thus far has been empirical in nature and in this paper we seek a theoretical understanding of label propagation algorithms. In our main result, we define a clustered version of Erdos-Renyi random graphs with clusters V 1, V 2, …, V k where the probability p, of an edge connecting nodes within a cluster V i is higher than p′, the probability of an edge connecting nodes in distinct clusters. We show that even with fairly general restrictions on p and p′ (\(p = \Omega\left(\frac{1}{n^{1/4-\epsilon}}\right)\) for any e > 0, p′ = O(p 2), where n is the number of nodes), Max-LPA detects the clusters V 1, V 2, …, V n in just two rounds. Based on this and on empirical results, we conjecture that Max-LPA can correctly and quickly identify communities on clustered Erdos-Renyi graphs even when the clusters are much sparser, i.e., with \(p = \frac{c\log n}{n}\) for some c > 1.

37 citations

Journal ArticleDOI
TL;DR: The utility of SomVarIUS is demonstrated by identifying somatic mutations in formalin-fixed samples, and tracking clonal dynamics of oncogenic mutations in targeted deep sequencing data from pre- and post-treatment leukemia samples.
Abstract: Motivation Somatic variant calling typically requires paired tumor-normal tissue samples. Yet, paired normal tissues are not always available in clinical settings or for archival samples. Results We present SomVarIUS, a computational method for detecting somatic variants using high throughput sequencing data from unpaired tissue samples. We evaluate the performance of the method using genomic data from synthetic and real tumor samples. SomVarIUS identifies somatic variants in exome-seq data of ∼150 × coverage with at least 67.7% precision and 64.6% recall rates, when compared with paired-tissue somatic variant calls in real tumor samples. We demonstrate the utility of SomVarIUS by identifying somatic mutations in formalin-fixed samples, and tracking clonal dynamics of oncogenic mutations in targeted deep sequencing data from pre- and post-treatment leukemia samples. Availability and implementation SomVarIUS is written in Python 2.7 and available at http://www.sjdlab.org/resources/ Contact subhajyoti.de@ucdenver.edu Supplementary information Supplementary data are available at Bioinformatics online.

37 citations

References
More filters