scispace - formally typeset
Open AccessJournal ArticleDOI

A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations

Herman Chernoff
- 01 Dec 1952 - 
- Vol. 23, Iss: 4, pp 493-507
TLDR
In this paper, it was shown that the likelihood ratio test for fixed sample size can be reduced to this form, and that for large samples, a sample of size $n$ with the first test will give about the same probabilities of error as a sample with the second test.
Abstract
In many cases an optimum or computationally convenient test of a simple hypothesis $H_0$ against a simple alternative $H_1$ may be given in the following form. Reject $H_0$ if $S_n = \sum^n_{j=1} X_j \leqq k,$ where $X_1, X_2, \cdots, X_n$ are $n$ independent observations of a chance variable $X$ whose distribution depends on the true hypothesis and where $k$ is some appropriate number. In particular the likelihood ratio test for fixed sample size can be reduced to this form. It is shown that with each test of the above form there is associated an index $\rho$. If $\rho_1$ and $\rho_2$ are the indices corresponding to two alternative tests $e = \log \rho_1/\log \rho_2$ measures the relative efficiency of these tests in the following sense. For large samples, a sample of size $n$ with the first test will give about the same probabilities of error as a sample of size $en$ with the second test. To obtain the above result, use is made of the fact that $P(S_n \leqq na)$ behaves roughly like $m^n$ where $m$ is the minimum value assumed by the moment generating function of $X - a$. It is shown that if $H_0$ and $H_1$ specify probability distributions of $X$ which are very close to each other, one may approximate $\rho$ by assuming that $X$ is normally distributed.

read more

Citations
More filters
Journal ArticleDOI

A survey of randomized algorithms for control synthesis and performance verification

TL;DR: An overview of probabilistic techniques based on randomized algorithms for solving ''hard'' problems arising in performance verification and control of complex systems and permits overcoming the fundamental tradeoff between numerical complexity and conservatism.
Journal ArticleDOI

A probabilistic framework for problems with real structured uncertainty in systems and control

TL;DR: The problem of generation of real random matrix samples with uniform distribution in structured (spectral) norm bounded sets is studied and an efficient (i.e. polynomial-time) algorithm for their generation is studied.
Journal ArticleDOI

Large Deviation Bounds for Markov Chains

TL;DR: An exponential bound on the probability that a Markov chain exceeds its expectation by a constant factor is given, which is asymptotically optimal for a certain class of Markov chains and presented an application to the leader election problem.
Journal ArticleDOI

The Moment Bound is Tighter than Chernoff's Bound for Positive Tail Probabilities

TL;DR: It is shown that for all positive t and for all distributions, the moment bound is tighter than Chernoff's bound.
Journal ArticleDOI

Trading quantum for classical resources in quantum data compression

TL;DR: This theorem provides a type of dual to Holevo's theorem, insofar as the latter characterizes the cost of coding classical bits into qubits.
References
More filters