Methods of evaluating and comparing the performance of diagnostic tests are of increasing importance as new tests are developed and marketed. When a test is based on an observed variable that lies on a continuous or graded scale, an assessment of the overall value of the test can be made through the use of a receiver operating characteristic (ROC) curve. The curve is constructed by varying the cutpoint used to determine which values of the observed variable will be considered abnormal and then plotting the resulting sensitivities against the corresponding false positive rates. When two or more empirical curves are constructed based on tests performed on the same individuals, statistical analysis on differences between curves must take into account the correlated nature of the data. This paper presents a nonparametric approach to the analysis of areas under correlated ROC curves, by using the theory on generalized U-statistics to generate an estimated covariance matrix.

Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.

THE DESIGN AND ANALYSIS OF EXPERIMENTS. By Oscar Kempthorne. New York, John Wiley and Sons, Inc., 1952. 631 pp. $8.50. This book by a teacher of statistics (as well as a consultant for \"experimenters\") is a comprehensive study of the philosophical background for the statistical design of experiment. It is necessary to have some facility with algebraic notation and manipulation to be able to use the volume intelligently. The problems are presented from the theoretical point of view, without such practical examples as would be helpful for those not acquainted with mathematics. The mathematical justification for the techniques is given. As a somewhat advanced treatment of the design and analysis of experiments, this volume will be interesting and helpful for many who approach statistics theoretically as well as practically. With emphasis on the \"why,\" and with description given broadly, the author relates the subject matter to the general theory of statistics and to the general problem of experimental inference. MARGARET J. ROBERTSON

The Design and Analysis of Experiments

An essential textbook for any student or researcher in biology needing to design experiments, sample programs or analyse the resulting data The text begins with a revision of estimation and hypothesis testing methods, covering both classical and Bayesian philosophies, before advancing to the analysis of linear and generalized linear models Topics covered include linear and logistic regression, simple and complex ANOVA models (for factorial, nested, block, split-plot and repeated measures and covariance designs), and log-linear models Multivariate techniques, including classification and ordination, are then introduced Special emphasis is placed on checking assumptions, exploratory data analysis and presentation of results The main analyses are illustrated with many examples from published papers and there is an extensive reference list to both the statistical and biological literature The book is supported by a website that provides all data sets, questions for each chapter and links to software

/pdf/experimental-design-and-data-analysis-for-biologists-8ybva8d53x.pdf

Experimental Design and Data Analysis for Biologists

Benjamini and Hochberg suggest that the false discovery rate may be the appropriate error rate to control in many applied multiple testing problems. A simple procedure was given there as an FDR controlling procedure for independent test statistics and was shown to be much more powerful than comparable procedures which control the traditional familywise error rate. We prove that this same procedure also controls the false discovery rate when the test statistics have positive regression dependency on each of the test statistics corresponding to the true null hypotheses. This condition for positive dependency is general enough to cover many problems of practical interest, including the comparisons of many treatments with a single control, multivariate normal test statistics with positive correlation matrix and multivariate $t$. Furthermore, the test statistics may be discrete, and the tested hypotheses composite without posing special difficulties. For all other forms of dependency, a simple conservative modification of the procedure controls the false discovery rate. Thus the range of problems for which a procedure with proven FDR control can be offered is greatly increased.

/pdf/the-control-of-the-false-discovery-rate-in-multiple-testing-426hrdkyhb.pdf

The control of the false discovery rate in multiple testing under dependency

The least squares estimator of a regression coefficient β is vulnerable to gross errors and the associated confidence interval is, in addition, sensitive to non-normality of the parent distribution. In this paper, a simple and robust (point as well as interval) estimator of β based on Kendall's [6] rank correlation tau is studied. The point estimator is the median of the set of slopes (Yj - Yi )/(tj-ti ) joining pairs of points with ti ≠ ti , and is unbiased. The confidence interval is also determined by two order statistics of this set of slopes. Various properties of these estimators are studied and compared with those of the least squares and some other nonparametric estimators.

Estimates of the Regression Coefficient Based on Kendall's Tau

Publisher Summary The individuals or the experimental units constituting the sample in a study do not enter into the scheme all at the same point of time. For example, in a clinical trial intended for studying the effectiveness of two competing drugs for a particular treatment, patients undergoing the treatment are allotted to one of the drugs and statistical conclusions are drawn on the basis of the responses of these drugs. As is the case with many infrequently occurring diseases, there might not be a steady flow of arrivals of patients in the clinic for the particular treatment, so that the recruitment of the desired number of patients in the clinical trial might require a considerable amount of waiting time. On the other hand, drawing a reliable and valid statistical inference in such a case requires setting a target sample size on which to base the statistical tests. A terminal test based on the target sample size might involve a considerable amount of waiting time before it can be administered. From time and cost considerations, under such a sequential entry plan of experimental units in the scheme, it might be advisable to monitor the experiment from the beginning with the objective of a possible early statistical decision.

Nonparametric Repeated Significance Tests

A class of permutation tests based on appropriate U-statistics is proposed for the multisample location, scale, and association problems. These U-statistics need not be functions solely of the ranks of the different sample observations and for the application of the tests the parent distributions need not be continuous. The proposed tests are based on the existence of some equally likely permutations of the sample observations and are valid for small as well as large sample sizes. Further, the underlying permutation principle yields optimum estimators of the variances and covariances of U-statistics entering into the expressions for the test statistics. The large sample test procedure is thereby simplified. This paper consists partly of expository material and partly of extensions of some allied two-sample results, considered earlier by the author (Sen [28]).

On Some Multisample Permutation Tests Based on a Class of U-Statistics

Permutational Central Limit Theorems

Distribution theory of rank statistics: Distribution Theory of Linear Rank-Order Statistics Distribution Theory of Signed Rank Order Statistics Distribution Theory of Multivariate Linear Rank-Order Statistics Nonparametric inference in linear models: Distribution-Free Rank-Order Tests for Some Linear Hypotheses Rank-Order Estimation Theory in Some Linear Models Asymptotically Distribution-Free Aligned Rank- Order Tests for Some General Linear Hypotheses Rank-Order Tests for Miscellaneous Problems in Linear Models Appendix.

Pranab Kumar Sen

Papers

Nonparametric Repeated Significance Tests

On Some Multisample Permutation Tests Based on a Class of U-Statistics

Permutational Central Limit Theorems

Nonparametric Methods in General Linear Models.

Asymptotically optimal sequential estimation of regular functionals of several distributions based on generalized U-statistics☆