Pseudoreplication and the Design of Ecological Field Experiments

TLDR: Suggestions are offered to statisticians and editors of ecological journals as to how ecologists' under- standing of experimental design and statistics might be improved.

Abstract: Pseudoreplication is defined. as the use of inferential statistics to test for treatment effects with data from experiments where either treatments are not replicated (though samples may be) or replicates are not statistically independent. In ANOVA terminology, it is the testing for treatment effects with an error term inappropriate to the hypothesis being considered. Scrutiny of 176 experi- mental studies published between 1960 and the present revealed that pseudoreplication occurred in 27% of them, or 48% of all such studies that applied inferential statistics. The incidence of pseudo- replication is especially high in studies of marine benthos and small mammals. The critical features of controlled experimentation are reviewed. Nondemonic intrusion is defined as the impingement of chance events on an experiment in progress. As a safeguard against both it and preexisting gradients, interspersion of treatments is argued to be an obligatory feature of good design. Especially in small experiments, adequate interspersion can sometimes be assured only by dispensing with strict random- ization procedures. Comprehension of this conflict between interspersion and randomization is aided by distinguishing pre-layout (or conventional) and layout-specifit alpha (probability of type I error). Suggestions are offered to statisticians and editors of ecological j oumals as to how ecologists' under- standing of experimental design and statistics might be improved.