Open Access
Robust misinterpretation of confidence intervals
Reads0
Chats0
TLDR
Although all six statements were false, both researchers and students endorsed, on average, more than three statements, indicating a gross misunderstanding of CIs, which suggests that many researchers do not know the correct interpretation of a CI.Abstract:
Null hypothesis significance testing (NHST) is undoubtedly the most common inferential technique used to justify claims in the social sciences. However, even staunch defenders of NHST agree that its outcomes are often misinterpreted. Confidence intervals (CIs) have frequently been proposed as a more useful alternative to NHST, and their use is strongly encouraged in the APA Manual. Nevertheless, little is known about how researchers interpret CIs. In this study, 120 researchers and 442 students—all in the field of psychology—were asked to assess the truth value of six particular statements involving different interpretations of a CI. Although all six statements were false, both researchers and students endorsed, on average, more than three statements, indicating a gross misunderstanding of CIs. Self-declared experience with statistics was not related to researchers’ performance, and, even more surprisingly, researchers hardly outperformed the students, even though the students had not received any education on statistical inference whatsoever. Our findings suggest that many researchers do not know the correct interpretation of a CI. The misunderstandings surrounding p-values and CIs are particularly unfortunate because they constitute the main tools by which psychologists draw conclusions from data.read more
Citations
More filters
Journal ArticleDOI
Perceived Statistical Knowledge Level and Self-Reported Statistical Practice Among Academic Psychologists
Laura Badenes-Ribera,Dolores Frias-Navarro,Nathalie O. Iotti,Amparo Bonilla-Campos,Claudio Longobardi +4 more
TL;DR: The results showed that, although the use of effect size estimates is becoming generalized, an under-reporting of CIs for ES persists, and academics with higher-level knowledge about ES statistics seem to have a profile closer to good statistical practices.
Journal ArticleDOI
Conflicts in Bayesian Statistics Between Inference Based on Credible Intervals and Bayes Factors
TL;DR: In this article, the authors show that point-null hypothesis testing based on Bayes factor may lead to an opposite conclusion if it is based on the Bayesian credible interval, which is not the case in the domain of Bayesian framework.
Journal ArticleDOI
Die Vertrauenskrise empirischer Forschung in der Psychologie
Geoffrey Schweizer,Philip Furley +1 more
TL;DR: In this paper, aktuell eine Vertrauenskrise der psychologischen Forschung postuliert wird, e.g., Researcher Degrees of Freedom, kleine Stichprobengrosen, Analyse-and Publikationspraktiken.
Journal ArticleDOI
Bayesian estimation of explained variance in ANOVA designs.
TL;DR: This work provides the expressions for the squared multiple, semipartial, and partial correlation coefficients corresponding to four commonly used analysis‐of‐variance designs and illustrates their contribution with two worked examples.
Journal ArticleDOI
Conceptual Knowledge of Confidence Intervals in Psychology Undergraduate and Graduate Students.
TL;DR: In this paper, the authors assessed conceptual knowledge of confidence intervals in undergraduate and graduate psychology students and found that CIs were difficult and prone to misconceptions for both groups, and connecting CIs to estimation and sample mean concepts was associated with greater conceptual knowledge.
References
More filters
Journal ArticleDOI
The earth is round (p < .05)
TL;DR: The authors reviewed the problems with null hypothesis significance testing, including near universal misinterpretation of p as the probability that H is false, the misinterpretation that its complement is the probability of successful replication, and the mistaken assumption that if one rejects H₀ one thereby affirms the theory that led to the test.
Journal ArticleDOI
Statistical Methods in Psychology Journals: Guidelines and Explanations
TL;DR: The Task Force on Statistical Inference (TFSI) of the American Psychological Association (APA) as discussed by the authors was formed to discuss the application of significance testing in psychology journals and its alternatives, including alternative underlying models and data transformation.
Journal ArticleDOI
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
John M. Hoenig,Dennis M. Heisey +1 more
TL;DR: The problem of post-experiment power calculation is discussed in this paper. But, the problem is extensive and present arguments to demonstrate the flaw in the logic, which is fundamentally flawed.
Journal ArticleDOI
Publication Manual of the American Psychological AssociationPublication Manual of the American Psychological Association.
Kate E Decleene,Jennifer L. Fogo +1 more
TL;DR: The book provides stronger standards for maintaining the participant confidentiality and for reducing bias in language describing participants and suggests that researchers avoid the use of derogatory language such as using “minority” for “non-white” populations.
Book
Introduction to Probability and Statistics
TL;DR: The twelve edition of the Introduction to Probability and Statistics (INTRODUCTION TO PROBABILITY and STATISTICS) as discussed by the authors has been used by hundreds of thousands of students since its first edition.