Using Bayes to get the most out of non-significant results
Reads0
Chats0
TLDR
It is argued Bayes factors allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches, and provides a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive.Abstract:
No scientific conclusion follows automatically from a statistically non-significant result, yet people routinely use non-significant results to guide conclusions about the status of theories (or the effectiveness of practices). To know whether a non-significant result counts against a theory, or if it just indicates data insensitivity, researchers must use one of: power, intervals (such as confidence or credibility intervals), or else an indicator of the relative evidence for one theory over another, such as a Bayes factor. I argue Bayes factors allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches. Specifically, Bayes factors use the data themselves to determine their sensitivity in distinguishing theories (unlike power), and they make use of those aspects of a theory’s predictions that are often easiest to specify (unlike power and intervals, which require specifying the minimal interesting value in order to address theory). Bayes factors provide a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive. They allow accepting and rejecting the null hypothesis to be put on an equal footing. Concrete examples are provided to indicate the range of application of a simple online Bayes calculator, which reveal both the strengths and weaknesses of Bayes factors.read more
Citations
More filters
Journal ArticleDOI
Embedded interruptions and task complexity influence schema-related cognitive load progression in an abstract learning task
TL;DR: Different effects of the induced interruptions show up in conditions of task complexity, which indicate the activation of distinct cognitive mechanisms related to structural aspects of the task.
Dissertation
Communicated beliefs: The interplay of evidence and truth values in erroneous belief acquisition and maintenance
TL;DR: In this paper, the authors explore the role of early experiences in belief propagation in online networks and show that beliefs from credible sources show consolidation prior to initial evidence, subsuming its role.
Journal ArticleDOI
The consonant/vowel pattern determines the structure of orthographic representations in the left fusiform gyrus
TL;DR: The results confirm the hypothesis that the vowel-centred structure is extracted during the early phases of letter string processing and that it is encoded in left fusiform regions devoted to visual word recognition.
Journal ArticleDOI
Response Modality and the Stroop Task: Are there phonological Stroop effects with manual responses?
Benjamin A. Parris,Dinkar Sharma,Brendan S. Weekes,Mohammad Momenian,Maria Augustinova,Ludovic Ferrand +5 more
TL;DR: Investigation of whether response mode modifies phonological facilitation produced by the irrelevant word showed phoneme overlap leads to facilitation with both response modes, a result that is inconsistent with qualitative differences between the two response modes.
Journal ArticleDOI
Mechanisms of the breathing contribution to bodily self-consciousness in healthy humans: Lessons from machine-assisted breathing?
Sophie Betka,Elisa Canzoneri,Dan Adler,Bruno Herbelin,Javier Bello-Ruiz,Oliver Alan Kannape,Thomas Similowski,Olaf Blanke,Olaf Blanke +8 more
TL;DR: This work found that synchrony of visuo‐respiratory stimulation is also able to modulate BSC by increasing self‐location and breathing agency toward the virtual body, and further exploration of such findings might inform the development of respiratory therapeutic tools using VR in patients.
References
More filters
Book
Statistical Power Analysis for the Behavioral Sciences
TL;DR: The concepts of power analysis are discussed in this paper, where Chi-square Tests for Goodness of Fit and Contingency Tables, t-Test for Means, and Sign Test are used.
Book
Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach
TL;DR: The second edition of this book is unique in that it focuses on methods for making formal statistical inference from all the models in an a priori set (Multi-Model Inference).
Journal ArticleDOI
Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses.
TL;DR: In the new version, procedures to analyze the power of tests based on single-sample tetrachoric correlations, comparisons of dependent correlations, bivariate linear regression, multiple linear regression based on the random predictor model, logistic regression, and Poisson regression are added.
Journal ArticleDOI
Bayesian data analysis.
TL;DR: A fatal flaw of NHST is reviewed and some benefits of Bayesian data analysis are introduced and illustrative examples of multiple comparisons in Bayesian analysis of variance and Bayesian approaches to statistical power are presented.
Journal ArticleDOI
Power failure: why small sample size undermines the reliability of neuroscience
Katherine S. Button,John P. A. Ioannidis,Claire Mokrysz,Brian A. Nosek,Jonathan Flint,Emma S J Robinson,Marcus R. Munafò +6 more
TL;DR: It is shown that the average statistical power of studies in the neurosciences is very low, and the consequences include overestimates of effect size and low reproducibility of results.