Measuring inconsistency in meta-analyses
Reads0
Chats0
TLDR
A new quantity is developed, I 2, which the authors believe gives a better measure of the consistency between trials in a meta-analysis, which is susceptible to the number of trials included in the meta- analysis.Abstract:
Cochrane Reviews have recently started including the quantity I 2 to help readers assess the consistency of the results of studies in meta-analyses. What does this new quantity mean, and why is assessment of heterogeneity so important to clinical practice?
Systematic reviews and meta-analyses can provide convincing and reliable evidence relevant to many aspects of medicine and health care.1 Their value is especially clear when the results of the studies they include show clinically important effects of similar magnitude. However, the conclusions are less clear when the included studies have differing results. In an attempt to establish whether studies are consistent, reports of meta-analyses commonly present a statistical test of heterogeneity. The test seeks to determine whether there are genuine differences underlying the results of the studies (heterogeneity), or whether the variation in findings is compatible with chance alone (homogeneity). However, the test is susceptible to the number of trials included in the meta-analysis. We have developed a new quantity, I 2, which we believe gives a better measure of the consistency between trials in a meta-analysis.
Assessment of the consistency of effects across studies is an essential part of meta-analysis. Unless we know how consistent the results of studies are, we cannot determine the generalisability of the findings of the meta-analysis. Indeed, several hierarchical systems for grading evidence state that the results of studies must be consistent or homogeneous to obtain the highest grading.2–4
Tests for heterogeneity are commonly used to decide on methods for combining studies and for concluding consistency or inconsistency of findings.5 6 But what does the test achieve in practice, and how should the resulting P values be interpreted?
A test for heterogeneity examines the null hypothesis that all studies are evaluating the same effect. The usual test statistic …read more
Citations
More filters
Journal ArticleDOI
Role of Physical Activity and Sedentary Behavior in the Mental Health of Preschoolers, Children and Adolescents: A Systematic Review and Meta-Analysis.
María Rodriguez-Ayllon,Cristina Cadenas-Sanchez,Fernando Estévez-López,Fernando Estévez-López,Nicolas E Muñoz,Jose Mora-Gonzalez,Jairo H. Migueles,Pablo Molina-Garcia,Pablo Molina-Garcia,Hanna Henriksson,Hanna Henriksson,Alejandra Mena-Molina,Vicente Martínez-Vizcaíno,Vicente Martínez-Vizcaíno,Andrés Catena,Marie Löf,Marie Löf,Kirk I. Erickson,David R. Lubans,Francisco B. Ortega,Francisco B. Ortega,Irene Esteban-Cornejo,Irene Esteban-Cornejo +22 more
TL;DR: Findings from the meta-analysis suggest that physical activity interventions can improve adolescents’ mental health, but additional studies are needed to confirm the effects of physical activity on children’s mental health.
Journal ArticleDOI
Influence of Resistance Exercise on Lean Body Mass in Aging Adults: A Meta-Analysis
TL;DR: Findings suggest that RE participation earlier in life may provide superior effectiveness, and RE is effective for eliciting gains in LBM among aging adults, particularly with higher-volume programs.
Journal ArticleDOI
Conducting quantitative synthesis when comparing medical interventions: AHRQ and the Effective Health Care Program
Rongwei Fu,Gerald Gartlehner,Mark D Grant,Tatyana Shamliyan,Art Sedrakyan,Timothy J Wilt,Lauren Griffith,Mark Oremus,Parminder Raina,Afisi S. Ismaila,Pasqualina Santaguida,Joseph Lau,Thomas A Trikalinos +12 more
TL;DR: Recommendations for conducting quantitative synthesis, or meta-analysis, using study-level data in comparative effectiveness reviews (CERs) for the Evidence-based Practice Center (EPC) program of the Agency for Healthcare Research and Quality are established.
Journal ArticleDOI
How Effective Were Lifestyle Interventions In Real-World Settings That Were Modeled On The Diabetes Prevention Program?
TL;DR: It is concluded that costs associated with diabetes prevention can be lowered without sacrificing effectiveness, using nonmedical personnel and motivating higher attendance at program sessions.
Journal ArticleDOI
Efficacy Comparison of 16 Interventions for Myopia Control in Children: A Network Meta-analysis
Jinhai Huang,Jinhai Huang,Daizong Wen,Qinmei Wang,Qinmei Wang,Colm McAlinden,Colm McAlinden,Colm McAlinden,Ian Flitcroft,Haisi Chen,Haisi Chen,Seang-Mei Saw,Hao Chen,Fangjun Bao,Fangjun Bao,Yun-e Zhao,Yun-e Zhao,Liang Hu,Liang Hu,Xuexi Li,Rongrong Gao,Rongrong Gao,Weicong Lu,Weicong Lu,Yaoqiang Du,Zhengxuan Jinag,A-Yong Yu,A-Yong Yu,Hengli Lian,Qiuruo Jiang,Qiuruo Jiang,Ye Yu,Ye Yu,Jia Qu,Jia Qu +34 more
TL;DR: It is indicated that a range of interventions can significantly reduce myopia progression when compared with single vision spectacle lenses or placebo, and pharmacologic interventions, that is, muscarinic antagonists such as atropine and pirenzepine were effective.
References
More filters
Journal ArticleDOI
Quantifying heterogeneity in a meta‐analysis
TL;DR: It is concluded that H and I2, which can usually be calculated for published meta-analyses, are particularly useful summaries of the impact of heterogeneity, and one or both should be presented in publishedMeta-an analyses in preference to the test for heterogeneity.
Journal ArticleDOI
The combination of estimates from different experiments.
TL;DR: The problem of making a combined estimate has been discussed previously by Cochran and Yates and Cochran (1937) for agricultural experiments, and by Bliss (1952) for bioassays in different laboratories as discussed by the authors.
Journal ArticleDOI
Tamoxifen for early breast cancer: An overview of the randomised trials
TL;DR: The absolute improvement in recurrence was greater during the first 5 years, whereas the improvement in survival grew steadily larger throughout the first 10 years, and these benefits appeared to be largely irrespective of age, menopausal status, daily tamoxifen dose, and of whether chemotherapy had been given to both groups.
Journal Article
Tamoxifen for early breast cancer: an overview of the randomised trials. Early Breast Cancer Trialists' Collaborative Group
TL;DR: There have been many randomised trials of adjuvant tamoxifen among women with early breast cancer, and an updated overview of their results is presented in this paper, which approximately doubles the amount of evidence from trials of about 5 years of tamoxifier and, taking all trials together, on events occurring more than 5 years after randomisation.
Journal ArticleDOI
Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis.
TL;DR: In this paper, the authors evaluated standard error, precision (inverse of standard error), variance, inverse of variance, sample size and log sample size (vertical axis) and log odds ratio, log risk ratio and risk difference (horizontal axis).