Reproducibility of R-fMRI metrics on the impact of different strategies for multiple comparison correction and sample sizes.
Xiao Chen,Bin Lu,Chao-Gan Yan +2 more
Reads0
Chats0
TLDR
This comprehensively assessed two aspects of reproducibility, test–retest reliability and replicability, on widely used R‐fMRI metrics in both between‐subject contrasts of sex differences and within‐subject comparisons of eyes‐open and eyes‐closed conditions, finding reliability, sensitivity and positive predictive value (PPV) rose as sample size increased.Abstract:
Concerns regarding reproducibility of resting-state functional magnetic resonance imaging (R-fMRI) findings have been raised. Little is known about how to operationally define R-fMRI reproducibility and to what extent it is affected by multiple comparison correction strategies and sample size. We comprehensively assessed two aspects of reproducibility, test-retest reliability and replicability, on widely used R-fMRI metrics in both between-subject contrasts of sex differences and within-subject comparisons of eyes-open and eyes-closed (EOEC) conditions. We noted permutation test with Threshold-Free Cluster Enhancement (TFCE), a strict multiple comparison correction strategy, reached the best balance between family-wise error rate (under 5%) and test-retest reliability/replicability (e.g., 0.68 for test-retest reliability and 0.25 for replicability of amplitude of low-frequency fluctuations (ALFF) for between-subject sex differences, 0.49 for replicability of ALFF for within-subject EOEC differences). Although R-fMRI indices attained moderate reliabilities, they replicated poorly in distinct datasets (replicability < 0.3 for between-subject sex differences, < 0.5 for within-subject EOEC differences). By randomly drawing different sample sizes from a single site, we found reliability, sensitivity and positive predictive value (PPV) rose as sample size increased. Small sample sizes (e.g., < 80 [40 per group]) not only minimized power (sensitivity < 2%), but also decreased the likelihood that significant results reflect "true" effects (PPV < 0.26) in sex differences. Our findings have implications for how to select multiple comparison correction strategies and highlight the importance of sufficiently large sample sizes in R-fMRI studies to enhance reproducibility. Hum Brain Mapp 39:300-318, 2018. © 2017 Wiley Periodicals, Inc.read more
Citations
More filters
Journal ArticleDOI
Reduced default mode network functional connectivity in patients with recurrent major depressive disorder.
Chao-Gan Yan,Xiao Chen,Le Li,Francisco X. Castellanos,Tongjian Bai,Qijing Bo,Jun Cao,Guanmao Chen,Ning-Xuan Chen,Wei Chen,Chang Cheng,Yu-Qi Cheng,Xi-Long Cui,Jia Duan,Yiru Fang,Qiyong Gong,Wenbin Guo,Zheng-Hua Hou,Lan Hu,Li Kuang,Feng Li,Kaiming Li,Tao Li,Yan-Song Liu,Zhening Liu,Yi-Cheng Long,Qing-Hua Luo,Hua-Qing Meng,Daihui Peng,Hai-Tang Qiu,Jiang Qiu,Yue-Di Shen,Yu-Shu Shi,Chuanyue Wang,Fei Wang,Kai Wang,Li Wang,Xiang Wang,Ying Wang,Xiao-Ping Wu,Xinran Wu,Chunming Xie,Guangrong Xie,Hai-Yan Xie,Peng Xie,Xiufeng Xu,Hong Yang,Jian Yang,Jia-Shu Yao,Shu-Qiao Yao,Yingying Yin,Yonggui Yuan,Aixia Zhang,Hong Zhang,Kerang Zhang,Lei Zhang,Zhijun Zhang,Ru-Bai Zhou,Yi-Ting Zhou,Jun-Juan Zhu,Chao-Jie Zou,Tian-Mei Si,Xi-Nian Zuo,Jing-Ping Zhao,Yu-Feng Zang +64 more
TL;DR: It is found that default mode network functional connectivity remains a prime target for understanding the pathophysiology of depression, with particular relevance to revealing mechanisms of effective treatments, and reduced rather than increased FC within the DMN is found.
Journal ArticleDOI
More than just statics: temporal dynamics of intrinsic brain activity predicts the suicidal ideation in depressed patients.
TL;DR: Findings suggest that alterations of temporal variability in regions involved in executive and emotional processing are associated with SI in MDD patients, and a novel predictive model using the dynamics of iBA could be useful in developing neuromarkers for clinical applications.
Journal ArticleDOI
Disrupted structural and functional brain networks in Alzheimer's disease.
Zhengjia Dai,Zhengjia Dai,Qixiang Lin,Qixiang Lin,Tao Li,Xiao Wang,Huishu Yuan,Xin Yu,Yong He,Yong He,Huali Wang +10 more
TL;DR: Overlap and distinct network disruptions in the FCN and SCN and a strengthened correlation between FCNs and SCNs in AD are demonstrated, which provides a novel perspective for understanding the pathophysiological mechanisms underlying AD.
Journal ArticleDOI
Mind-body exercise improves cognitive function and modulates the function and structure of the hippocampus and anterior cingulate cortex in patients with mild cognitive impairment.
Jing Tao,Jiao Liu,Xiangli Chen,Rui Xia,Moyi Li,Maomao Huang,Shuzhen Li,Joel Park,Georgia Wilson,Courtney Lang,Guanli Xie,Binlong Zhang,Guohua Zheng,Lidian Chen,Jian Kong +14 more
TL;DR: The results demonstrate the potential of Baduanjin for the treatment of MCI and show decreased ALFF value changes in the right hippocampus and bilateral ACC were significantly associated with corresponding MoCA score changes across all groups.
Journal ArticleDOI
Disrupted functional connectivity within the default mode network and salience network in unmedicated bipolar II disorder.
Jiaying Gong,Guanmao Chen,Yanbin Jia,Shuming Zhong,Lianping Zhao,Xiaomei Luo,Shaojuan Qiu,Shunkai Lai,Zhangzhang Qi,Li Huang,Ying Wang +10 more
TL;DR: The findings suggest that disrupted FC is located in the DMN and SN, especially in the PCC‐mPFC and precuneus/PCC, and sgACC‐ITG connectivity in BD II patients.
References
More filters
Journal ArticleDOI
Intraclass correlations: uses in assessing rater reliability.
TL;DR: In this article, the authors present guidelines for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges, and the confidence intervals for each of the forms are reviewed.
Journal ArticleDOI
Improved optimization for the robust and accurate linear registration and motion correction of brain images
Journal ArticleDOI
Functional connectivity in the motor cortex of resting human brain using echo-planar MRI.
TL;DR: It is concluded that correlation of low frequency fluctuations, which may arise from fluctuations in blood oxygenation or flow, is a manifestation of functional connectivity of the brain.
Journal ArticleDOI
The human brain is intrinsically organized into dynamic, anticorrelated functional networks
Michael D. Fox,Abraham Z. Snyder,Justin L. Vincent,Maurizio Corbetta,David C. Van Essen,Marcus E. Raichle +5 more
TL;DR: It is suggested that both task-driven neuronal responses and behavior are reflections of this dynamic, ongoing, functional organization of the brain, featuring the presence of anticorrelated networks in the absence of overt task performance.
Journal ArticleDOI
A fast diffeomorphic image registration algorithm
TL;DR: DARTEL has been applied to intersubject registration of 471 whole brain images, and the resulting deformations were evaluated in terms of how well they encode the shape information necessary to separate male and female subjects and to predict the ages of the subjects.
Related Papers (5)
DPABI: Data Processing & Analysis for (Resting-State) Brain Imaging.
DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI
Yan Chao-Gan,Zang Yu-Feng +1 more