Showing papers by "Russell A. Poldrack published in 2022"

Is Neuroscience FAIR? A Call for Collaborative Standardisation of Neuroscience Data

Abstract: In this perspective article, we consider the critical issue of data and other research object standardisation and, specifically, how international collaboration, and organizations such as the International Neuroinformatics Coordinating Facility (INCF) can encourage that emerging neuroscience data be Findable, Accessible, Interoperable, and Reusable (FAIR). As neuroscientists engaged in the sharing and integration of multi-modal and multiscale data, we see the current insufficiency of standards as a major impediment in the Interoperability and Reusability of research results. We call for increased international collaborative standardisation of neuroscience data to foster integration and efficient reuse of research objects.

NEMAR: an open access data, tools and compute resource operating on neuroelectromagnetic data

Abstract: Abstract To preserve scientific data created by publicly and/or philanthropically funded research projects and to make it ready for exploitation using recent and ongoing advances in advanced and large-scale computational modeling methods, publicly available data must use in common, now-evolving standards for formatting, identifying and annotating should share data. The OpenNeuro.org archive, built first as a repository for magnetic resonance imaging data based on the Brain Imaging Data Structure formatting standards, aims to house and share all types of human neuroimaging data. Here, we present NEMAR.org, a web gateway to OpenNeuro data for human neuroelectromagnetic data. NEMAR allows users to search through, visually explore and assess the quality of shared electroencephalography (EEG), magnetoencephalography and intracranial EEG data and then to directly process selected data using high-performance computing resources of the San Diego Supercomputer Center via the Neuroscience Gateway (nsgportal.org, NSG), a freely available web portal to high-performance computing serving a variety of neuroscientific analysis environments and tools. Combined, OpenNeuro, NEMAR and NSG form an efficient, integrated data, tools and compute resource for human neuroimaging data analysis and meta-analysis. Database URL: https://nemar.org

Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Data

Abstract: Self-supervised learning techniques are celebrating immense success in natural language processing (NLP) by enabling models to learn from broad language data at unprecedented scales. Here, we aim to leverage the success of these techniques for mental state decoding, where researchers aim to identify specific mental states (e.g., the experience of anger or joy) from brain activity. To this end, we devise a set of novel self-supervised learning frameworks for neuroimaging data inspired by prominent learning frameworks in NLP. At their core, these frameworks learn the dynamics of brain activity by modeling sequences of activity akin to how sequences of text are modeled in NLP. We evaluate the frameworks by pre-training models on a broad neuroimaging dataset spanning functional Magnetic Resonance Imaging data from 11,980 experimental runs of 1,726 individuals across 34 datasets, and subsequently adapting the pre-trained models to benchmark mental state decoding datasets. The pre-trained models transfer well, generally outperforming baseline models trained from scratch, while models trained in a learning framework based on causal language modeling clearly outperform the others.

Neuroscout, a unified platform for generalizable and reproducible fMRI research

Abstract: Functional magnetic resonance imaging (fMRI) has revolutionized cognitive neuroscience, but methodological barriers limit the generalizability of findings from the lab to the real world. Here, we present Neuroscout, an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout leverages state-of-the-art machine learning models to automatically annotate stimuli from dozens of naturalistic fMRI studies, allowing researchers to easily test neuroscientific hypotheses across multiple ecologically-valid datasets. In addition, Neuroscout builds on a robust ecosystem of open tools and standards to provide an easy-to-use analysis builder and a fully automated execution engine that reduce the burden of reproducible research. Through a series of meta-analytic case studies, we validate the automatic feature extraction approach and demonstrate its potential to support more robust fMRI research. Owing to its ease of use and a high degree of automation, Neuroscout makes it possible to overcome modeling challenges commonly arising in naturalistic analysis and to easily scale analyses within and across datasets, democratizing generalizable fMRI research.

Momentary Influences on Self-Regulation in Two Populations With Health Risk Behaviors: Adults Who Smoke and Adults Who Are Overweight and Have Binge-Eating Disorder

Abstract: Introduction Self-regulation has been implicated in health risk behaviors and is a target of many health behavior interventions. Despite most prior research focusing on self-regulation as an individual-level trait, we hypothesize that self-regulation is a time-varying mechanism of health and risk behavior that may be influenced by momentary contexts to a substantial degree. Because most health behaviors (e.g., eating, drinking, smoking) occur in the context of everyday activities, digital technologies may help us better understand and influence these behaviors in real time. Using a momentary self-regulation measure, the current study (which was part of a larger multi-year research project on the science of behavior change) used ecological momentary assessment (EMA) to assess if self-regulation can be engaged and manipulated on a momentary basis in naturalistic, non-laboratory settings. Methods This one-arm, open-label exploratory study prospectively collected momentary data for 14 days from 104 participants who smoked regularly and 81 participants who were overweight and had binge-eating disorder. Four times per day, participants were queried about momentary self-regulation, emotional state, and social and environmental context; recent smoking and exposure to smoking cues (smoking sample only); and recent eating, binge eating, and exposure to binge-eating cues (binge-eating sample only). This study used a novel, momentary self-regulation measure comprised of four subscales: momentary perseverance, momentary sensation seeking, momentary self-judgment, and momentary mindfulness. Participants were also instructed to engage with Laddr, a mobile application that provides evidence-based health behavior change tools via an integrated platform. The association between momentary context and momentary self-regulation was explored via mixed-effects models. Exploratory assessments of whether recent Laddr use (defined as use within 12 h of momentary responses) modified the association between momentary context and momentary self-regulation were performed via mixed-effects models. Results Participants (mean age 35.2; 78% female) in the smoking and binge-eating samples contributed a total of 3,233 and 3,481 momentary questionnaires, respectively. Momentary self-regulation subscales were associated with several momentary contexts, in the combined as well as smoking and binge-eating samples. For example, in the combined sample momentary perseverance was associated with location, positively associated with positive affect, and negatively associated with negative affect, stress, and tiredness. In the smoking sample, momentary perseverance was positively associated with momentary difficulty in accessing cigarettes, caffeine intake, and momentary restraint in smoking, and negatively associated with temptation and urge to smoke. In the binge-eating sample, momentary perseverance was positively associated with difficulty in accessing food and restraint in eating, and negatively associated with urge to binge eat. While recent Laddr use was not associated directly with momentary self-regulation subscales, it did modify several of the contextual associations, including challenging contexts. Conclusions Overall, this study provides preliminary evidence that momentary self-regulation may vary in response to differing momentary contexts in samples from two exemplar populations with risk behaviors. In addition, the Laddr application may modify some of these relationships. These findings demonstrate the possibility of measuring momentary self-regulation in a trans-diagnostic way and assessing the effects of momentary, mobile interventions in context. Health behavior change interventions may consider measuring and targeting momentary self-regulation in addition to trait-level self-regulation to better understand and improve health risk behaviors. This work will be used to inform a later stage of research focused on assessing the transdiagnostic mediating effect of momentary self-regulation on medical regimen adherence and health outcomes. Clinical Trial Registration ClinicalTrials.gov, Identifier: NCT03352713.

DeepDefacer: Automatic Removal of Facial Features via U-Net Image Segmentation

Abstract: Recent advancements in the field of magnetic resonance imaging (MRI) have enabled large-scale collaboration among clinicians and researchers for neuroimaging tasks. However, researchers are often forced to use outdated and slow software to anonymize MRI images for pub-lication. These programs specifically perform expensive mathematical operations over 3D images that rapidly slows down anonymization speed as an image’s volume increases in size. In this paper, we introduce DeepDefacer, an application of deep learning to MRI anonymization that uses a streamlined 3D U-Net network to mask facial regions in MRI images with a significant increase in speed over traditional de-identification software. We train DeepDefacer on MRI images from the Brain Development Organization (IXI) and International Consortium for Brain Mapping (ICBM) and quantitatively evaluate our model against a baseline 3D U-Net model with regards to Dice, recall, and precision scores. We also evaluate DeepDefacer against Pydeface, a traditional defacing application, with regards to speed on a range of CPU and GPU devices and qualitatively evaluate our model’s defaced output versus the ground truth images produced by Pydeface. We provide a link to a PyPi program at the end of this manuscript to encourage further research into the application of deep learning to MRI anonymization.

Comparing interpretation methods in mental state decoding analyses with deep learning models

Abstract: Deep learning (DL) models find increasing application in mental state decoding, where researchers seek to understand the mapping between mental states (e.g., perceiving fear or joy) and brain activity by identifying those brain regions (and networks) whose activity al-lows to accurately identify (i.e., decode) these states. Once a DL model has been trained to accurately decode a set of mental states, neuroimaging researchers often make use of interpretation methods from explainable artificial intelligence research to understand the model’s learned mappings between mental states and brain activity. Here, we compare the explanation performance of prominent interpretation methods in a mental state decoding analysis of three functional Magnetic Resonance Imaging (fMRI) datasets. Our findings demonstrate a gradient between two key characteristics of an explanation in mental state decoding, namely, its biological plausibility and faithfulness: interpretation methods with high explanation faithfulness, which capture the model’s decision process well, generally provide explanations that are biologically less plausible than the explanations of interpretation methods with less explanation faithfulness. Based on this finding, we provide specific recommendations for the application of interpretation methods in mental state decoding.

Addressing privacy risk in neuroscience data: from data protection to harm prevention

Abstract: Abstract A recent increase in the amount and availability of neuroscience data within and outside of research and clinical contexts will enhance reproducibility of neuroscience research leading to new discoveries on the mechanisms of brain function in healthy and disease states. However, the uniquely sensitive nature of neuroscience data raises critical concerns regarding data privacy. In response to these concerns, various policy and regulatory approaches have been proposed to control access to and disclosure of neuroscience data, but excessive restriction may hamper open science practice in the field. This article argues that it may now be time to expand the scope of regulatory discourse beyond protection of neuroscience data and to begin contemplating how to prevent potential harm. Legal prohibition of harmful use of neuroscience data could provide an ultimate safeguard against privacy risks and would help us chart a path toward protecting data subjects without unduly limiting the benefits of open science practice. Here we take the Genetic Information Non-Discrimination Act (GINA) as a reference for this new legislation and search for answers to the core regulatory questions based on what we have learned from the enactment of the GINA and the merits and weaknesses of the protection it provides.

Discovering dynamical models of human behavior

Abstract: Response time (RT) data collected from cognitive tasks are a cornerstone of psychology and neuroscience research, yet existing models of these data either make strong assumptions about the data generating process or are limited to modeling single trials. We introduce task-DyVA, a deep learning framework in which expressive dynamical systems are trained to reproduce sequences of RTs observed in data from individual human subjects. Models fitted to a large task-switching dataset captured subject-specific behavioral differences with high temporal precision, including task-switching costs. Through perturbation experiments and analyses of the models’ latent dynamics, we find support for a rational account of switch costs in terms of a stability-flexibility tradeoff. Thus, our framework can be used to discover interpretable cognitive theories that explain how the brain dynamically gives rise to behavior.

Quality control and nuisance regression of fMRI, looking out where signal should not be found

Abstract: Quality control of functional MRI data is essential as artifacts can have a critical impact on subsequent analysis. Yet, visual assessment of a dataset is tedious and time-consuming. By extending the carpet plot with the voxels located on a closed band (or “crown”) around the brain, we showed that fMRI data quality can be assessed more effectively. This new feature has been incorporated into MRIQC and fMRIPrep. In addition, a new nuisance regressor has been added to the latter, calculated from timeseries within this new “crown”.

Differentiable programming for functional connectomics

Abstract: Mapping the functional connectome has the potential to uncover key insights into brain organisation. However, existing workflows for functional connectomics are limited in their adaptability to new data, and principled workflow design is a challenging combinatorial problem. We introduce a new analytic paradigm and software toolbox that implements common operations used in functional connectomics as fully differentiable processing blocks. Under this paradigm, workflow configurations exist as reparameterisations of a differentiable functional that interpolates them. The differentiable program that we envision occupies a niche midway between traditional pipelines and end-to-end neural networks, combining the glass-box tractability and domain knowledge of the former with the amenability to optimisation of the latter. In this preliminary work, we provide a proof of concept for differentiable connectomics, demonstrating the capacity of our processing blocks both to recapitulate canonical knowledge in neuroscience and to make new discoveries in an unsupervised setting. Our differentiable modules are competitive with state-of-the-art methods in problem domains including functional parcellation, denoising, and covariance modelling. Taken together, our results and software demonstrate the promise of differentiable programming for functional connectomics.

Digital Commons@Becker Digital Commons@Becker Data sharing in neuroimaging research Data sharing in neuroimaging research

Abstract: Significant resources around the world have been invested in neuroimaging studies of brain function and disease. Easier access to this large body of work should have profound impact on research in cognitive neuroscience and psychiatry, leading to advances in the diagnosis and treatment of psychiatric and neurological disease. A trend toward increased sharing of neuroimaging data has emerged in recent years. Nevertheless, a number of barriers continue to impede momentum. Many researchers and institutions remain uncertain about how to share data or lack the tools and expertise to participate in data sharing. The use of electronic data capture (EDC) methods for neuroimaging greatly simplifies the task of data collection and has the potential to help standardize many aspects of data sharing. We review here the motivations for sharing neuroimaging data, the current data sharing landscape, and the sociological or technical barriers that still need to be addressed. The INCF Task Force on Neuroimaging Datasharing, in conjunction with several collaborative groups around the world, has started work on several tools to ease and eventually automate the practice of data sharing. It is hoped that such tools will allow researchers to easily share raw, processed, and derived neuroimaging data, with appropriate metadata and provenance records, and will improve the reproducibility of neuroimaging studies. By providing seamless integration of data sharing and analysis tools within a commodity research environment, the Task Force seeks to identify and minimize barriers to data sharing in the field of neuroimaging.

A dual-task approach to inform the taxonomy of inhibition-related processes.

Abstract: Response inhibition is key to controlled behavior and is commonly investigated with the stop-signal paradigm. The authors investigated how response inhibition is situated within a taxonomy of control processes by combining multiple forms of control within dual tasks. Response inhibition, as measured by stop-signal reaction time (SSRT), was impaired when combined with shape matching, but not the flanker task, and when combined with cued task switching, but not predictable task switching, suggesting that response inhibition may be weakly or variably impaired when combined with selective attention and set shifting demands, respectively. Response inhibition was also consistently impaired when combined with the N-back or directed forgetting tasks, putative measures of working memory. Impairments of response inhibition by other control demands appeared to be primarily driven by task context, as SSRT slowing was similar for trials where control demands were either high (e.g., task switch) or low (e.g., task stay). These results demonstrate that response inhibition processes are often impaired in the context of other control demands, even on trials where direct engagement of those other control processes is not required. This suggests a taxonomy of control in which response inhibition overlaps with related control processes, especially working memory. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Estimating the Time to Do Nothing: Toward Next-Generation Models of Response Inhibition

Abstract: Controlled behavior requires response inhibition, which is a cognitive function that involves withholding action as goals change. Response inhibition is often assessed using the stop-signal paradigm, in which participants respond to most stimuli but periodically withhold their response when a subsequent stop signal occurs. The stop-signal paradigm rests on the theoretical foundation of the independent race model, which assumes a stop racer that races independently against a go racer; behavior is determined by which racer finishes first. We highlight work showing violations of the keystone independence assumption of existing stop models and discuss promising new models of response inhibition.