We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach, and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network (CNN), and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this work, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model's accuracy is comparable to state-of-the-art methods, while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time, and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines, while facilitating novel directions in learning-based registration and its applications. Our code is freely available at this http URL.

/pdf/voxelmorph-a-learning-framework-for-deformable-medical-image-4slzlz3vmh.pdf

VoxelMorph: A Learning Framework for Deformable Medical Image Registration

Dementia is increasingly being recognized in cases of Parkinson's disease (PD); such cases are termed PD dementia (PDD). The spread of fibrillar α-synuclein (α-syn) pathology from the brainstem to limbic and neocortical structures seems to be the strongest neuropathological correlate of emerging dementia in PD. In addition, up to 50% of patients with PDD also develop sufficient numbers of amyloid-β plaques and tau-containing neurofibrillary tangles for a secondary diagnosis of Alzheimer's disease, and these pathologies may act synergistically with α-syn pathology to confer a worse prognosis. An understanding of the relationships between these three distinct pathologies and their resultant clinical phenotypes is crucial for the development of effective disease-modifying treatments for PD and PDD.

Parkinson's disease dementia: convergence of α-synuclein, tau and amyloid-β pathologies

We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this paper, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model’s accuracy is comparable to the state-of-the-art methods while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines while facilitating novel directions in learning-based registration and its applications. Our code is freely available at https://github.com/voxelmorph/voxelmorph .

/pdf/voxelmorph-a-learning-framework-for-deformable-medical-image-5cdv6vi9wj.pdf

Brain stimulation, a therapy increasingly used for neurological and psychiatric disease, traditionally is divided into invasive approaches, such as deep brain stimulation (DBS), and noninvasive approaches, such as transcranial magnetic stimulation. The relationship between these approaches is unknown, therapeutic mechanisms remain unclear, and the ideal stimulation site for a given technique is often ambiguous, limiting optimization of the stimulation and its application in further disorders. In this article, we identify diseases treated with both types of stimulation, list the stimulation sites thought to be most effective in each disease, and test the hypothesis that these sites are different nodes within the same brain network as defined by resting-state functional-connectivity MRI. Sites where DBS was effective were functionally connected to sites where noninvasive brain stimulation was effective across diseases including depression, Parkinson9s disease, obsessive-compulsive disorder, essential tremor, addiction, pain, minimally conscious states, and Alzheimer’s disease. A lack of functional connectivity identified sites where stimulation was ineffective, and the sign of the correlation related to whether excitatory or inhibitory noninvasive stimulation was found clinically effective. These results suggest that resting-state functional connectivity may be useful for translating therapy between stimulation modalities, optimizing treatment, and identifying new stimulation targets. More broadly, this work supports a network perspective toward understanding and treating neuropsychiatric disease, highlighting the therapeutic potential of targeted brain network modulation.

https://www.pnas.org/content/pnas/111/41/E4367.full.pdf

Sophie Malloy

Papers

The Parkinson Progression Marker Initiative (PPMI)