Automated cardiovascular magnetic resonance image analysis with fully convolutional networks
Wenjia Bai,Matthew Sinclair,Giacomo Tarroni,Ozan Oktay,Martin Rajchl,Ghislain Vaillant,Aaron M. Lee,Nay Aung,Elena Lukaschuk,Mihir M. Sanghvi,Filip Zemrak,Kenneth Fung,José Miguel Paiva,Valentina Carapella,Young Jin Kim,Hideaki Suzuki,Bernhard Kainz,Paul M. Matthews,Steffen E. Petersen,Stefan K. Piechnik,Stefan Neubauer,Ben Glocker,Daniel Rueckert +22 more
Reads0
Chats0
TLDR
An automated analysis method based on a fully convolutional network achieves a performance on par with human experts in analysing CMR images and deriving clinically relevant measures.Abstract:
Cardiovascular resonance (CMR) imaging is a standard imaging modality for assessing cardiovascular diseases (CVDs), the leading cause of death globally. CMR enables accurate quantification of the cardiac chamber volume, ejection fraction and myocardial mass, providing information for diagnosis and monitoring of CVDs. However, for years, clinicians have been relying on manual approaches for CMR image analysis, which is time consuming and prone to subjective errors. It is a major clinical challenge to automatically derive quantitative and clinically relevant information from CMR images. Deep neural networks have shown a great potential in image pattern recognition and segmentation for a variety of tasks. Here we demonstrate an automated analysis method for CMR images, which is based on a fully convolutional network (FCN). The network is trained and evaluated on a large-scale dataset from the UK Biobank, consisting of 4,875 subjects with 93,500 pixelwise annotated images. The performance of the method has been evaluated using a number of technical metrics, including the Dice metric, mean contour distance and Hausdorff distance, as well as clinically relevant measures, including left ventricle (LV) end-diastolic volume (LVEDV) and end-systolic volume (LVESV), LV mass (LVM); right ventricle (RV) end-diastolic volume (RVEDV) and end-systolic volume (RVESV). By combining FCN with a large-scale annotated dataset, the proposed automated method achieves a high performance in segmenting the LV and RV on short-axis CMR images and the left atrium (LA) and right atrium (RA) on long-axis CMR images. On a short-axis image test set of 600 subjects, it achieves an average Dice metric of 0.94 for the LV cavity, 0.88 for the LV myocardium and 0.90 for the RV cavity. The mean absolute difference between automated measurement and manual measurement is 6.1 mL for LVEDV, 5.3 mL for LVESV, 6.9 gram for LVM, 8.5 mL for RVEDV and 7.2 mL for RVESV. On long-axis image test sets, the average Dice metric is 0.93 for the LA cavity (2-chamber view), 0.95 for the LA cavity (4-chamber view) and 0.96 for the RA cavity (4-chamber view). The performance is comparable to human inter-observer variability. We show that an automated method achieves a performance on par with human experts in analysing CMR images and deriving clinically relevant measures.read more
Citations
More filters
Posted Content
Attention U-Net: Learning Where to Look for the Pancreas
Ozan Oktay,Jo Schlemper,Loic Le Folgoc,Matthew C. H. Lee,Mattias P. Heinrich,Kazunari Misawa,Kensaku Mori,Steven McDonagh,Nils Y. Hammerla,Bernhard Kainz,Ben Glocker,Daniel Rueckert +11 more
TL;DR: A novel attention gate (AG) model for medical imaging that automatically learns to focus on target structures of varying shapes and sizes is proposed to eliminate the necessity of using explicit external tissue/organ localisation modules of cascaded convolutional neural networks (CNNs).
Journal ArticleDOI
The 'Digital Twin' to enable the vision of precision cardiology.
Jorge Corral-Acero,Francesca Margara,Maciej Marciniak,Cristobal Rodero,Filip Loncaric,Yingjing Feng,Andrew Gilbert,Joao Filipe Fernandes,Hassaan A. Bukhari,Ali Wajdan,Manuel Villegas Martinez,Mariana Sousa Santos,Mehrdad Shamohammdi,Hongxing Luo,Philip Westphal,Paul Leeson,Paolo DiAchille,Viatcheslav Gurev,Manuel Mayr,Liesbet Geris,Pras Pathmanathan,Tina M. Morrison,Richard Cornelussen,Frits W. Prinzen,Tammo Delhaas,Ada Doltra,Marta Sitges,Edward J. Vigmond,Ernesto Zacur,Vicente Grau,Blanca Rodriguez,Espen W. Remme,Steven A. Niederer,Peter Mortier,Kristin McLeod,Mark Potse,Esther Pueyo,Alfonso Bueno-Orovio,Pablo Lamata +38 more
TL;DR: It is argued that the second enabling pillar towards this vision is the increasing power of computers and algorithms to learn, reason, and build the ‘digital twin’ of a patient.
Journal ArticleDOI
The UK Biobank imaging enhancement of 100,000 participants: rationale, data collection, management and future directions
Thomas J. Littlejohns,Jo Holliday,Lorna Gibson,Lorna Gibson,Steve Garratt,Niels Oesingmann,Fidel Alfaro-Almagro,Jimmy D. Bell,Chris Boultwood,Rory Collins,Megan Conroy,Nicola Crabtree,Nicola Doherty,Alejandro F. Frangi,Alejandro F. Frangi,Nicholas C. Harvey,Paul Leeson,Karla L. Miller,Stefan Neubauer,Steffen E. Petersen,Jonathan Sellors,Simon Sheard,Stephen M. Smith,Cathie Sudlow,Paul M. Matthews,Naomi E. Allen +25 more
TL;DR: An in-depth overview of the imaging enhancement of the UK Biobank, including the data collected, how it is managed and processed, and future directions is provided.
Journal ArticleDOI
A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises
S. Kevin Zhou,Hayit Greenspan,Christos Davatzikos,James S. Duncan,Bram van Ginneken,Anant Madabhushi,Jerry L. Prince,Daniel Rueckert,Ronald M. Summers +8 more
TL;DR: In this paper, the authors present traits of medical imaging, highlight clinical needs and technical challenges in medical imaging and describe how emerging trends in deep learning are addressing these issues, and conclude with a discussion and presentation of promising future directions.
Journal ArticleDOI
Deep learning for cardiac image segmentation: A review
Chen Chen,Chen Qin,Huaqi Qiu,Giacomo Tarroni,Giacomo Tarroni,Jinming Duan,Wenjia Bai,Daniel Rueckert +7 more
TL;DR: In this article, a review of deep learning-based segmentation methods for cardiac image segmentation is provided, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Book ChapterDOI
U-Net: Convolutional Networks for Biomedical Image Segmentation
TL;DR: Neber et al. as discussed by the authors proposed a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently, which can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.
Proceedings Article
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Sergey Ioffe,Christian Szegedy +1 more
TL;DR: Applied to a state-of-the-art image classification model, Batch Normalization achieves the same accuracy with 14 times fewer training steps, and beats the original model by a significant margin.
Related Papers (5)
Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?
Olivier Bernard,Alain Lalande,Clement Zotti,Frederick Cervenansky,Xin Yang,Pheng-Ann Heng,Irem Cetin,Karim Lekadir,Oscar Camara,Miguel Ángel González Ballester,Gerard Sanroma,Sandy Napel,Steffen E. Petersen,Georgios Tziritas,Elias Grinias,Mahendra Khened,Varghese Alex Kollerathu,Ganapathy Krishnamurthi,Marc-Michel Rohé,Xavier Pennec,Maxime Sermesant,Fabian Isensee,Paul F. Jäger,Klaus H. Maier-Hein,Peter M. Full,Ivo Wolf,Sandy Engelhardt,Christian F. Baumgartner,Lisa M. Koch,Jelmer M. Wolterink,Ivana Išgum,Yeonggul Jang,Yoonmi Hong,Jay Patravali,Shubham Jain,Olivier Humbert,Pierre-Marc Jodoin +36 more