Recon-GLGAN: A Global-Local Context Based Generative Adversarial Network for MRI Reconstruction.
Balamurali Murugesan,S. Vijaya Raghavan,Kaushik Sarveswaran,Keerthi Ram,Mohanasankar Sivaprakasam +4 more
- pp 3-15
Reads0
Chats0
TLDR
In this article, the authors proposed a reconstruction global-local GAN (Recon-GLGAN) for MRI reconstruction, which contains a generator and a context discriminator which incorporates global and local contextual information from images.Abstract:
Magnetic resonance imaging (MRI) is one of the best medical imaging modalities as it offers excellent spatial resolution and soft-tissue contrast. But, the usage of MRI is limited by its slow acquisition time, which makes it expensive and causes patient discomfort. In order to accelerate the acquisition, multiple deep learning networks have been proposed. Recently, Generative Adversarial Networks (GANs) have shown promising results in MRI reconstruction. The drawback with the proposed GAN based methods is it does not incorporate the prior information about the end goal which could help in better reconstruction. For instance, in the case of cardiac MRI, the physician would be interested in the heart region which is of diagnostic relevance while excluding the peripheral regions. In this work, we show that incorporating prior information about a region of interest in the model would offer better performance. Thereby, we propose a novel GAN based architecture, Reconstruction Global-Local GAN (Recon-GLGAN) for MRI reconstruction. The proposed model contains a generator and a context discriminator which incorporates global and local contextual information from images. Our model offers significant performance improvement over the baseline models. Our experiments show that the concept of a context discriminator can be extended to existing GAN based reconstruction models to offer better performance. We also demonstrate that the reconstructions from the proposed method give segmentation results similar to fully sampled images.read more
Citations
More filters
Journal ArticleDOI
Deep learning for fast MR imaging: A review for learning reconstruction from incomplete k-space data
TL;DR: This survey aims to review deep learning based MR image reconstruction works from 2016- June 2020 and will discuss merits, limitations and challenges associated with such methods, as a starting point for researchers interested in contributing to this field.
Journal ArticleDOI
Which GAN? A comparative study of generative adversarial network-based fast MRI reconstruction
Jun Lv,Jin Zhu,Guang Yang +2 more
TL;DR: In this paper, a comparative study of GAN-based models for MRI reconstruction is conducted. But, the comparison of these methods remains limited because the models have not been trained on the same datasets and the validation strategies may be different.
Journal ArticleDOI
Narrative review of generative adversarial networks in medical and molecular imaging
Kazuhiro Koshino,Rudolf A. Werner,Martin G. Pomper,Ralph A. Bundschuh,Fujio Toriumi,Takahiro Higuchi,Steven P. Rowe +6 more
TL;DR: A comprehensive overview for GANs is provided and their usefulness in medical and molecular imaging is discussed on the following topics: data augmentation to increase training data for AI-based computer-aided diagnosis as a solution for the data-hungry nature of such training sets.
Posted Content
Hierarchical Amortized Training for Memory-efficient High Resolution 3D GAN.
TL;DR: This work proposes a novel end-to-end GAN architecture that can generate high-resolution 3D images and demonstrates that this approach outperforms state of the art in image generation, image reconstruction, and clinical-relevant variables prediction.
Proceedings ArticleDOI
Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution
TL;DR: McMRSR as mentioned in this paper uses transformers to model long-range dependencies in both reference and target images, and a new multi-scale contextual matching method is proposed to capture corresponding contexts from reference features at different scales.
References
More filters
Book ChapterDOI
U-Net: Convolutional Networks for Biomedical Image Segmentation
TL;DR: Neber et al. as discussed by the authors proposed a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently, which can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.
Proceedings ArticleDOI
Image-to-Image Translation with Conditional Adversarial Networks
TL;DR: Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Journal ArticleDOI
Globally and locally consistent image completion
TL;DR: This work presents a novel approach for image completion that results in images that are both locally and globally consistent, with a fully-convolutional neural network that can complete images of arbitrary resolutions by filling-in missing regions of any shape.
Journal ArticleDOI
Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?
Olivier Bernard,Alain Lalande,Clement Zotti,Frederick Cervenansky,Xin Yang,Pheng-Ann Heng,Irem Cetin,Karim Lekadir,Oscar Camara,Miguel Ángel González Ballester,Gerard Sanroma,Sandy Napel,Steffen E. Petersen,Georgios Tziritas,Elias Grinias,Mahendra Khened,Varghese Alex Kollerathu,Ganapathy Krishnamurthi,Marc-Michel Rohé,Xavier Pennec,Maxime Sermesant,Fabian Isensee,Paul F. Jäger,Klaus H. Maier-Hein,Peter M. Full,Ivo Wolf,Sandy Engelhardt,Christian F. Baumgartner,Lisa M. Koch,Jelmer M. Wolterink,Ivana Išgum,Yeonggul Jang,Yoonmi Hong,Jay Patravali,Shubham Jain,Olivier Humbert,Pierre-Marc Jodoin +36 more
TL;DR: How far state-of-the-art deep learning methods can go at assessing CMRI, i.e., segmenting the myocardium and the two ventricles as well as classifying pathologies is measured, to open the door to highly accurate and fully automatic analysis of cardiac CMRI.
Journal ArticleDOI
DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction
Guang Yang,Simiao Yu,Hao Dong,Greg Slabaugh,Pier Luigi Dragotti,Xujiong Ye,Fangde Liu,Simon R. Arridge,Jennifer Keegan,Yike Guo,David N. Firmin +10 more
TL;DR: This paper provides a deep learning-based strategy for reconstruction of CS-MRI, and bridges a substantial gap between conventional non-learning methods working only on data from a single image, and prior knowledge from large training data sets.
Related Papers (5)
Which GAN? A comparative study of generative adversarial network-based fast MRI reconstruction
Jun Lv,Jin Zhu,Guang Yang +2 more