scispace - formally typeset
Open AccessBook ChapterDOI

Recon-GLGAN: A Global-Local Context Based Generative Adversarial Network for MRI Reconstruction.

Reads0
Chats0
TLDR
In this article, the authors proposed a reconstruction global-local GAN (Recon-GLGAN) for MRI reconstruction, which contains a generator and a context discriminator which incorporates global and local contextual information from images.
Abstract
Magnetic resonance imaging (MRI) is one of the best medical imaging modalities as it offers excellent spatial resolution and soft-tissue contrast. But, the usage of MRI is limited by its slow acquisition time, which makes it expensive and causes patient discomfort. In order to accelerate the acquisition, multiple deep learning networks have been proposed. Recently, Generative Adversarial Networks (GANs) have shown promising results in MRI reconstruction. The drawback with the proposed GAN based methods is it does not incorporate the prior information about the end goal which could help in better reconstruction. For instance, in the case of cardiac MRI, the physician would be interested in the heart region which is of diagnostic relevance while excluding the peripheral regions. In this work, we show that incorporating prior information about a region of interest in the model would offer better performance. Thereby, we propose a novel GAN based architecture, Reconstruction Global-Local GAN (Recon-GLGAN) for MRI reconstruction. The proposed model contains a generator and a context discriminator which incorporates global and local contextual information from images. Our model offers significant performance improvement over the baseline models. Our experiments show that the concept of a context discriminator can be extended to existing GAN based reconstruction models to offer better performance. We also demonstrate that the reconstructions from the proposed method give segmentation results similar to fully sampled images.

read more

Citations
More filters
Journal ArticleDOI

Deep learning for fast MR imaging: A review for learning reconstruction from incomplete k-space data

TL;DR: This survey aims to review deep learning based MR image reconstruction works from 2016- June 2020 and will discuss merits, limitations and challenges associated with such methods, as a starting point for researchers interested in contributing to this field.
Journal ArticleDOI

Which GAN? A comparative study of generative adversarial network-based fast MRI reconstruction

TL;DR: In this paper, a comparative study of GAN-based models for MRI reconstruction is conducted. But, the comparison of these methods remains limited because the models have not been trained on the same datasets and the validation strategies may be different.
Journal ArticleDOI

Narrative review of generative adversarial networks in medical and molecular imaging

TL;DR: A comprehensive overview for GANs is provided and their usefulness in medical and molecular imaging is discussed on the following topics: data augmentation to increase training data for AI-based computer-aided diagnosis as a solution for the data-hungry nature of such training sets.
Posted Content

Hierarchical Amortized Training for Memory-efficient High Resolution 3D GAN.

TL;DR: This work proposes a novel end-to-end GAN architecture that can generate high-resolution 3D images and demonstrates that this approach outperforms state of the art in image generation, image reconstruction, and clinical-relevant variables prediction.
Proceedings ArticleDOI

Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution

TL;DR: McMRSR as mentioned in this paper uses transformers to model long-range dependencies in both reference and target images, and a new multi-scale contextual matching method is proposed to capture corresponding contexts from reference features at different scales.
References
More filters
Book ChapterDOI

U-Net: Convolutional Networks for Biomedical Image Segmentation

TL;DR: Neber et al. as discussed by the authors proposed a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently, which can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.
Proceedings ArticleDOI

Image-to-Image Translation with Conditional Adversarial Networks

TL;DR: Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Journal ArticleDOI

Globally and locally consistent image completion

TL;DR: This work presents a novel approach for image completion that results in images that are both locally and globally consistent, with a fully-convolutional neural network that can complete images of arbitrary resolutions by filling-in missing regions of any shape.
Journal ArticleDOI

Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?

TL;DR: How far state-of-the-art deep learning methods can go at assessing CMRI, i.e., segmenting the myocardium and the two ventricles as well as classifying pathologies is measured, to open the door to highly accurate and fully automatic analysis of cardiac CMRI.
Journal ArticleDOI

DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction

TL;DR: This paper provides a deep learning-based strategy for reconstruction of CS-MRI, and bridges a substantial gap between conventional non-learning methods working only on data from a single image, and prior knowledge from large training data sets.
Related Papers (5)