Open AccessPosted Content
SAINT: Spatially Aware Interpolation NeTwork for Medical Slice Synthesis
Reads0
Chats0
TLDR
This paper introduces a Spatially Aware Interpolation NeTwork (SAINT) for medical slice synthesis to alleviate the memory constraint that volumetric data poses, and shows that SAINT consistently outperforms other SISR methods in terms ofmedical slice synthesis quality.Abstract:
Deep learning-based single image super-resolution (SISR) methods face various challenges when applied to 3D medical volumetric data (i.e., CT and MR images) due to the high memory cost and anisotropic resolution, which adversely affect their performance. Furthermore, mainstream SISR methods are designed to work over specific upsampling factors, which makes them ineffective in clinical practice. In this paper, we introduce a Spatially Aware Interpolation NeTwork (SAINT) for medical slice synthesis to alleviate the memory constraint that volumetric data poses. Compared to other super-resolution methods, SAINT utilizes voxel spacing information to provide desirable levels of details, and allows for the upsampling factor to be determined on the fly. Our evaluations based on 853 CT scans from four datasets that contain liver, colon, hepatic vessels, and kidneys show that SAINT consistently outperforms other SISR methods in terms of medical slice synthesis quality, while using only a single model to deal with different upsampling factors.read more
Citations
More filters
Posted Content
Video Super Resolution Based on Deep Learning: A comprehensive survey
TL;DR: A taxonomy is proposed and classify the methods into six sub-categories according to the ways of utilizing inter-frame information for video super-resolution, to alleviate understandability and transferability of existing and future techniques into practice.
Posted Content
Progressively Volumetrized Deep Generative Models for Data-Efficient Contextual Learning of MR Image Recovery
Tolga Çukur,Mahmut Yurt,Muzaffer Özbey,Salman Ul Hassan Dar,Berk Tinaz,Kader Karli Oguz,Tolga Çukur +6 more
TL;DR: A novel progressive volumetrization strategy for generative models (ProvoGAN) that serially decomposes complex volumetric image recovery tasks into successive cross-sectional mappings task-optimally ordered across individual rectilinear dimensions is introduced.
Book ChapterDOI
Two-Stage Self-supervised Cycle-Consistency Network for Reconstruction of Thin-Slice MR Images
TL;DR: Li et al. as mentioned in this paper proposed a two-stage self-supervised cycle-consistency network (TSCNet) for MR slice interpolation, which synthesizes paired LR-HR images along the sagittal and coronal directions of input LR images, and then a cyclic interpolation procedure based on triplet axial slices is designed in the second-stage SSL for further refinement.
Journal ArticleDOI
Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advances
TL;DR: The domain of SR is reviewed in light of recent advances, and state-of-the-art models such as diffusion (DDPM) and transformer-based SR models are examined, and a critical discussion on contemporary strategies used in SR is presented, and promising yet unexplored research directions are identified.
Book ChapterDOI
RPLHR-CT Dataset and Transformer Baseline for Volumetric Super-Resolution from CT Scans
TL;DR: Li et al. as discussed by the authors proposed a transformer volumetric super-resolution network (TVSRN) based on attention mechanisms, dispensing with convolutions entirely. And the experimental results show that TVSRN significantly outperforms all baselines on both PSNR and SSIM.
References
More filters
Proceedings ArticleDOI
Densely Connected Convolutional Networks
TL;DR: DenseNet as mentioned in this paper proposes to connect each layer to every other layer in a feed-forward fashion, which can alleviate the vanishing gradient problem, strengthen feature propagation, encourage feature reuse, and substantially reduce the number of parameters.
Proceedings ArticleDOI
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Christian Ledig,Lucas Theis,Ferenc Huszar,Jose Caballero,Andrew Cunningham,Alejandro Acosta,Andrew Peter Aitken,Alykhan Tejani,Johannes Totz,Zehan Wang,Wenzhe Shi +10 more
TL;DR: SRGAN as mentioned in this paper proposes a perceptual loss function which consists of an adversarial loss and a content loss, which pushes the solution to the natural image manifold using a discriminator network that is trained to differentiate between the super-resolved images and original photo-realistic images.
Proceedings ArticleDOI
Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network
Wenzhe Shi,Jose Caballero,Ferenc Huszar,Johannes Totz,Andrew Peter Aitken,Rob Bishop,Daniel Rueckert,Zehan Wang +7 more
TL;DR: This paper presents the first convolutional neural network capable of real-time SR of 1080p videos on a single K2 GPU and introduces an efficient sub-pixel convolution layer which learns an array of upscaling filters to upscale the final LR feature maps into the HR output.
Posted Content
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Christian Ledig,Lucas Theis,Ferenc Huszar,Jose Caballero,Andrew Cunningham,Alejandro Acosta,Andrew Peter Aitken,Alykhan Tejani,Johannes Totz,Zehan Wang,Wenzhe Shi +10 more
TL;DR: SRGAN, a generative adversarial network (GAN) for image super-resolution (SR), is presented, to its knowledge, the first framework capable of inferring photo-realistic natural images for 4x upscaling factors and a perceptual loss function which consists of an adversarial loss and a content loss.
Journal ArticleDOI
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
Bjoern H. Menze,Andras Jakab,Stefan Bauer,Jayashree Kalpathy-Cramer,Keyvan Farahani,Justin Kirby,Yuliya Burren,N Porz,Johannes Slotboom,Roland Wiest,Levente Lanczi,Elizabeth R. Gerstner,Marc-André Weber,Tal Arbel,Brian B. Avants,Nicholas Ayache,Patricia Buendia,D. Louis Collins,Nicolas Cordier,Jason J. Corso,Antonio Criminisi,Tilak Das,Hervé Delingette,Çağatay Demiralp,Christopher R. Durst,Michel Dojat,Senan Doyle,Joana Festa,Florence Forbes,Ezequiel Geremia,Ben Glocker,Polina Golland,Xiaotao Guo,Andac Hamamci,Khan M. Iftekharuddin,Raj Jena,Nigel M. John,Ender Konukoglu,Danial Lashkari,José Mariz,Raphael Meier,Sérgio Pereira,Doina Precup,Stephen J. Price,Tammy Riklin Raviv,Syed M. S. Reza,Michael Ryan,Duygu Sarikaya,Lawrence H. Schwartz,Hoo-Chang Shin,Jamie Shotton,Carlos A. Silva,Nuno Sousa,Nagesh K. Subbanna,Gábor Székely,Thomas J. Taylor,Owen M. Thomas,Nicholas J. Tustison,Gozde Unal,Flor Vasseur,Max Wintermark,Dong Hye Ye,Liang Zhao,Binsheng Zhao,Darko Zikic,Marcel Prastawa,Mauricio Reyes,Koen Van Leemput +67 more
TL;DR: The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) as mentioned in this paper was organized in conjunction with the MICCAI 2012 and 2013 conferences, and twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low and high grade glioma patients.