Recurrent Saliency Transformation Network: Incorporating Multi-stage Visual Cues for Small Organ Segmentation
Qihang Yu,Lingxi Xie,Yan Wang,Yuyin Zhou,Elliot K. Fishman,Alan L. Yuille +5 more
- pp 8280-8289
Reads0
Chats0
TLDR
The key innovation is a saliency transformation module, which repeatedly converts the segmentation probability map from the previous iteration as spatial weights and applies these weights to the current iteration, making it more efficient and reliable in practice.Abstract:
We aim at segmenting small organs (e.g., the pancreas) from abdominal CT scans. As the target often occupies a relatively small region in the input image, deep neural networks can be easily confused by the complex and variable background. To alleviate this, researchers proposed a coarse-to-fine approach [46], which used prediction from the first (coarse) stage to indicate a smaller input region for the second (fine) stage. Despite its effectiveness, this algorithm dealt with two stages individually, which lacked optimizing a global energy function, and limited its ability to incorporate multi-stage visual cues. Missing contextual information led to unsatisfying convergence in iterations, and that the fine stage sometimes produced even lower segmentation accuracy than the coarse stage. This paper presents a Recurrent Saliency Transformation Network. The key innovation is a saliency transformation module, which repeatedly converts the segmentation probability map from the previous iteration as spatial weights and applies these weights to the current iteration. This brings us two-fold benefits. In training, it allows joint optimization over the deep networks dealing with different input scales. In testing, it propagates multi-stage visual information throughout iterations to improve segmentation accuracy. Experiments in the NIH pancreas segmentation dataset demonstrate the state-of-the-art accuracy, which outperforms the previous best by an average of over 2%. Much higher accuracies are also reported on several small organs in a larger dataset collected by ourselves. In addition, our approach enjoys better convergence properties, making it more efficient and reliable in practice.read more
Citations
More filters
Posted Content
Attention U-Net: Learning Where to Look for the Pancreas
Ozan Oktay,Jo Schlemper,Loic Le Folgoc,Matthew C. H. Lee,Mattias P. Heinrich,Kazunari Misawa,Kensaku Mori,Steven McDonagh,Nils Y. Hammerla,Bernhard Kainz,Ben Glocker,Daniel Rueckert +11 more
TL;DR: A novel attention gate (AG) model for medical imaging that automatically learns to focus on target structures of varying shapes and sizes is proposed to eliminate the necessity of using explicit external tissue/organ localisation modules of cascaded convolutional neural networks (CNNs).
Journal ArticleDOI
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
TL;DR: This article provides a detailed review of the solutions above, summarizing both the technical novelties and empirical results, and compares the benefits and requirements of the surveyed methodologies and provides recommended solutions.
Posted Content
Med3D: Transfer Learning for 3D Medical Image Analysis
Sihong Chen,Kai Ma,Yefeng Zheng +2 more
TL;DR: A heterogeneous 3D network called Med3D is designed to co-train multi-domain 3DSeg-8 so as to make a series of pre-trained models which can accelerate the training convergence speed of target 3D medical tasks and improve accuracy ranging from 3% to 20%.
Journal ArticleDOI
FastSurfer - A fast and accurate deep learning based neuroimaging pipeline
Leonie Henschel,Sailesh Conjeti,Santiago Estrada,Kersten Diers,Bruce Fischl,Martin Reuter,Martin Reuter +6 more
TL;DR: This work proposes a fast and accurate deep learning based neuroimaging pipeline for the automated processing of structural human brain MRI scans, replicating FreeSurfer’s anatomical segmentation including surface reconstruction and cortical parcellation.
Posted Content
Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
TL;DR: In this paper, the authors provide a detailed review of the solutions above, summarizing both the technical novelties and empirical results, and further compare the benefits and requirements of surveyed methodologies and provide their recommended solutions.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article
ImageNet Classification with Deep Convolutional Neural Networks
TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Book ChapterDOI
U-Net: Convolutional Networks for Biomedical Image Segmentation
TL;DR: Neber et al. as discussed by the authors proposed a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently, which can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.
Proceedings ArticleDOI
Fully convolutional networks for semantic segmentation
TL;DR: The key insight is to build “fully convolutional” networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning.