DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
TLDR
This work addresses the task of semantic image segmentation with Deep Learning and proposes atrous spatial pyramid pooling (ASPP), which is proposed to robustly segment objects at multiple scales, and improves the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models.Abstract:
In this work we address the task of semantic image segmentation with Deep Learning and make three main contributions that are experimentally shown to have substantial practical merit. First , we highlight convolution with upsampled filters, or ‘atrous convolution’, as a powerful tool in dense prediction tasks. Atrous convolution allows us to explicitly control the resolution at which feature responses are computed within Deep Convolutional Neural Networks. It also allows us to effectively enlarge the field of view of filters to incorporate larger context without increasing the number of parameters or the amount of computation. Second , we propose atrous spatial pyramid pooling (ASPP) to robustly segment objects at multiple scales. ASPP probes an incoming convolutional feature layer with filters at multiple sampling rates and effective fields-of-views, thus capturing objects as well as image context at multiple scales. Third , we improve the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. The commonly deployed combination of max-pooling and downsampling in DCNNs achieves invariance but has a toll on localization accuracy. We overcome this by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF), which is shown both qualitatively and quantitatively to improve localization performance. Our proposed “DeepLab” system sets the new state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching 79.7 percent mIOU in the test set, and advances the results on three other datasets: PASCAL-Context, PASCAL-Person-Part, and Cityscapes. All of our code is made publicly available online.read more
Citations
More filters
Journal ArticleDOI
Deep Learning for SAR Image Despeckling
Francesco Lattari,Borja Gonzalez Leon,Francesco Asaro,Alessio Rucci,Claudio Maria Prati,Matteo Matteucci +5 more
TL;DR: A deep encoder–decoder CNN architecture, focused in the specific context of SAR images, is proposed in order to enhance speckle filtering capabilities alongside texture preservation through the adaptation of the U-Net CNN, which has been modified and optimized accordingly.
Book ChapterDOI
Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice.
Jeroen Bertels,Tom Eelbode,Maxim Berman,Dirk Vandermeulen,Frederik Maes,Raf Bisschops,Matthew B. Blaschko +6 more
TL;DR: In this article, the authors investigate the theoretical differences in a risk minimization framework and question the existence of a weighted cross-entropy loss with weights theoretically optimized to surrogate Dice or Jaccard.
Journal ArticleDOI
Revisiting Feature Fusion for RGB-T Salient Object Detection
TL;DR: This article revisits feature fusion for mining intrinsic RGB-T saliency patterns and proposes a novel deep feature fusion network, which consists of the multi-scale, multi-modality, and multi-level feature fusion modules.
Posted Content
Improving Semantic Segmentation via Decoupled Body and Edge Supervision
Xiangtai Li,Xia Li,Li Zhang,Guangliang Cheng,Jianping Shi,Zhouchen Lin,Shaohua Tan,Yunhai Tong +7 more
TL;DR: This paper proposes a new paradigm for semantic segmentation that establishes new state of the art while retaining high efficiency in inference and shows that the proposed framework with various baselines or backbone networks leads to better object inner consistency and object boundaries.
Journal ArticleDOI
Review on remote sensing methods for landslide detection using machine and deep learning
TL;DR: In the past decades, due to inflation of urbanized area and climate change, a large number of landslides have been reported as mentioned in this paper, which is caused by specific compositional slope movement.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article
ImageNet Classification with Deep Convolutional Neural Networks
TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Journal ArticleDOI
Gradient-based learning applied to document recognition
Yann LeCun,Léon Bottou,Léon Bottou,Yoshua Bengio,Yoshua Bengio,Yoshua Bengio,Patrick Haffner +6 more
TL;DR: In this article, a graph transformer network (GTN) is proposed for handwritten character recognition, which can be used to synthesize a complex decision surface that can classify high-dimensional patterns, such as handwritten characters.
Proceedings ArticleDOI
Going deeper with convolutions
Christian Szegedy,Wei Liu,Yangqing Jia,Pierre Sermanet,Scott Reed,Dragomir Anguelov,Dumitru Erhan,Vincent Vanhoucke,Andrew Rabinovich +8 more
TL;DR: Inception as mentioned in this paper is a deep convolutional neural network architecture that achieves the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC14).