Proceedings ArticleDOI
Dense Semantic Labeling of Very-High-Resolution Aerial Imagery and LiDAR with Fully-Convolutional Neural Networks and Higher-Order CRFs
Yansong Liu,Sankaranarayanan Piramanayagam,Sildomar T. Monteiro,Eli Saber +3 more
- pp 1561-1570
Reads0
Chats0
TLDR
This paper proposes a decision-level fusion approach using a probabilistic graphical model for the task of dense semantic labeling of airborne remote sensing imagery and shows that the proposed approach compares favorably to the state-of-the-art baseline methods.Abstract:
The increasing availability of very-high-resolution (VHR) aerial optical images as well as coregistered Li- DAR data opens great opportunities for improving objectlevel dense semantic labeling of airborne remote sensing imagery. As a result, efficient and effective multisensor fusion techniques are needed to fully exploit these complementary data modalities. Recent researches demonstrated how to process remote sensing images using pre-trained deep convolutional neural networks (DCNNs) at the feature level. In this paper, we propose a decision-level fusion approach using a probabilistic graphical model for the task of dense semantic labeling. Our proposed method first obtains two initial probabilistic labeling predictions from a fully-convolutional neural network and a linear classifier, e.g. logistic regression, respectively. These two predictions are then combined within a higher-order conditional random field (CRF). We utilize graph cut inference to estimate the final dense semantic labeling results. Higher-order CRF modeling helps to resolve fusion ambiguities by explicitly using the spatial contextual information, which can be learned from the training data. Experiments on the ISPRS 2D semantic labeling Potsdam dataset show that our proposed approach compares favorably to the state-of-the-art baseline methods.read more
Citations
More filters
Proceedings ArticleDOI
DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images
Ilke Demir,Krzysztof Koperski,David Lindenbaum,Guan Pang,Jing Huang,Saikat Basu,Forest Hughes,Devis Tuia,Ramesh Raska +8 more
TL;DR: The DeepGlobe 2018 Satellite Image Understanding Challenge is presented, which includes three public competitions for segmentation, detection, and classification tasks on satellite images, and characteristics of each dataset are analyzed, and evaluation criteria for each task are defined.
Journal ArticleDOI
Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks
TL;DR: In this paper, the authors investigate various methods to deal with semantic labeling of very high-resolution multi-modal remote sensing data and propose an efficient multi-scale approach to leverage both a large spatial context and the high resolution data, and investigate early and late fusion of Lidar and multispectral data.
Journal ArticleDOI
Unmanned Aerial Vehicle for Remote Sensing Applications—A Review
TL;DR: This paper performs a critical review on RS tasks that involve UAV data and their derived products as their main sources including raw perspective images, digital surface models, and orthophotos and focuses on solutions that address the “new” aspects of the U drone data including ultra-high resolution; availability of coherent geometric and spectral data; and capability of simultaneously using multi-sensor data for fusion.
Journal ArticleDOI
Land cover mapping at very high resolution with rotation equivariant CNNs: Towards small yet accurate models
TL;DR: This work proposes a CNN architecture called Rotation Equivariant Vector Field Network (RotEqNet) to encode rotation equivariance in the network itself and achieves state-of-the-art performances even when using very small architectures trained from scratch.
Journal ArticleDOI
Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks
TL;DR: This letter presents an evaluation of fully convolutional neural networks (FCNNs) for road segmentation in SAR images, and shows that although FCNNs natively lack efficiency, they are capable of good results if properly tuned.
References
More filters
Proceedings ArticleDOI
Fully convolutional networks for semantic segmentation
TL;DR: The key insight is to build “fully convolutional” networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning.
Journal ArticleDOI
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
TL;DR: Quantitative assessments show that SegNet provides good performance with competitive inference time and most efficient inference memory-wise as compared to other architectures, including FCN and DeconvNet.
Journal ArticleDOI
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
TL;DR: A new superpixel algorithm is introduced, simple linear iterative clustering (SLIC), which adapts a k-means clustering approach to efficiently generate superpixels and is faster and more memory efficient, improves segmentation performance, and is straightforward to extend to supervoxel generation.
Posted Content
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
TL;DR: This work brings together methods from DCNNs and probabilistic graphical models for addressing the task of pixel-level classification by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF).
Proceedings Article
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
TL;DR: This paper considers fully connected CRF models defined on the complete set of pixels in an image and proposes a highly efficient approximate inference algorithm in which the pairwise edge potentials are defined by a linear combination of Gaussian kernels.