Deep learning (DL) algorithms have seen a massive rise in popularity for remote-sensing image analysis over the past few years. In this study, the major DL concepts pertinent to remote-sensing are introduced, and more than 200 publications in this field, most of which were published during the last two years, are reviewed and analyzed. Initially, a meta-analysis was conducted to analyze the status of remote sensing DL studies in terms of the study targets, DL model(s) used, image spatial resolution(s), type of study area, and level of classification accuracy achieved. Subsequently, a detailed review is conducted to describe/discuss how DL has been applied for remote sensing image analysis tasks including image fusion, image registration, scene classification, object detection, land use and land cover (LULC) classification, segmentation, and object-based image analysis (OBIA). This review covers nearly every application and technology in the field of remote sensing, ranging from preprocessing to mapping. Finally, a conclusion regarding the current state-of-the art methods, a critical conclusion on open challenges, and directions for future research are presented.

Deep learning in remote sensing applications: A meta-analysis and review

Deep learning in environmental remote sensing: Achievements and challenges

Street view imagery in urban analytics and GIS: A review

Mapping deforestation is an essential step in the process of managing tropical rainforests. It lets us understand and monitor both legal and illegal deforestation and its implications, which include the effect deforestation may have on climate change through greenhouse gas emissions. Given that there is ample room for improvements when it comes to mapping deforestation using satellite imagery, in this study, we aimed to test and evaluate the use of algorithms belonging to the growing field of deep learning (DL), particularly convolutional neural networks (CNNs), to this end. Although studies have been using DL algorithms for a variety of remote sensing tasks for the past few years, they are still relatively unexplored for deforestation mapping. We attempted to map the deforestation between images approximately one year apart, specifically between 2017 and 2018 and between 2018 and 2019. Three CNN architectures that are available in the literature—SharpMask, U-Net, and ResUnet—were used to classify the change between years and were then compared to two classic machine learning (ML) algorithms—random forest (RF) and multilayer perceptron (MLP)—as points of reference. After validation, we found that the DL models were better in most performance metrics including the Kappa index, F1 score, and mean intersection over union (mIoU) measure, while the ResUnet model achieved the best overall results with a value of 0.94 in all three measures in both time sequences. Visually, the DL models also provided classifications with better defined deforestation patches and did not need any sort of post-processing to remove noise, unlike the ML models, which needed some noise removal to improve results.

Change Detection of Deforestation in the Brazilian Amazon Using Landsat Data and Convolutional Neural Networks

GlobeLand30, donated to the United Nations by China in September 2014, is the first wall-to-wall 30 m global land cover (GLC) data product. GlobeLand30 is widely used by scientists and users around the world. This paper provides a review of the analysis and applications of GlobeLand30 based on its data-downloading statistics and published studies. An average accuracy of 80% for full classes or one single class is achieved by third-party researchers from more than 10 countries through sample-based validation or comparison with existing data. GlobeLand30 has users from more than 120 countries on five continents, and from all five Social Benefit Areas. The significance of GlobeLand30 is demonstrated by a number of published papers dealing with land-cover status and change analysis, cause-and-consequence analysis, and the environmental parameterization of Earth system models. Accordingly, scientific data sharing in the field of geosciences and Earth observation is promoted, and fine-resolution GLC mapping and applications worldwide are stimulated. The future development of GlobeLand30, including comprehensive validation, continuous updating, and monitoring of sustainable development goals, is also discussed.

Analysis and Applications of GlobeLand30: A Review

Integrating landscape metrics and socioeconomic features for urban functional region classification

Exploring the relationship between landscape characteristics and urban vibrancy: A case study using morphology and review data

Understanding the changes in spatial fairness of urban greenery using time-series remote sensing images: A case study of Guangdong-Hong Kong-Macao Greater Bay.

Land cover validation plays an important role in the process of generating and distributing land cover thematic maps, which is usually implemented by high cost of sample interpretation with remotely sensed images or field survey. With an increasing availability of geo-tagged landscape photos, the automatic photo recognition methodologies, e.g., deep learning, can be effectively utilised for land cover applications. However, they have hardly been utilised in validation processes, as challenges remain in sample selection and classification for highly heterogeneous photos. This study proposed an approach to employ geo-tagged photos for land cover validation by using the deep learning technology. The approach first identified photos automatically based on the VGG-16 network. Then, samples for validation were selected and further classified by considering photos distribution and classification probabilities. The implementations were conducted for the validation of the GlobeLand30 land cover product in a heterogeneous area, western California. Experimental results represented promises in land cover validation, given that GlobeLand30 showed an overall accuracy of 83.80% with classified samples, which was close to the validation result of 80.45% based on visual interpretation. Additionally, the performances of deep learning based on ResNet-50 and AlexNet were also quantified, revealing no substantial differences in final validation results. The proposed approach ensures geo-tagged photo quality, and supports the sample classification strategy by considering photo distribution, with accuracy improvement from 72.07% to 79.33% compared with solely considering the single nearest photo. Consequently, the presented approach proves the feasibility of deep learning technology on land cover information identification of geo-tagged photos, and has a great potential to support and improve the efficiency of land cover validation.

Hanfa Xing

Papers

Integrating landscape metrics and socioeconomic features for urban functional region classification

Exploring the relationship between landscape characteristics and urban vibrancy: A case study using morphology and review data

Understanding the changes in spatial fairness of urban greenery using time-series remote sensing images: A case study of Guangdong-Hong Kong-Macao Greater Bay.

Exploring geo-tagged photos for land cover validation with deep learning

Measuring urban landscapes for urban function classification using spatial metrics