scispace - formally typeset
Search or ask a question

Showing papers in "Remote Sensing in 2016"


Journal ArticleDOI
TL;DR: A new pansharpening method is proposed, based on convolutional neural networks, which is largely competitive with the current state of the art in terms of both full-reference and no-reference metrics, and also at a visual inspection.
Abstract: A new pansharpening method is proposed, based on convolutional neural networks. We adapt a simple and effective three-layer architecture recently proposed for super-resolution to the pansharpening problem. Moreover, to improve performance without increasing complexity, we augment the input by including several maps of nonlinear radiometric indices typical of remote sensing. Experiments on three representative datasets show the proposed method to provide very promising results, largely competitive with the current state of the art in terms of both full-reference and no-reference metrics, and also at a visual inspection.

719 citations


Journal ArticleDOI
TL;DR: This paper presents a new filtering method which only needs a few easy-to-set integer and Boolean parameters and may help the users without much experience to use LiDAR data and related technology in their own applications more easily.
Abstract: Separating point clouds into ground and non-ground measurements is an essential step to generate digital terrain models (DTMs) from airborne LiDAR (light detection and ranging) data. However, most filtering algorithms need to carefully set up a number of complicated parameters to achieve high accuracy. In this paper, we present a new filtering method which only needs a few easy-to-set integer and Boolean parameters. Within the proposed approach, a LiDAR point cloud is inverted, and then a rigid cloth is used to cover the inverted surface. By analyzing the interactions between the cloth nodes and the corresponding LiDAR points, the locations of the cloth nodes can be determined to generate an approximation of the ground surface. Finally, the ground points can be extracted from the LiDAR point cloud by comparing the original LiDAR points and the generated surface. Benchmark datasets provided by ISPRS (International Society for Photogrammetry and Remote Sensing) working Group III/3 are used to validate the proposed filtering method, and the experimental results yield an average total error of 4.58%, which is comparable with most of the state-of-the-art filtering algorithms. The proposed easy-to-use filtering method may help the users without much experience to use LiDAR data and related technology in their own applications more easily.

653 citations


Journal ArticleDOI
TL;DR: The study presents the preliminary results of two classification exercises assessing the capabilities of pre-operational Sentinel-2 (S2) data for mapping crop types and tree species and confirmed its expected capabilities to produce reliable land cover maps.
Abstract: The study presents the preliminary results of two classification exercises assessing the capabilities of pre-operational (August 2015) Sentinel-2 (S2) data for mapping crop types and tree species. In the first case study, an S2 image was used to map six summer crop species in Lower Austria as well as winter crops/bare soil. Crop type maps are needed to account for crop-specific water use and for agricultural statistics. Crop type information is also useful to parametrize crop growth models for yield estimation, as well as for the retrieval of vegetation biophysical variables using radiative transfer models. The second case study aimed to map seven different deciduous and coniferous tree species in Germany. Detailed information about tree species distribution is important for forest management and to assess potential impacts of climate change. In our S2 data assessment, crop and tree species maps were produced at 10 m spatial resolution by combining the ten S2 spectral channels with 10 and 20 m pixel size. A supervised Random Forest classifier (RF) was deployed and trained with appropriate ground truth. In both case studies, S2 data confirmed its expected capabilities to produce reliable land cover maps. Cross-validated overall accuracies ranged between 65% (tree species) and 76% (crop types). The study confirmed the high value of the red-edge and shortwave infrared (SWIR) bands for vegetation mapping. Also, the blue band was important in both study sites. The S2-bands in the near infrared were amongst the least important channels. The object based image analysis (OBIA) and the classical pixel-based classification achieved comparable results, mainly for the cropland. As only single date acquisitions were available for this study, the full potential of S2 data could not be assessed. In the future, the two twin S2 satellites will offer global coverage every five days and therefore permit to concurrently exploit unprecedented spectral and temporal information with high spatial resolution.

652 citations


Journal ArticleDOI
TL;DR: A novel 10-m spatial resolution MNDWI is produced from Sentinel-2 images by downscaling the 20-m resolution SWIR band to 10 m based on pan-sharpening, which shows that MND WI can enhance water bodies and suppressbuilt-up features more efficiently than NDWI.
Abstract: Monitoring open water bodies accurately is an important and basic application in remote sensing. Various water body mapping approaches have been developed to extract water bodies from multispectral images. The method based on the spectral water index, especially the Modified Normalized Difference Water Index (MDNWI) calculated from the green and Shortwave-Infrared (SWIR) bands, is one of the most popular methods. The recently launched Sentinel-2 satellite can provide fine spatial resolution multispectral images. This new dataset is potentially of important significance for regional water bodies’ mapping, due to its free access and frequent revisit capabilities. It is noted that the green and SWIR bands of Sentinel-2 have different spatial resolutions of 10 m and 20 m, respectively. Straightforwardly, MNDWI can be produced from Sentinel-2 at the spatial resolution of 20 m, by upscaling the 10-m green band to 20 m correspondingly. This scheme, however, wastes the detailed information available at the 10-m resolution. In this paper, to take full advantage of the 10-m information provided by Sentinel-2 images, a novel 10-m spatial resolution MNDWI is produced from Sentinel-2 images by downscaling the 20-m resolution SWIR band to 10 m based on pan-sharpening. Four popular pan-sharpening algorithms, including Principle Component Analysis (PCA), Intensity Hue Saturation (IHS), High Pass Filter (HPF) and A Trous Wavelet Transform (ATWT), were applied in this study. The performance of the proposed method was assessed experimentally using a Sentinel-2 image located at the Venice coastland. In the experiment, six water indexes, including 10-m NDWI, 20-m MNDWI and 10-m MNDWI, produced by four pan-sharpening algorithms, were compared. Three levels of results, including the sharpened images, the produced MNDWI images and the finally mapped water bodies, were analysed quantitatively. The results showed that MNDWI can enhance water bodies and suppressbuilt-up features more efficiently than NDWI. Moreover, 10-m MNDWIs produced by all four pan-sharpening algorithms can represent more detailed spatial information of water bodies than 20-m MNDWI produced by the original image. Thus, MNDWIs at the 10-m resolution can extract more accurate water body maps than 10-m NDWI and 20-m MNDWI. In addition, although HPF can produce more accurate sharpened images and MNDWI images than the other three benchmark pan-sharpening algorithms, the ATWT algorithm leads to the best 10-m water bodies mapping results. This is no necessary positive connection between the accuracy of the sharpened MNDWI image and the map-level accuracy of the resultant water body maps.

498 citations


Journal ArticleDOI
TL;DR: This study reviewed 112 studies on fusing optical and radar data, which offer unique spectral and structural information, for land cover and use assessments, and concluded that fusion improved results compared to using single data sources.
Abstract: The wealth of complementary data available from remote sensing missions can hugely aid efforts towards accurately determining land use and quantifying subtle changes in land use management or intensity. This study reviewed 112 studies on fusing optical and radar data, which offer unique spectral and structural information, for land cover and use assessments. Contrary to our expectations, only 50 studies specifically addressed land use, and five assessed land use changes, while the majority addressed land cover. The advantages of fusion for land use analysis were assessed in 32 studies, and a large majority (28 studies) concluded that fusion improved results compared to using single data sources. Study sites were small, frequently 300–3000 km 2 or individual plots, with a lack of comparison of results and accuracies across sites. Although a variety of fusion techniques were used, pre-classification fusion followed by pixel-level inputs in traditional classification algorithms (e.g., Gaussian maximum likelihood classification) was common, but often without a concrete rationale on the applicability of the method to the land use theme being studied. Progress in this field of research requires the development of robust techniques of fusion to map the intricacies of land uses and changes therein and systematic procedures to assess the benefits of fusion over larger spatial scales.

467 citations


Journal ArticleDOI
TL;DR: This study developed a generalized additive modeling (GAM) method for satellite-based PM2.5 concentration mapping that outperforms LUR modeling at both the annual and seasonal scale, with obvious higher model fitting-based adjusted R2 and lower RMSEs.
Abstract: Satellite-based PM2.5 concentration estimation is growing as a popular solution to map the PM2.5 spatial distribution due to the insufficiency of ground-based monitoring stations. However, those applications usually suffer from the simple hypothesis that the influencing factors are linearly correlated with PM2.5 concentrations, though non-linear mechanisms indeed exist in their interactions. Taking the Beijing-Tianjin-Hebei (BTH) region in China as a case, this study developed a generalized additive modeling (GAM) method for satellite-based PM2.5 concentration mapping. In this process, the linear and non-linear relationships between PM2.5 variation and associated contributing factors, such as the aerosol optical depth (AOD), industrial sources, land use type, road network, and meteorological variables, were comprehensively considered. The reliability of the GAM models was validated by comparison with typical linear land use regression (LUR) models. Results show that GAM modeling outperforms LUR modeling at both the annual and seasonal scale, with obvious higher model fitting-based adjusted R2 and lower RMSEs. This is confirmed by the cross-validation-based adjusted R2 with values of GAM-based spring, summer, autumn, winter, and annual models, which are 0.92, 0.78, 0.87, 0.85, and 0.90, respectively, while those of LUR models are 0.87, 0.71, 0.84, 0.84, and 0.85, respectively. Different to the LUR-based hypothesis of the “straight line” relations, the “smoothed curves” from GAM-based apportionment analysis reveals that factors contributing to PM2.5 variation are unstable with the alternate linear and non-linear relations. The GAM model-based PM2.5 concentration surfaces clearly demonstrate their superiority in disclosing the heterogeneous PM2.5 concentrations to the discrete observations. It can be concluded that satellite-based PM2.5 concentration mapping could be greatly improved by GAM modeling given its simultaneous considerations of the linear and non-linear influencing mechanisms of PM2.5.

439 citations


Journal ArticleDOI
TL;DR: Preliminary results allow us to assume that Sentinel-2 will be a valuable tool for lake monitoring and research, especially taking into account that the data will be available routinely for many years, the imagery will be frequent, and free of charge.
Abstract: The importance of lakes and reservoirs leads to the high need for monitoring lake water quality both at local and global scales. The aim of the study was to test suitability of Sentinel-2 Multispectral Imager’s (MSI) data for mapping different lake water quality parameters. In situ data of chlorophyll a (Chl a), water color, colored dissolved organic matter (CDOM) and dissolved organic carbon (DOC) from nine small and two large lakes were compared with band ratio algorithms derived from Sentinel-2 Level-1C and atmospherically corrected (Sen2cor) Level-2A images. The height of the 705 nm peak was used for estimating Chl a. The suitability of the commonly used green to red band ratio was tested for estimating the CDOM, DOC and water color. Concurrent reflectance measurements were not available. Therefore, we were not able to validate the performance of Sen2cor atmospheric correction available in the Sentinel-2 Toolbox. The shape and magnitude of water reflectance were consistent with our field measurements from previous years. However, the atmospheric correction reduced the correlation between the band ratio algorithms and water quality parameters indicating the need in better atmospheric correction. We were able to show that there is good correlation between band ratio algorithms calculated from Sentinel-2 MSI data and lake water parameters like Chl a (R2 = 0.83), CDOM (R2 = 0.72) and DOC (R2 = 0.92) concentrations as well as water color (R2 = 0.52). The in situ dataset was limited in number, but covered a reasonably wide range of optical water properties. These preliminary results allow us to assume that Sentinel-2 will be a valuable tool for lake monitoring and research, especially taking into account that the data will be available routinely for many years, the imagery will be frequent, and free of charge.

333 citations


Journal ArticleDOI
TL;DR: A deep learning based framework for oil palm tree detection and counting using high-resolution remote sensing images for Malaysia, where more than 96% of the oil palm trees in the study area can be detected correctly when compared with the manually interpreted ground truth, and this is higher than the accuracies of the other three tree detection methods.
Abstract: Oil palm trees are important economic crops in Malaysia and other tropical areas. The number of oil palm trees in a plantation area is important information for predicting the yield of palm oil, monitoring the growing situation of palm trees and maximizing their productivity, etc. In this paper, we propose a deep learning based framework for oil palm tree detection and counting using high-resolution remote sensing images for Malaysia. Unlike previous palm tree detection studies, the trees in our study area are more crowded and their crowns often overlap. We use a number of manually interpreted samples to train and optimize the convolutional neural network (CNN), and predict labels for all the samples in an image dataset collected through the sliding window technique. Then, we merge the predicted palm coordinates corresponding to the same palm tree into one palm coordinate and obtain the final palm tree detection results. Based on our proposed method, more than 96% of the oil palm trees in our study area can be detected correctly when compared with the manually interpreted ground truth, and this is higher than the accuracies of the other three tree detection methods used in this study.

324 citations


Journal ArticleDOI
TL;DR: A protocol to identify urban land use functions over large areas using satellite images and open social data is developed and tested in Beijing, China, revealing significantly more details of the spatial pattern of land uses in Beijing than the land use map released by the government.
Abstract: High-resolution urban land use maps have important applications in urban planning and management, but the availability of these maps is low in countries such as China. To address this issue, we have developed a protocol to identify urban land use functions over large areas using satellite images and open social data. We first derived parcels from road networks contained in Open Street Map (OSM) and used the parcels as the basic mapping unit. We then used 10 features derived from Points of Interest (POI) data and two indices obtained from Landsat 8 Operational Land Imager (OLI) images to classify parcels into eight Level I classes and sixteen Level II classes of land use. Similarity measures and threshold methods were used to identify land use types in the classification process. This protocol was tested in Beijing, China. The results showed that the generated land use map had an overall accuracy of 81.04% and 69.89% for Level I and Level II classes, respectively. The map revealed significantly more details of the spatial pattern of land uses in Beijing than the land use map released by the government.

299 citations


Journal ArticleDOI
TL;DR: This is the first time that deep learning in recurrent neural networks is exploited for change detection and under the framework of the proposed method, changes can be detected under both binary detection and multi-class change detection.
Abstract: When exploited in remote sensing analysis, a reliable change rule with transfer ability can detect changes accurately and be applied widely. However, in practice, the complexity of land cover changes makes it difficult to use only one change rule or change feature learned from a given multi-temporal dataset to detect any other new target images without applying other learning processes. In this study, we consider the design of an efficient change rule having transferability to detect both binary and multi-class changes. The proposed method relies on an improved Long Short-Term Memory (LSTM) model to acquire and record the change information of long-term sequence remote sensing data. In particular, a core memory cell is utilized to learn the change rule from the information concerning binary changes or multi-class changes. Three gates are utilized to control the input, output and update of the LSTM model for optimization. In addition, the learned rule can be applied to detect changes and transfer the change rule from one learned image to another new target multi-temporal image. In this study, binary experiments, transfer experiments and multi-class change experiments are exploited to demonstrate the superiority of our method. Three contributions of this work can be summarized as follows: (1) the proposed method can learn an effective change rule to provide reliable change information for multi-temporal images; (2) the learned change rule has good transferability for detecting changes in new target images without any extra learning process, and the new target images should have a multi-spectral distribution similar to that of the training images; and (3) to the authors’ best knowledge, this is the first time that deep learning in recurrent neural networks is exploited for change detection. In addition, under the framework of the proposed method, changes can be detected under both binary detection and multi-class change detection.

286 citations


Journal ArticleDOI
TL;DR: This study proves UAV based SfM has the potential to become a new standard for high-throughput phenotyping of in-field crop heights and provides a novel spatial mapping of crop height variation both at the field scale and also within individual plots.
Abstract: There is a growing need to increase global crop yields, whilst minimising use of resources such as land, fertilisers and water. Agricultural researchers use ground-based observations to identify, select and develop crops with favourable genotypes and phenotypes; however, the ability to collect rapid, high quality and high volume phenotypic data in open fields is restricting this. This study develops and assesses a method for deriving crop height and growth rate rapidly from multi-temporal, very high spatial resolution (1 cm/pixel), 3D digital surface models of crop field trials produced via Structure from Motion (SfM) photogrammetry using aerial imagery collected through repeated campaigns flying an Unmanned Aerial Vehicle (UAV) with a mounted Red Green Blue (RGB) camera. We compare UAV SfM modelled crop heights to those derived from terrestrial laser scanner (TLS) and to the standard field measurement of crop height conducted using a 2 m rule. The most accurate UAV-derived surface model and the TLS both achieve a Root Mean Squared Error (RMSE) of 0.03 m compared to the existing manual 2 m rule method. The optimised UAV method was then applied to the growing season of a winter wheat field phenotyping experiment containing 25 different varieties grown in 27 m2 plots and subject to four different nitrogen fertiliser treatments. Accuracy assessments at different stages of crop growth produced consistently low RMSE values (0.07, 0.02 and 0.03 m for May, June and July, respectively), enabling crop growth rate to be derived from differencing of the multi-temporal surface models. We find growth rates range from −13 mm/day to 17 mm/day. Our results clearly display the impact of variable nitrogen fertiliser rates on crop growth. Digital surface models produced provide a novel spatial mapping of crop height variation both at the field scale and also within individual plots. This study proves UAV based SfM has the potential to become a new standard for high-throughput phenotyping of in-field crop heights.

Journal ArticleDOI
TL;DR: This paper shows how a convolutional neural network can be applied to multispectral orthoimagery and a digital surface model of a small city for a full, fast and accurate per-pixel classification.
Abstract: The availability of high-resolution remote sensing (HRRS) data has opened up the possibility for new interesting applications, such as per-pixel classification of individual objects in greater detail. This paper shows how a convolutional neural network (CNN) can be applied to multispectral orthoimagery and a digital surface model (DSM) of a small city for a full, fast and accurate per-pixel classification. The predicted low-level pixel classes are then used to improve the high-level segmentation. Various design choices of the CNN architecture are evaluated and analyzed. The investigated land area is fully manually labeled into five categories (vegetation, ground, roads, buildings and water), and the classification accuracy is compared to other per-pixel classification works on other land areas that have a similar choice of categories. The results of the full classification and segmentation on selected segments of the map show that CNNs are a viable tool for solving both the segmentation and object recognition task for remote sensing data.

Journal ArticleDOI
TL;DR: A clear conclusion of the review is that advances in both sensor technology and processing algorithms continue to drive forward remote sensing capability for coral reef mapping, particularly with respect to spatial resolution of maps, and synthesis across multiple data products.
Abstract: Coral reefs are in decline worldwide and monitoring activities are important for assessing the impact of disturbance on reefs and tracking subsequent recovery or decline. Monitoring by field surveys provides accurate data but at highly localised scales and so is not cost-effective for reef scale monitoring at frequent time points. Remote sensing from satellites is an alternative and complementary approach. While remote sensing cannot provide the level of detail and accuracy at a single point than a field survey, the statistical power for inferring large scale patterns benefits in having complete areal coverage. This review considers the state of the art of coral reef remote sensing for the diverse range of objectives relevant for management, ranging from the composition of the reef: physical extent, benthic cover, bathymetry, rugosity; to environmental parameters: sea surface temperature, exposure, light, carbonate chemistry. In addition to updating previous reviews, here we also consider the capability to go beyond basic maps of habitats or environmental variables, to discuss concepts highly relevant to stakeholders, policy makers and public communication: such as biodiversity, environmental threat and ecosystem services. A clear conclusion of the review is that advances in both sensor technology and processing algorithms continue to drive forward remote sensing capability for coral reef mapping, particularly with respect to spatial resolution of maps, and synthesis across multiple data products. Both trends can be expected to continue.

Journal ArticleDOI
TL;DR: Establishing a more systematic relationship between higher-level image elements and slum characteristics is essential to train algorithms able to analyze variations in slum morphologies to facilitate global slum monitoring.
Abstract: The body of scientific literature on slum mapping employing remote sensing methods has increased since the availability of more very-high-resolution (VHR) sensors. This improves the ability to produce information for pro-poor policy development and to build methods capable of supporting systematic global slum monitoring required for international policy development such as the Sustainable Development Goals. This review provides an overview of slum mapping-related remote sensing publications over the period of 2000–2015 regarding four dimensions: contextual factors, physical slum characteristics, data and requirements, and slum extraction methods. The review has shown the following results. First, our contextual knowledge on the diversity of slums across the globe is limited, and slum dynamics are not well captured. Second, a more systematic exploration of physical slum characteristics is required for the development of robust image-based proxies. Third, although the latest commercial sensor technologies provide image data of less than 0.5 m spatial resolution, thereby improving object recognition in slums, the complex and diverse morphology of slums makes extraction through standard methods difficult. Fourth, successful approaches show diversity in terms of extracted information levels (area or object based), implemented indicator sets (single or large sets) and methods employed (e.g., object-based image analysis (OBIA) or machine learning). In the context of a global slum inventory, texture-based methods show good robustness across cities and imagery. Machine-learning algorithms have the highest reported accuracies and allow working with large indicator sets in a computationally efficient manner, while the upscaling of pixel-level information requires further research. For local slum mapping, OBIA approaches show good capabilities of extracting both area- and object-based information. Ultimately, establishing a more systematic relationship between higher-level image elements and slum characteristics is essential to train algorithms able to analyze variations in slum morphologies to facilitate global slum monitoring.

Journal ArticleDOI
TL;DR: IMERG yields better results for detection of precipitation events on the basis of Probability of Detection (POD), Critical Success Index (CSI) and False Alarm Ratio (FAR) in those areas with stratiform and orographic precipitation, such as Tehran and Kermanshah, compared with other satellite/model data sets.
Abstract: The new generation of weather observatory satellites, namely Global Precipitation Measurement (GPM) constellation satellites, is the lead observatory of the 10 highly advanced earth orbiting weather research satellites. Indeed, GPM is the first satellite that has been designed to measure light rain and snowfall, in addition to heavy tropical rainfall. This work compares the final run of the Integrated Multi-satellitE Retrievals for GPM (IMERG) product, the post real time of TRMM and Multi-satellite Precipitation Analysis (TMPA-3B42) and the Era-Interim product from the European Centre for Medium Range Weather Forecasts (ECMWF) against the Iran Meteorological Organization (IMO) daily precipitation measured by the synoptic rain-gauges over four regions with different topography and climate conditions in Iran. Assessment is implemented for a one-year period from March 2014 to February 2015. Overall, in daily scale the results reveal that all three products lead to underestimation but IMERG performs better than other products and underestimates precipitation slightly in all four regions. Based on monthly and seasonal scale, in Guilan all products, in Bushehr and Kermanshah ERA-Interim and in Tehran IMERG and ERA-Interim tend to underestimate. The correlation coefficient between IMERG and the rain-gauge data in daily scale is far superior to that of Era-Interim and TMPA-3B42. On the basis of daily timescale of bias in comparison with the ground data, the IMERG product far outperforms ERA-Interim and 3B42 products. According to the categorical verification technique in this study, IMERG yields better results for detection of precipitation events on the basis of Probability of Detection (POD), Critical Success Index (CSI) and False Alarm Ratio (FAR) in those areas with stratiform and orographic precipitation, such as Tehran and Kermanshah, compared with other satellite/model data sets. In particular, for heavy precipitation (>15 mm/day), IMERG is superior to the other products in all study areas and could be used in future for meteorological and hydrological models, etc.

Journal ArticleDOI
TL;DR: It is shown that active sources are becoming more prominent in ITCD studies, and comparison of methods continues to be complicated by both choice of reference data and assessment metric; it is imperative to establish a standardized two-level assessment framework to evaluate and compare I TCD algorithms in order to provide specific recommendations about suitable applications of particular algorithms.
Abstract: Automated individual tree crown detection and delineation (ITCD) using remotely sensed data plays an increasingly significant role in efficiently, accurately, and completely monitoring forests. This paper reviews trends in ITCD research from 1990–2015 from several perspectives—data/forest type, method applied, accuracy assessment and research objective—with a focus on studies using LiDAR data. This review shows that active sources are becoming more prominent in ITCD studies. Studies using active data—LiDAR in particular—accounted for 80% of the total increase over the entire time period, those using passive data or fusion of passive and active data comprised relatively small proportions of the total increase (8% and 12%, respectively). Additionally, ITCD research has moved from incremental adaptations of algorithms developed for passive data sources to innovative approaches that take advantage of the novel characteristics of active datasets like LiDAR. These improvements make it possible to explore more complex forest conditions (e.g., closed hardwood forests, suburban/urban forests) rather than a single forest type although most published ITCD studies still focused on closed softwood (41%) or mixed forest (22%). Approximately one-third of studies applied individual tree level (30%) assessment, with only a quarter reporting more comprehensive multi-level assessment (23%). Almost one-third of studies (32%) that concentrated on forest parameter estimation based on ITCD results had no ITCD-specific evaluation. Comparison of methods continues to be complicated by both choice of reference data and assessment metric; it is imperative to establish a standardized two-level assessment framework to evaluate and compare ITCD algorithms in order to provide specific recommendations about suitable applications of particular algorithms. However, the evolution of active remotely sensed data and novel platforms implies that automated ITCD will continue to be a promising technology and an attractive research topic for both the forestry and remote sensing communities.

Journal ArticleDOI
TL;DR: The statistically-significant associations between C6 LAI and climate variables indicate that C6LAI has the potential to provide reliable biophysical information about the land surface when diagnosing climate-driven vegetation responses.
Abstract: The aim of this paper is to assess the latest version of the MODIS LAI/FPAR product (MOD15A2H), namely Collection 6 (C6). We comprehensively evaluate this product through three approaches: validation with field measurements, intercomparison with other LAI/FPAR products and comparison with climate variables. Comparisons between ground measurements and C6, as well as C5 LAI/FPAR indicate: (1) MODIS LAI is closer to true LAI than effective LAI; (2) the C6 product is considerably better than C5 with RMSE decreasing from 0.80 down to 0.66; (3) both C5 and C6 products overestimate FPAR over sparsely-vegetated areas. Intercomparisons with three existing global LAI/FPAR products (GLASS, CYCLOPES and GEOV1) are carried out at site, continental and global scales. MODIS and GLASS (CYCLOPES and GEOV1) agree better with each other. This is expected because the surface reflectances, from which these products were derived, were obtained from the same instrument. Considering all biome types, the RMSE of LAI (FPAR) derived from any two products ranges between 0.36 (0.05) and 0.56 (0.09). Temporal comparisons over seven sites for the 2001–2004 period indicate that all products properly capture the seasonality in different biomes, except evergreen broadleaf forests, where infrequent observations due to cloud contamination induce unrealistic variations. Thirteen years of C6 LAI, temperature and precipitation time series data are used to assess the degree of correspondence between their variations. The statistically-significant associations between C6 LAI and climate variables indicate that C6 LAI has the potential to provide reliable biophysical information about the land surface when diagnosing climate-driven vegetation responses.

Journal ArticleDOI
TL;DR: This paper uses convolutional neural networks to extract deep features from high levels of the image data using a sparse representation classification framework and reveals that the proposed method exploits the inherent low-dimensional structure of the deep features to provide better classification results.
Abstract: In recent years, deep learning has been widely studied for remote sensing image analysis. In this paper, we propose a method for remotely-sensed image classification by using sparse representation of deep learning features. Specifically, we use convolutional neural networks (CNN) to extract deep features from high levels of the image data. Deep features provide high level spatial information created by hierarchical structures. Although the deep features may have high dimensionality, they lie in class-dependent sub-spaces or sub-manifolds. We investigate the characteristics of deep features by using a sparse representation classification framework. The experimental results reveal that the proposed method exploits the inherent low-dimensional structure of the deep features to provide better classification results as compared to the results obtained by widely-used feature exploration algorithms, such as the extended morphological attribute profiles (EMAPs) and sparse coding (SC).

Journal ArticleDOI
TL;DR: Investigating aerial survey data quality in relation to the application of ground control points (GCPs) at a site of undulating topography contributes to the understanding of the sources of error when conducting a UAV-SfM survey and provides guidance on the collection of GCPs.
Abstract: The use of small UAV (Unmanned Aerial Vehicle) and Structure-from-Motion (SfM) with Multi-View Stereopsis (MVS) for acquiring survey datasets is now commonplace, however, aspects of the SfM-MVS workflow require further validation. This work aims to provide guidance for scientists seeking to adopt this aerial survey method by investigating aerial survey data quality in relation to the application of ground control points (GCPs) at a site of undulating topography (Ennerdale, Lake District, UK). Sixteen digital surface models (DSMs) were produced from a UAV survey using a varying number of GCPs (3-101). These DSMs were compared to 530 dGPS spot heights to calculate vertical error. All DSMs produced reasonable surface reconstructions (vertical root-mean-square-error (RMSE) of <0.2 m), however, an improvement in DSM quality was found where four or more GCPs (up to 101 GCPs) were applied, with errors falling to within the suggested point quality range of the survey equipment used for GCP acquisition (e.g., vertical RMSE of <0.09 m). The influence of a poor GCP distribution was also investigated by producing a DSM using an evenly distributed network of GCPs, and comparing it to a DSM produced using a clustered network of GCPs. The results accord with existing findings, where vertical error was found to increase with distance from the GCP cluster. Specifically vertical error and distance to the nearest GCP followed a strong polynomial trend (R2 = 0.792). These findings contribute to our understanding of the sources of error when conducting a UAV-SfM survey and provide guidance on the collection of GCPs. Evidence-driven UAV-SfM survey designs are essential for practitioners seeking reproducible, high quality topographic datasets for detecting surface change.

Journal ArticleDOI
TL;DR: Overall, increased temperature and enhanced precipitation favored vegetation growth, however, their combined effects exhibited strong spatial heterogeneity, and precipitation was the limiting factor in Tibet during dry periods.
Abstract: Grasslands occupy nearly three quarters of the land surface of the Qinghai-Tibet plateau (QTP) and play a critical role in regulating the ecological functions of the QTP. Ongoing climate change and human interference have greatly affected grasslands on the QTP. Differentiating human-induced and climate-driven vegetation changes is vital for both ecological understanding and the management of husbandry. In this study, we employed statistical analysis of annual records, various sources of remote sensing data, and an ecosystem process model to calculate the relative contribution of climate and human activities to vegetation vigor on the QTP. The temperature, precipitation and the intensity and spatial pattern of livestock grazing differed between the periods prior to and after the year 2000, which led to different vegetation dynamics. Overall, increased temperature and enhanced precipitation favored vegetation growth. However, their combined effects exhibited strong spatial heterogeneity. Specifically, increased temperature restrained vegetation growth in dry steppe regions during a period of slightly increasing precipitation from 1986 to 2000 and in meadow regions during a period of precipitation decline during 2000–2011, thereby making precipitation a dominant factor. An increase in precipitation tended to enhance vegetation growth in wet meadow regions during warm periods, and temperature was the limiting factor in Tibet during dry periods. The dominant role played by climate and human activities differed with location and targeted time period. Areas dominated by human activities are much smaller than those dominated by climate. The effects of grazing on grassland pasture were more obvious under unfavorable climate conditions than under suitable ones.

Journal ArticleDOI
TL;DR: It was shown that the use of SAR imagery allows to use optical data without gap-filling yielding results which are equivalent to theUse of gap- filling in the case of perfect cloud screening, and better results in the cases of cloud screening errors.
Abstract: High temporal and spatial resolution optical image time series have been proven efficient for crop type mapping at the end of the agricultural season. However, due to cloud cover and image availability, crop identification earlier in the season is difficult. The recent availability of high temporal and spatial resolution SAR image time series, opens the possibility of improving early crop type mapping. This paper studies the impact of such SAR image time series when used in complement of optical imagery. The pertinent SAR image features, the optimal working resolution, the effect of speckle filtering and the use of temporal gap-filling of the optical image time series are assessed. SAR image time series as those provided by the Sentinel-1 satellites allow significant improvements in terms of land cover classification, both in terms of accuracy at the end of the season and for early crop identification. Haralik textures (Entropy, Inertia), the polarization ratio and the local mean together with the VV imagery were found to be the most pertinent features. Working at at 10 m resolution and using speckle filtering yield better results than other configurations. Finally it was shown that the use of SAR imagery allows to use optical data without gap-filling yielding results which are equivalent to the use of gap-filling in the case of perfect cloud screening, and better results in the case of cloud screening errors.

Journal ArticleDOI
TL;DR: Comparisons between corresponding bands and band combinations point out that in most cases the two sensors can be well combined; however, some issues arise regarding near-infrared bands when Sentinel-2 data are combined with both Landsat 8 and older Landsat images.
Abstract: The availability of new generation multispectral sensors of the Landsat 8 and Sentinel-2 satellite platforms offers unprecedented opportunities for long-term high-frequency monitoring applications. The present letter aims at highlighting some potentials and challenges deriving from the spectral and spatial characteristics of the two instruments. Some comparisons between corresponding bands and band combinations were performed on the basis of different datasets: the first consists of a set of simulated images derived from a hyperspectral Hyperion image, the other five consist instead of pairs of real images (Landsat 8 and Sentinel-2A) acquired on the same date, over five areas. Results point out that in most cases the two sensors can be well combined; however, some issues arise regarding near-infrared bands when Sentinel-2 data are combined with both Landsat 8 and older Landsat images.

Journal ArticleDOI
TL;DR: This study provides a full overview of Collect Earth’s structure and functionality, and presents the methodology used to undertake land monitoring through augmented visual interpretation, and an example of land monitoring in Papua New Guinea is presented.
Abstract: Collect Earth is a free and open source software for land monitoring developed by the Food and Agriculture Organization of the United Nations (FAO). Built on Google desktop and cloud computing technologies, Collect Earth facilitates access to multiple freely available archives of satellite imagery, including archives with very high spatial resolution imagery (Google Earth, Bing Maps) and those with very high temporal resolution imagery (e.g., Google Earth Engine, Google Earth Engine Code Editor). Collectively, these archives offer free access to an unparalleled amount of information on current and past land dynamics for any location in the world. Collect Earth draws upon these archives and the synergies of imagery of multiple resolutions to enable an innovative method for land monitoring that we present here: augmented visual interpretation. In this study, we provide a full overview of Collect Earth’s structure and functionality, and we present the methodology used to undertake land monitoring through augmented visual interpretation. To illustrate the application of the tool and its customization potential, an example of land monitoring in Papua New Guinea (PNG) is presented. The PNG example demonstrates that Collect Earth is a comprehensive and user-friendly tool for land monitoring and that it has the potential to be used to assess land use, land use change, natural disasters, sustainable management of scarce resources and ecosystem functioning. By enabling non-remote sensing experts to assess more than 100 sites per day, we believe that Collect Earth can be used to rapidly and sustainably build capacity for land monitoring and to substantively improve our collective understanding of the world’s land use and land cover.

Journal ArticleDOI
TL;DR: Overall, IMERG can capture the spatial patterns of precipitation over China well and performs a little better than TRMM 3B43 at seasonal and monthly scales; but most IMERG products over these areas are unreliable and IMERG shows poor performance in winter even if GPM improved its ability to sense frozen precipitation.
Abstract: As the successor of the Tropical Rainfall Measuring Mission (TRMM), the Global Precipitation Measurement (GPM) mission significantly improves the spatial resolution of precipitation estimates from 0.25° to 0.1°. The present study analyzed the error structures of Integrated Multisatellite Retrievals for GPM (IMERG) monthly precipitation products over Mainland China from March 2014 to February 2015 using gauge measurements at multiple spatiotemporal scales. Moreover, IMERG products were also compared with TRMM 3B43 products. The results show that: (1) overall, IMERG can capture the spatial patterns of precipitation over China well. It performs a little better than TRMM 3B43 at seasonal and monthly scales; (2) the performance of IMERG varies greatly spatially and temporally. IMERG performs better at low latitudes than at middle latitudes, and shows worse performance in winter than at other times; (3) compared with TRMM 3B43, IMERG significantly improves the estimation accuracy of precipitation over the Xinjiang region and the Qinghai-Tibetan Plateau, especially over the former where IMERG increases Pearson correlation coefficient by 0.18 and decreases root-mean-square error by 54.47 mm for annual precipitation estimates. However, most IMERG products over these areas are unreliable; and (4) IMERG shows poor performance in winter as TRMM 3B43 even if GPM improved its ability to sense frozen precipitation. Most of them over North China are unreliable during this period.

Journal ArticleDOI
TL;DR: A new dataset is presented, consisting of 21,030 polygons from across the country that were manually classified as “built-up” or “not built-up,” which is used for supervised image classification and detection of urban areas in India and has potential use in GEE for temporal large-scale analysis of the urbanization process.
Abstract: Urbanization often occurs in an unplanned and uneven manner, resulting in profound changes in patterns of land cover and land use. Understanding these changes is fundamental for devising environmentally responsible approaches to economic development in the rapidly urbanizing countries of the emerging world. One indicator of urbanization is built-up land cover that can be detected and quantified at scale using satellite imagery and cloud-based computational platforms. This process requires reliable and comprehensive ground-truth data for supervised classification and for validation of classification products. We present a new dataset for India, consisting of 21,030 polygons from across the country that were manually classified as “built-up” or “not built-up,” which we use for supervised image classification and detection of urban areas. As a large and geographically diverse country that has been undergoing an urban transition, India represents an ideal context to develop and test approaches for the detection of features related to urbanization. We perform the analysis in Google Earth Engine (GEE) using three types of classifiers, based on imagery from Landsat 7 and Landsat 8 as inputs. The methodology produces high-quality maps of built-up areas across space and time. Although the dataset can facilitate supervised image classification in any platform, we highlight its potential use in GEE for temporal large-scale analysis of the urbanization process. Our methodology can easily be applied to other countries and regions.

Journal ArticleDOI
TL;DR: This study suggests that in semi-arid cities, such as Tehran, with the urban-rural indicator, a surface urban cool island may be observed in daytime while SUHI at nighttime; with other indicators, SUHI can be seen in both day and night.
Abstract: The process of the surface urban heat island (SUHI) varies with latitude, climate, topography and meteorological conditions. This study investigated the seasonal variability of SUHI in the Tehran metropolitan area, Iran, with respect to selected surface biophysical variables. Terra Moderate Resolution Imaging Spectroradiometer (MODIS) Land Surface Temperature (LST) was retrieved as nighttime LST data, while daytime LST was retrieved from Landsat 8 Thermal Infrared Sensor (TIRS) using the split-window algorithm. Both data covered the time period from September 2013 to September 2015. To assess SUHI intensity, we employed three SUHI indicators, i.e., the LST difference of urban-rural, that of urban-agriculture and that of urban-water. Physical and biophysical surface variables, including land use and land cover (LULC), elevation, impervious surface (IS), fractional vegetation cover (FVC) and albedo, were selected to estimate the relationship between LST seasonal variability and the surface properties. Results show that an inversion of the SUHI phenomenon (i.e., surface urban cool island) existed at daytime with the maximal value of urban-rural LST difference of −4 K in March; whereas the maximal value of SUHI at nighttime yielded 3.9 K in May. When using the indicators of urban-agriculture and urban-water LST differences, the maximal value of SUHI was found to be 8.2 K and 15.5 K, respectively. Both results were observed at daytime, suggesting the role of bare soils in the inversion of the SUHI phenomenon with the urban-rural indicator. Maximal correlation was observed in the relationship between night LST and elevation in spring (coefficient: −0.76), night LST and IS in spring (0.60), night LST and albedo in winter (−0.53) and day LST with fractional vegetation cover in summer (−0.41). The relationship between all surface properties with LST possessed large seasonal variations, and thus, using these relationships for SUHI modeling may not be effective. The only exception existed in the correlation between elevation and IS, which may be useful to simulate the SUHI at night. This study suggests that in semi-arid cities, such as Tehran, with the urban-rural indicator, a surface urban cool island may be observed in daytime while SUHI at nighttime; with other indicators, SUHI can be observed in both day and night. Thus, SUHI studies require the acquisition of remote sensing image data at both daytime and nighttime and careful selection of SUHI indicators.

Journal ArticleDOI
TL;DR: The objective of this study is to investigate the level of accuracy that can be achieved using two of these software tools: Agisoft PhotoScan Pro and an open-source alternative, IGN © MicMac ® in sub-optimal survey conditions.
Abstract: For monitoring purposes and in the context of geomorphological research, Unmanned Aerial Vehicles (UAV) appear to be a promising solution to provide multi-temporal Digital Surface Models (DSMs) and orthophotographs. There are a variety of photogrammetric software tools available for UAV-based data. The objective of this study is to investigate the level of accuracy that can be achieved using two of these software tools: Agisoft PhotoScan ® Pro and an open-source alternative, IGN © MicMac ® , in sub-optimal survey conditions (rugged terrain, with a large variety of morphological features covering a range of roughness sizes, poor GPS reception). A set of UAV images has been taken by a hexacopter drone above the Riviere des Remparts, a river on Reunion Island. This site was chosen for its challenging survey conditions: the topography of the study area (i) involved constraints on the flight plan; (ii) implied errors on some GPS measurements; (iii) prevented an optimal distribution of the Ground Control Points (GCPs) and; (iv) was very complex to reconstruct. Several image processing tests are performed with different scenarios in order to analyze the sensitivity of each software package to different parameters (image quality, numbers of GCPs, etc.). When computing the horizontal and vertical errors within a control region on a set of ground reference targets, both methods provide rather similar results. A precision up to 3–4 cm is achievable with these software packages. The DSM quality is also assessed over the entire study area comparing PhotoScan DSM and MicMac DSM with a Terrestrial Laser Scanner (TLS) point cloud. PhotoScan and MicMac DSM are also compared at the scale of particular features. Both software packages provide satisfying results: PhotoScan is more straightforward to use but its source code is not open; MicMac is recommended for experimented users as it is more flexible.

Journal ArticleDOI
TL;DR: A preliminary test showed that noticeable improvement of the quality of the classification could be gained from the increased spatial detail and from the thematic contents of Sentinel-2 compared to the Landsat derived product as well as from the complementarity between Sentinel-1 and Sentinel- 2 images.
Abstract: Monitoring of the human-induced changes and the availability of reliable and methodologically consistent urban area maps are essential to support sustainable urban development on a global scale. The Global Human Settlement Layer (GHSL) is a project funded by the European Commission, Joint Research Centre, which aims at providing scientific methods and systems for reliable and automatic mapping of built-up areas from remote sensing data. In the frame of the GHSL, the opportunities offered by the recent availability of Sentinel-2 data are being explored using a novel image classification method, called Symbolic Machine Learning (SML), for detailed urban land cover mapping. In this paper, a preliminary test was implemented with the purpose of: (i) assessing the applicability of the SML classifier on Sentinel-2 imagery; (ii) evaluating the complementarity of Sentinel-1 and Sentinel-2; and (iii) understanding the added-value of Sentinel-2 with respect to Landsat for improving global high-resolution human settlement mapping. The overall objective is to explore areas of improvement, including the possibility of synergistic use of the different sensors. The results showed that noticeable improvement of the quality of the classification could be gained from the increased spatial detail and from the thematic contents of Sentinel-2 compared to the Landsat derived product as well as from the complementarity between Sentinel-1 and Sentinel-2 images.

Journal ArticleDOI
TL;DR: Spatial features of texture and structure were far more important in algorithmic classification than spectral information, highlighting the potential for future implementation of machine learning algorithms which use panchromatic or pansharpened imagery alone.
Abstract: Remote sensing continues to be an invaluable tool in earthquake damage assessments and emergency response. This study evaluates the effectiveness of multilayer feedforward neural networks, radial basis neural networks, and Random Forests in detecting earthquake damage caused by the 2010 Port-au-Prince, Haiti 7.0 moment magnitude (Mw) event. Additionally, textural and structural features including entropy, dissimilarity, Laplacian of Gaussian, and rectangular fit are investigated as key variables for high spatial resolution imagery classification. Our findings show that each of the algorithms achieved nearly a 90% kernel density match using the United Nations Operational Satellite Applications Programme (UNITAR/UNOSAT) dataset as validation. The multilayer feedforward network was able to achieve an error rate below 40% in detecting damaged buildings. Spatial features of texture and structure were far more important in algorithmic classification than spectral information, highlighting the potential for future implementation of machine learning algorithms which use panchromatic or pansharpened imagery alone.

Journal ArticleDOI
TL;DR: By quantifying the impact of input changes, it is found that the improvements of both land-cover and reflectance products improve LAI/FPAR products and spatial scale effects due to a resolution change from 1 km to 500 m do not cause any significant differences.
Abstract: As the latest version of Moderate Resolution Imaging Spectroradiometer (MODIS) Leaf Area Index (LAI) and Fraction of Photosynthetically Active Radiation (FPAR) products, Collection 6 (C6) has been distributed since August 2015. This collection is evaluated in this two-part series with the goal of assessing product accuracy, uncertainty and consistency with the previous version. In this first paper, we compare C6 (MOD15A2H) with Collection 5 (C5) to check for consistency and discuss the scale effects associated with changing spatial resolution between the two collections and benefits from improvements to algorithm inputs. Compared with C5, C6 benefits from two improved inputs: (1) L2G–lite surface reflectance at 500 m resolution in place of reflectance at 1 km resolution; and (2) new multi-year land-cover product at 500 m resolution in place of the 1 km static land-cover product. Global and seasonal comparison between C5 and C6 indicates good continuity and consistency for all biome types. Moreover, inter-annual LAI anomalies at the regional scale from C5 and C6 agree well. The proportion of main radiative transfer algorithm retrievals in C6 increased slightly in most biome types, notably including a 17% improvement in evergreen broadleaf forests. With same biome input, the mean RMSE of LAI and FPAR between C5 and C6 at global scale are 0.29 and 0.091, respectively, but biome type disagreement worsens the consistency (LAI: 0.39, FPAR: 0.102). By quantifying the impact of input changes, we find that the improvements of both land-cover and reflectance products improve LAI/FPAR products. Moreover, we find that spatial scale effects due to a resolution change from 1 km to 500 m do not cause any significant differences.