Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

A random forest (RF) classifier is an ensemble classifier that produces multiple decision trees, using a randomly selected subset of training samples and variables. This classifier has become popular within the remote sensing community due to the accuracy of its classifications. The overall objective of this work was to review the utilization of RF classifier in remote sensing. This review has revealed that RF classifier can successfully handle high data dimensionality and multicolinearity, being both fast and insensitive to overfitting. It is, however, sensitive to the sampling design. The variable importance (VI) measurement provided by the RF classifier has been extensively exploited in different scenarios, for example to reduce the number of dimensions of hyperspectral data, to identify the most relevant multisource remote sensing and geographic data, and to select the most suitable season to classify particular target classes. Further investigations are required into less commonly exploited uses of this classifier, such as for sample proximity analysis to detect and remove outliers in the training samples.

Random forest in remote sensing: A review of applications and future directions

A wide range of methods for analysis of airborne- and satellite-derived imagery continues to be proposed and assessed. In this paper, we review remote sensing implementations of support vector machines (SVMs), a promising machine learning methodology. This review is timely due to the exponentially increasing number of works published in recent years. SVMs are particularly appealing in the remote sensing field due to their ability to generalize well even with limited training samples, a common limitation for remote sensing applications. However, they also suffer from parameter assignment issues that can significantly affect obtained results. A summary of empirical results is provided for various applications of over one hundred published works (as of April, 2010). It is our hope that this survey will provide guidelines for future applications of SVMs and possible areas of algorithm enhancement.

https://www.aboutgis.com/Publications/Mountrakis_SVM_review_in_remote_sensing_ISPRS2010.pdf

Support vector machines in remote sensing: A review

Land cover monitoring using remotely sensed data requires robust classification methods which allow for the accurate mapping of complex land cover and land use categories. Random forest (RF) is a powerful machine learning classifier that is relatively unknown in land remote sensing and has not been evaluated thoroughly by the remote sensing community compared to more conventional pattern recognition techniques. Key advantages of RF include: their non-parametric nature; high classification accuracy; and capability to determine variable importance. However, the split rules for classification are unknown, therefore RF can be considered to be black box type classifier. RF provides an algorithm for estimating missing values; and flexibility to perform several types of data analysis, including regression, classification, survival analysis, and unsupervised learning.

In this paper, the performance of the RF classifier for land cover classification of a complex area is explored. Evaluation was based on several criteria: mapping accuracy, sensitivity to data set size and noise. Landsat-5 Thematic Mapper data captured in European spring and summer were used with auxiliary variables derived from a digital terrain model to classify 14 different land categories in the south of Spain. Results show that the RF algorithm yields accurate land cover classifications, with 92% overall accuracy and a Kappa index of 0.92. RF is robust to training data reduction and noise because significant differences in kappa values were only observed for data reduction and noise addition values greater than 50 and 20%, respectively. Additionally, variables that RF identified as most important for classifying land cover coincided with expectations. A McNemar test indicates an overall better performance of the random forest model over a single decision tree at the 0.00001 significance level.

An assessment of the effectiveness of a random forest classifier for land-cover classification

The development of the Internet in recent years has made it possible and useful to access many different information systems anywhere in the world to obtain information. While there is much research on the integration of heterogeneous information systems, most commercial systems stop short of the actual integration of available data. Data fusion is the process of fusing multiple records representing the same real-world object into a single, consistent, and clean representation.This article places data fusion into the greater context of data integration, precisely defines the goals of data fusion, namely, complete, concise, and consistent data, and highlights the challenges of data fusion, namely, uncertain and conflicting data values. We give an overview and classification of different ways of fusing data and present several techniques based on standard and advanced operators of the relational algebra and SQL. Finally, the article features a comprehensive survey of data integration systems from academia and industry, showing if and how data fusion is performed in each.

Data fusion

In this paper, we propose an incremental learning strategy for import vector machines (IVM), which is a sparse kernel logistic regression approach. We use the procedure for the concept of self-training for sequential classification of hyperspectral data. The strategy comprises the inclusion of new training samples to increase the classification accuracy and the deletion of noninformative samples to be memory and runtime efficient. Moreover, we update the parameters in the incremental IVM model without retraining from scratch. Therefore, the incremental classifier is able to deal with large data sets. The performance of the IVM in comparison to support vector machines (SVM) is evaluated in terms of accuracy, and experiments are conducted to assess the potential of the probabilistic outputs of the IVM. Experimental results demonstrate that the IVM and SVM perform similar in terms of classification accuracy. However, the number of import vectors is significantly lower when compared to the number of support vectors, and thus, the computation time during classification can be decreased. Moreover, the probabilities provided by IVM are more reliable, when compared to the probabilistic information, derived from an SVM's output. In addition, the proposed self-training strategy can increase the classification accuracy. Overall, the IVM and its incremental version is worthwhile for the classification of hyperspectral data.

/pdf/incremental-import-vector-machines-for-classifying-4nkd19pp4d.pdf

Incremental Import Vector Machines for Classifying Hyperspectral Data

The global demand for agricultural products is surging due to population growth, more meat-based diets, and the increasing role of bioenergy. Three strategies can increase agricultural production: (1) expanding agriculture into natural ecosystems; (2) intensifying existing farmland; or (3) recultivating abandoned farmland. Because agricultural expansion entails substantial environmental trade-offs, intensification and recultivation are currently gaining increasing attention. Assessing where these strategies may be pursued, however, requires improved spatial information on land use intensity, including where farmland is active and fallow. We developed a framework to integrate optical and radar data in order to advance the mapping of three farmland management regimes: (1) large-scale, mechanized agriculture; (2) small-scale, subsistence agriculture; and (3) fallow or abandoned farmland. We applied this framework to our study area in western Ukraine, a region characterized by marked spatial heterogeneity in management intensity due to the legacies from Soviet land management, the breakdown of the Soviet Union in 1991, and the recent integration of this region into world markets. We mapped land management regimes using a hierarchical, object-based framework. Image segmentation for delineating objects was performed by using the Superpixel Contour algorithm. We then applied Random Forest classification to map land management regimes and validated our map using randomly sampled in-situ data, obtained during an extensive field campaign. Our results showed that farmland management regimes were mapped reliably, resulting in a final map with an overall accuracy of 83.4%. Comparing our land management regimes map with a soil map revealed that most fallow land occurred on soils marginally suited for agriculture, but some areas within our study region contained considerable potential for recultivation. Overall, our study highlights the potential for an improved, more nuanced mapping of agricultural land use by combining imagery of different sensors.

/pdf/mapping-land-management-regimes-in-western-ukraine-using-59nx9vu0ld.pdf

Mapping Land Management Regimes in Western Ukraine Using Optical and SAR Data

Land use changes have a pronounced impact on hydrology. Vice versa, hydrologic changes affect land use patterns. The objective of this study is to test whether hydrologic variables can explain land use change. We employ a set of spatially distributed hydrologic variables and compare it against a set of commonly used explanatory variables for land use change. The explanatory power of these variables is assessed by using a logistic regression approach to model the spatial distribution of land use changes in a meso-scale Indian catchment. When hydrologic variables are additionally included, the accuracies of the logistic regression models improve, which is indicated by a change in the relative operating characteristic statistic (ROC) by up to 11%. This is mostly due to the complementarity of the two datasets that is reflected in the use of 44% commonly used variables and 56% hydrologic variables in the best models for land use change. Display Omitted Hydrologic patterns can contribute towards explaining land use change.Hydrologic variables complement commonly used explanatory variables for land use change.Modeled hydrologic variables improve land use change modeling.

Importance of spatially distributed hydrologic variables for land use change modeling

http://media.journals.elsevier.com/content/files/1roscher-05032210.pdf

Editors Choice Article: I2VM: Incremental import vector machines

Several applications have been developed in the field of remote sensing image analysis during the last decades. Besides well-known statistical approaches, many recent methods are based on techniques taken from the field of machine learning. A major aim of machine learning algorithms in remote sensing is supervised classification, which is perhaps the most widely usedimageclassificationapproach.Inthischapterabriefintroductiontomachinelearningand the different paradigms in remote sensing is given. Moreover this chapter briefly discusses the use of recent developments in supervised classification techniques such as neural networks, support vector machines and multiple classifier systems.

Björn Waske

Papers

Incremental Import Vector Machines for Classifying Hyperspectral Data

Mapping Land Management Regimes in Western Ukraine Using Optical and SAR Data

Importance of spatially distributed hydrologic variables for land use change modeling

Editors Choice Article: I2VM: Incremental import vector machines

Machine Learning Techniques in Remote Sensing Data Analysis